2022-01-23T14:39:33.617 INFO:root:teuthology version: 1.1.0-75f1bcd2
2022-01-23T14:39:33.785 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi058.front.sepia.ceph.com' reimaging
2022-01-23T14:39:33.786 INFO:teuthology.lock.ops:Updating [ubuntu@smithi058.front.sepia.ceph.com]: reset os type and version on server
2022-01-23T14:39:33.786 INFO:teuthology.lock.ops:Updating smithi058.front.sepia.ceph.com on lock server
2022-01-23T14:39:33.805 INFO:teuthology.lock.ops:Node 'ubuntu@smithi058.front.sepia.ceph.com' reimaging is complete
2022-01-23T14:39:33.805 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi072.front.sepia.ceph.com' reimaging
2022-01-23T14:39:33.805 INFO:teuthology.lock.ops:Updating [ubuntu@smithi072.front.sepia.ceph.com]: reset os type and version on server
2022-01-23T14:39:33.806 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2022-01-23T14:39:33.823 INFO:teuthology.lock.ops:Node 'ubuntu@smithi072.front.sepia.ceph.com' reimaging is complete
2022-01-23T14:39:34.014 INFO:teuthology.provision.fog.smithi058:Scheduling deploy of centos 8.stream
2022-01-23T14:39:34.027 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of centos 8.stream
2022-01-23T14:39:34.322 INFO:teuthology.orchestra.console:Power off smithi058
2022-01-23T14:39:34.337 INFO:teuthology.orchestra.console:Power off smithi072
2022-01-23T14:39:42.689 INFO:teuthology.orchestra.console:Power off for smithi058 completed
2022-01-23T14:39:42.791 INFO:teuthology.orchestra.console:Power on smithi058
2022-01-23T14:39:46.808 INFO:teuthology.orchestra.console:Power off for smithi072 completed
2022-01-23T14:39:46.911 INFO:teuthology.orchestra.console:Power on smithi072
2022-01-23T14:39:51.157 INFO:teuthology.orchestra.console:Power on for smithi058 completed
2022-01-23T14:39:51.162 INFO:teuthology.orchestra.console:Power on for smithi072 completed
2022-01-23T14:39:51.259 INFO:teuthology.provision.fog.smithi058:Waiting for deploy to finish
2022-01-23T14:39:51.265 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish
2022-01-23T14:43:52.740 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: Authentication timeout.
2022-01-23T14:43:56.088 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-23T14:43:56.378 INFO:teuthology.provision.fog.smithi058:Node is ready
2022-01-23T14:43:56.395 INFO:teuthology.orchestra.run.smithi058.stdout:smithi058.front.sepia.ceph.com
2022-01-23T14:43:56.454 INFO:teuthology.orchestra.run.smithi058.stdout:172.21.15.58 smithi058.front.sepia.ceph.com smithi058
2022-01-23T14:43:56.801 INFO:teuthology.provision.fog.smithi058:Deploy complete!
2022-01-23T14:45:00.177 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-23T14:45:00.544 INFO:teuthology.provision.fog.smithi072:Node is ready
2022-01-23T14:45:00.561 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com
2022-01-23T14:45:00.617 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072
2022-01-23T14:45:00.959 INFO:teuthology.provision.fog.smithi072:Deploy complete!
2022-01-23T14:45:01.137 INFO:teuthology.lock.ops:Checking smithi058.front.sepia.ceph.com
2022-01-23T14:45:01.138 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-23T14:45:01.188 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com
2022-01-23T14:45:01.189 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-23T14:45:01.207 INFO:teuthology.lock.ops:Updating [smithi058.front.sepia.ceph.com]: set os type and version on server
2022-01-23T14:45:01.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi058.front.sepia.ceph.com'
2022-01-23T14:45:01.457 INFO:teuthology.orchestra.run.smithi058.stdout:x86_64
2022-01-23T14:45:01.513 INFO:teuthology.orchestra.run.smithi058.stdout:NAME="CentOS Stream"
2022-01-23T14:45:01.514 INFO:teuthology.orchestra.run.smithi058.stdout:VERSION="8"
2022-01-23T14:45:01.514 INFO:teuthology.orchestra.run.smithi058.stdout:ID="centos"
2022-01-23T14:45:01.514 INFO:teuthology.orchestra.run.smithi058.stdout:ID_LIKE="rhel fedora"
2022-01-23T14:45:01.514 INFO:teuthology.orchestra.run.smithi058.stdout:VERSION_ID="8"
2022-01-23T14:45:01.515 INFO:teuthology.orchestra.run.smithi058.stdout:PLATFORM_ID="platform:el8"
2022-01-23T14:45:01.515 INFO:teuthology.orchestra.run.smithi058.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-23T14:45:01.515 INFO:teuthology.orchestra.run.smithi058.stdout:ANSI_COLOR="0;31"
2022-01-23T14:45:01.516 INFO:teuthology.orchestra.run.smithi058.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-23T14:45:01.516 INFO:teuthology.orchestra.run.smithi058.stdout:HOME_URL="https://centos.org/"
2022-01-23T14:45:01.516 INFO:teuthology.orchestra.run.smithi058.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-23T14:45:01.516 INFO:teuthology.orchestra.run.smithi058.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-23T14:45:01.517 INFO:teuthology.orchestra.run.smithi058.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-23T14:45:01.518 INFO:teuthology.lock.ops:Updating smithi058.front.sepia.ceph.com on lock server
2022-01-23T14:45:01.535 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server
2022-01-23T14:45:01.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com'
2022-01-23T14:45:01.729 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64
2022-01-23T14:45:01.786 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream"
2022-01-23T14:45:01.786 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8"
2022-01-23T14:45:01.786 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos"
2022-01-23T14:45:01.787 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora"
2022-01-23T14:45:01.787 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8"
2022-01-23T14:45:01.787 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8"
2022-01-23T14:45:01.787 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-23T14:45:01.787 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31"
2022-01-23T14:45:01.788 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-23T14:45:01.788 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/"
2022-01-23T14:45:01.788 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-23T14:45:01.788 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-23T14:45:01.789 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-23T14:45:01.789 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2022-01-23T14:45:01.887 INFO:teuthology.dispatcher.supervisor:Running job 6635832
2022-01-23T14:45:01.887 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-01-23_03:31:03-rados-pacific-distro-default-smithi/6635832 --name teuthology-2022-01-23_03:31:03-rados-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/teuthology-2022-01-23_03:31:03-rados-pacific-distro-default-smithi/6635832/orig.config.yaml
2022-01-23T14:45:01.890 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-01-23_03:31:03-rados-pacific-distro-default-smithi/6635832
2022-01-23T14:45:01.891 INFO:teuthology.dispatcher.supervisor:Job PID: 17659
2022-01-23T14:45:01.892 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-23T14:45:09.707 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-01-23T21:15:30.554 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-23T21:15:30.736 INFO:teuthology.kill:Killing Pids: {17659}
2022-01-23T21:15:31.890 INFO:teuthology.task.internal:roles: ubuntu@smithi058.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-23T21:15:31.891 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-23T21:15:31.891 INFO:teuthology.misc:Compressing logs...
2022-01-23T21:15:31.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi058.front.sepia.ceph.com'
2022-01-23T21:15:32.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com'
2022-01-23T21:15:32.140 INFO:teuthology.orchestra.run.smithi058.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-23T21:15:32.323 INFO:teuthology.orchestra.run.smithi072.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-23T21:15:32.387 INFO:teuthology.orchestra.run.smithi058.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-23T21:15:32.388 INFO:teuthology.orchestra.run.smithi058.stderr:tar: Error is not recoverable: exiting now
2022-01-23T21:15:32.437 INFO:teuthology.orchestra.run.smithi072.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-23T21:15:32.437 INFO:teuthology.orchestra.run.smithi072.stderr:tar: Error is not recoverable: exiting now
2022-01-23T21:15:32.439 INFO:teuthology.misc:Compressing logs...
2022-01-23T21:15:32.868 INFO:teuthology.misc:Compressing logs...
2022-01-23T21:15:57.418 INFO:teuthology.orchestra.run.smithi058.stderr:gzip: /var/log/ceph/3856c44a-7c5c-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-23T21:15:59.619 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/3856c44a-7c5c-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-23T21:16:02.658 INFO:teuthology.orchestra.run.smithi058.stderr:gzip: /var/log/ceph/3856c44a-7c5c-11ec-8c35-001a4aab830c/ceph-mgr.smithi058.fqylgw.log: file size changed while zipping
2022-01-23T21:16:21.924 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/3856c44a-7c5c-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-23T21:16:23.852 INFO:teuthology.orchestra.run.smithi058.stderr:gzip: /var/log/ceph/3856c44a-7c5c-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-23T21:16:37.945 INFO:teuthology.orchestra.run.smithi058.stderr:gzip: /var/log/ceph/3856c44a-7c5c-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-23T21:16:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/3856c44a-7c5c-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-23T21:16:44.735 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/3856c44a-7c5c-11ec-8c35-001a4aab830c/ceph-mon.smithi072.log: file size changed while zipping
2022-01-23T21:17:02.393 INFO:teuthology.orchestra.run.smithi058.stderr:gzip: /var/log/ceph/3856c44a-7c5c-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-23T21:17:03.716 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/3856c44a-7c5c-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-23T21:17:15.211 INFO:teuthology.orchestra.run.smithi058.stderr:gzip: /var/log/ceph/3856c44a-7c5c-11ec-8c35-001a4aab830c/ceph-mon.smithi058.log: file size changed while zipping
2022-01-23T21:17:54.613 INFO:teuthology.orchestra.run.smithi072.stderr:tar: .: file changed as we read it
2022-01-23T21:17:54.677 INFO:teuthology.kill:No teuthology processes running
2022-01-23T21:17:55.848 INFO:teuthology.kill:Nuking machines: ['smithi058', 'smithi072']
2022-01-23T21:17:56.803 INFO:teuthology.kill:2022-01-23 21:17:56,803.803 INFO:teuthology.nuke:targets:
2022-01-23T21:17:56.804 INFO:teuthology.kill:  smithi058.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjo6pQBZIbYwEUWzutAzgsbx2iernYN8XcXDT8h0zjllSn+S8gP7VAWilIkgC3Xxg1wRTAxqQKXqcKAemJzydkEfQRoX8E1oPeyX89W7GOnAg32DfKmRdEXegvSm4YfFwcVWGqc8mrj4OT5y2x8Y3IhcdqaHxa1nDJv4wGV4bT4gBP3hgVmXu+prghwA61W40GCMLGL2qiAZl/XWI53SFXAShVXOk2bjYmGFRbZdLxme0jVR9H8EA0/XJ6nh35qtNmypaB6VpRE9HXayF/BwJbfzel2mL+D+uA8B6Z5uzNvG5IwzufKn4zKcDsCmLXU/gfZRA0yvyQFcht3PNrbWmZNICR90b/trm0sIjbb+WAXlJ8xk4aAVHZzWD3J0s4u/FHcqHeIFc5Q/rONEgg7yb39LMXLT8g2MYualPBeEQvVZjhuER1vRtWQ8MVjq1bJQC/qSGMDJtxT7oSWkWHeukKI2ifSS33+arluLUXXChJE8eyxm8v0IGxe++6U8OzrqU=
2022-01-23T21:17:56.804 INFO:teuthology.kill:  smithi072.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7LN7buyjD0jKwNZkOusgWB5dZoo9FqxV9hz+559ZVPx2pfRUPduFChSIlZIe6asg7PoUsTP9j5qaALgrRiQejNKlWIeZBFk2UAjAbQVVU4E+Z84uUmnaFC2G3DljdMXPvqIhn2J8WzZHnoP97Z25eRb1YaCGCUM/+P83fdaTYpA5PBYKQG5PCjM+GDN9l3trfiuBFvy6KajV0h3Ni0Vk6rJHrq50XO5HyBCCK+Wno6x6L62ITJFVVswwyTGthUIkCqzJywBzsilkJfBNtDSZBXGLPi66+SLxMIh2sNt6ZxaB8tEiPkCt96p+0f+eD6zuTC+sNzOl+a+fxMMUlVkimNchiPqbW/nS1q0sMT4XQHvrb7sv0cqjJxqX7mpr9NHYhQyGHf0SNGi43WyuLY9COuisAFlS6n9NUDtMyhRNd5F9bEc/nqMWRsKdNW6vzJYnsrN2dv8pnbxd+ZC/NwntyT2x9oNhrvlC9WhnQjaspbu2WWk4OAjc6xN5bpn55l8s=
2022-01-23T21:17:56.831 INFO:teuthology.kill:2022-01-23 21:17:56,830.830 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-23T21:17:56.834 INFO:teuthology.kill:2022-01-23 21:17:56,833.833 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-23T21:17:56.908 INFO:teuthology.kill:2022-01-23 21:17:56,908.908 INFO:teuthology.orchestra.console:Power off smithi072
2022-01-23T21:17:56.922 INFO:teuthology.kill:2022-01-23 21:17:56,922.922 INFO:teuthology.orchestra.console:Power off smithi058
2022-01-23T21:18:05.277 INFO:teuthology.kill:2022-01-23 21:18:05,277.277 INFO:teuthology.orchestra.console:Power off for smithi072 completed
2022-01-23T21:18:05.282 INFO:teuthology.kill:2022-01-23 21:18:05,282.282 INFO:teuthology.orchestra.console:Power off for smithi058 completed
2022-01-23T21:18:05.425 INFO:teuthology.kill:2022-01-23 21:18:05,424.424 INFO:teuthology.lock.ops:unlocked: smithi058.front.sepia.ceph.com
2022-01-23T21:18:05.428 INFO:teuthology.kill:2022-01-23 21:18:05,427.427 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com
2022-01-23T21:20:05.728 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-23T21:20:05.822 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi058 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-20_03:05:02-rgw-master-distro-default-smithi/6628366
2022-01-23T21:20:05.823 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi072 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-20_03:05:02-rgw-master-distro-default-smithi/6628366