2023-05-11T21:05:35.159 INFO:root:teuthology version: 0.0.1.dev98+g69caab8
2023-05-11T21:05:35.321 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2023-05-11T21:05:35.322 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2023-05-11T21:05:35.322 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-05-11T21:05:35.353 INFO:teuthology.lock.ops:Node 'smithi161.front.sepia.ceph.com' reimaging is complete
2023-05-11T21:05:35.354 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging
2023-05-11T21:05:35.354 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server
2023-05-11T21:05:35.354 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2023-05-11T21:05:39.270 INFO:teuthology.lock.ops:Node 'smithi162.front.sepia.ceph.com' reimaging is complete
2023-05-11T21:05:50.849 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 8.stream
2023-05-11T21:05:50.858 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream
2023-05-11T21:06:02.028 INFO:teuthology.orchestra.console:Power off smithi162
2023-05-11T21:06:02.047 INFO:teuthology.orchestra.console:Power off smithi161
2023-05-11T21:06:10.408 INFO:teuthology.orchestra.console:Power off for smithi162 completed
2023-05-11T21:06:10.415 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2023-05-11T21:06:10.510 INFO:teuthology.orchestra.console:Power on smithi162
2023-05-11T21:06:10.519 INFO:teuthology.orchestra.console:Power on smithi161
2023-05-11T21:06:18.887 INFO:teuthology.orchestra.console:Power on for smithi161 completed
2023-05-11T21:06:18.956 INFO:teuthology.orchestra.console:Power on for smithi162 completed
2023-05-11T21:06:18.989 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2023-05-11T21:06:23.997 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish
2023-05-11T21:06:42.416 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-05-11T21:06:58.747 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-05-11T21:07:12.816 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-05-11T21:07:21.872 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-05-11T21:07:51.280 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-05-11T21:07:58.132 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-05-11T21:08:14.218 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: Authentication failed.
2023-05-11T21:08:15.337 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: Authentication failed.
2023-05-11T21:08:16.415 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: Authentication failed.
2023-05-11T21:08:17.534 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: Authentication failed.
2023-05-11T21:08:23.618 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: Authentication failed.
2023-05-11T21:08:34.698 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: Authentication failed.
2023-05-11T21:08:35.778 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: Authentication failed.
2023-05-11T21:08:36.894 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: Authentication failed.
2023-05-11T21:08:43.016 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: Authentication failed.
2023-05-11T21:08:48.362 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: Authentication failed.
2023-05-11T21:08:48.362 WARNING:teuthology.provision.fog:'connect to smithi162.front.sepia.ceph.com' reached maximum tries (10) after waiting for 10 seconds
2023-05-11T21:09:17.876 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-05-11T21:09:31.956 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-05-11T21:09:46.032 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-05-11T21:09:59.371 WARNING:teuthology.provision.fog:timed out
2023-05-11T21:10:00.112 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-05-11T21:10:29.492 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-05-11T21:10:38.576 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-05-11T21:10:50.107 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-05-11T21:11:05.376 WARNING:teuthology.provision.fog:timed out
2023-05-11T21:11:05.692 INFO:teuthology.provision.fog.smithi161:Node is ready
2023-05-11T21:11:05.717 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2023-05-11T21:11:05.779 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2023-05-11T21:11:06.136 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2023-05-11T21:11:11.630 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-05-11T21:11:11.886 INFO:teuthology.provision.fog.smithi162:Node is ready
2023-05-11T21:11:11.946 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com
2023-05-11T21:11:12.006 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162
2023-05-11T21:11:12.350 INFO:teuthology.provision.fog.smithi162:Deploy complete!
2023-05-11T21:11:27.516 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2023-05-11T21:11:27.517 INFO:teuthology.lock.ops:New key found. Updating...
2023-05-11T21:11:32.551 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com
2023-05-11T21:11:32.551 INFO:teuthology.lock.ops:New key found. Updating...
2023-05-11T21:11:37.585 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2023-05-11T21:11:37.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-05-11T21:11:42.857 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2023-05-11T21:11:42.916 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2023-05-11T21:11:42.916 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8"
2023-05-11T21:11:42.917 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2023-05-11T21:11:42.917 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2023-05-11T21:11:42.917 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8"
2023-05-11T21:11:42.917 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-05-11T21:11:42.917 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8"
2023-05-11T21:11:42.917 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-05-11T21:11:42.917 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-05-11T21:11:42.918 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2023-05-11T21:11:42.918 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-05-11T21:11:42.918 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-05-11T21:11:42.918 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-05-11T21:11:42.919 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-05-11T21:11:47.950 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server
2023-05-11T21:11:47.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com'
2023-05-11T21:11:48.228 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64
2023-05-11T21:11:48.289 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream"
2023-05-11T21:11:48.290 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8"
2023-05-11T21:11:48.290 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos"
2023-05-11T21:11:48.290 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora"
2023-05-11T21:11:48.290 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8"
2023-05-11T21:11:48.290 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8"
2023-05-11T21:11:48.290 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 8"
2023-05-11T21:11:48.290 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31"
2023-05-11T21:11:48.291 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-05-11T21:11:48.291 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/"
2023-05-11T21:11:48.291 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-05-11T21:11:48.291 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-05-11T21:11:48.291 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-05-11T21:11:48.292 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2023-05-11T21:11:52.126 INFO:teuthology.dispatcher.supervisor:Running job 7271612
2023-05-11T21:11:52.126 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-05-11_20:55:58-rados-wip-yuri11-testing-2023-05-11-0817-pacific-distro-default-smithi/7271612 --name yuriw-2023-05-11_20:55:58-rados-wip-yuri11-testing-2023-05-11-0817-pacific-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-05-11_20:55:58-rados-wip-yuri11-testing-2023-05-11-0817-pacific-distro-default-smithi/7271612/orig.config.yaml
2023-05-11T21:11:52.134 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-05-11_20:55:58-rados-wip-yuri11-testing-2023-05-11-0817-pacific-distro-default-smithi/7271612
2023-05-11T21:11:52.135 INFO:teuthology.dispatcher.supervisor:Job PID: 3071
2023-05-11T21:11:52.135 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-05-12T09:13:27.228 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-05-12T09:13:27.400 INFO:teuthology.kill:Killing Pids: {3071}
2023-05-12T09:13:28.241 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2023-05-12T09:13:28.242 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2023-05-12T09:13:28.242 INFO:teuthology.misc:Compressing logs...
2023-05-12T09:13:28.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-05-12T09:13:28.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com'
2023-05-12T09:13:28.694 INFO:teuthology.misc:Compressing logs...
2023-05-12T09:13:28.725 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-05-12T09:13:28.725 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-05-12T09:13:28.726 INFO:teuthology.orchestra.run.smithi161.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	/home/ubuntu/cephtest/archive/syslog/misc.log:	 87.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-05-12T09:13:28.765 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-05-12T09:13:28.765 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-05-12T09:13:28.765 INFO:teuthology.orchestra.run.smithi162.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	 78.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-05-12T09:13:28.885 INFO:teuthology.orchestra.run.smithi161.stderr: 91.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-05-12T09:13:28.922 INFO:teuthology.orchestra.run.smithi162.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log:	 91.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-05-12T09:13:29.033 INFO:teuthology.misc:Compressing logs...
2023-05-12T09:13:29.061 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2023-05-12T09:13:29.062 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mon.smithi161.log
2023-05-12T09:13:29.063 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-volume.log
2023-05-12T09:13:29.063 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/cephadm.log:	  0.0% -- replaced with /var/log/ceph/cephadm.log.gz
2023-05-12T09:13:29.063 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.2.log
2023-05-12T09:13:29.064 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mon.smithi161.log:	gzip -5 --verbose -- /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.0.log
2023-05-12T09:13:29.064 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-volume.log:	/var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.2.log:	gzip -5 --verbose -- /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mgr.smithi161.lwnggj.log
2023-05-12T09:13:29.064 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.0.log:	gzip -5 --verbose -- /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.1.log
2023-05-12T09:13:29.065 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mgr.smithi161.lwnggj.log:	/var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.1.log:	 89.9% -- replaced with /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-volume.log.gz
2023-05-12T09:13:29.095 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2023-05-12T09:13:29.095 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-volume.log
2023-05-12T09:13:29.096 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.3.log
2023-05-12T09:13:29.097 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/cephadm.log:	  0.0% -- replaced with /var/log/ceph/cephadm.log.gz
2023-05-12T09:13:29.097 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mon.smithi162.log
2023-05-12T09:13:29.097 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-volume.log:	  0.0% -- replaced with /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-volume.log.gz
2023-05-12T09:13:29.097 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.3.log:	gzip -5 --verbose -- /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.4.log
2023-05-12T09:13:29.097 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.5.log
2023-05-12T09:13:29.097 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mon.smithi162.log:	/var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.4.log:	gzip -5 --verbose -- /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mgr.smithi162.grvolu.log
2023-05-12T09:13:29.166 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.5.log:	/var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mgr.smithi162.grvolu.log:	 94.7% -- replaced with /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mgr.smithi162.grvolu.log.gz
2023-05-12T09:13:32.507 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mon.smithi162.log: file size changed while zipping
2023-05-12T09:13:32.507 INFO:teuthology.orchestra.run.smithi162.stderr: 93.0% -- replaced with /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mon.smithi162.log.gz
2023-05-12T09:13:33.570 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2023-05-12T09:13:33.571 INFO:teuthology.orchestra.run.smithi162.stderr: 93.8% -- replaced with /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.4.log.gz
2023-05-12T09:13:33.752 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2023-05-12T09:13:33.752 INFO:teuthology.orchestra.run.smithi162.stderr: 93.9% -- replaced with /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.5.log.gz
2023-05-12T09:13:34.740 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2023-05-12T09:13:34.740 INFO:teuthology.orchestra.run.smithi162.stderr: 94.1% -- replaced with /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.3.log.gz
2023-05-12T09:13:35.709 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mgr.smithi161.lwnggj.log: file size changed while zipping
2023-05-12T09:13:35.709 INFO:teuthology.orchestra.run.smithi161.stderr: 92.3% -- replaced with /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mgr.smithi161.lwnggj.log.gz
2023-05-12T09:13:38.636 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2023-05-12T09:13:38.637 INFO:teuthology.orchestra.run.smithi161.stderr: 93.8% -- replaced with /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.0.log.gz
2023-05-12T09:13:39.778 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2023-05-12T09:13:39.778 INFO:teuthology.orchestra.run.smithi161.stderr: 93.7% -- replaced with /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.2.log.gz
2023-05-12T09:13:41.350 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2023-05-12T09:13:41.351 INFO:teuthology.orchestra.run.smithi161.stderr: 94.0% -- replaced with /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-osd.1.log.gz
2023-05-12T09:13:50.035 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mon.smithi161.log: file size changed while zipping
2023-05-12T09:13:50.035 INFO:teuthology.orchestra.run.smithi161.stderr: 89.8% -- replaced with /var/log/ceph/c91bf1b6-f042-11ed-9b02-001a4aab830c/ceph-mon.smithi161.log.gz
2023-05-12T09:14:01.972 INFO:teuthology.kill:No teuthology processes running
2023-05-12T09:14:02.816 INFO:teuthology.kill:Nuking machines: ['smithi161', 'smithi162']
2023-05-12T09:14:03.407 INFO:teuthology.kill:2023-05-12 09:14:03,406.406 INFO:teuthology.nuke:targets:
2023-05-12T09:14:03.408 INFO:teuthology.kill:  smithi161.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdVl5OSwO8OZ+RfP+OZkS2xAqjCGyWQCv2G4al+w3ilX4tesckkdXVLS+fD2F/CiNy95Bdl5u3Ei6aZZ4CmtDAtg5L7IUJLd4zxz51fer+qtHYpZxhLsfugzjyHW/8MoTLzIvjvyl32bYo+HBskDVk51sVIpePuZwVs9sji5xcwZivOOzV6cZK3snbM0EMvLvct/UbG98FsK2+deMtEgLDsx72OK2+6Jgb3iK6bA8jb5Pmi7yqsAuZDJ3MPYHoJbLqOdc+PHjnNK1dIhZnaxnIEfBmAPEJMncMPvwV6ORtuG7ZmnA1WfuKJFTJ7NwOBNGnM4Y6V/Qb4SkcjfqnNKfuY5QOx2ngu6ZOpZ5Uh49Ov6+loIzlq949/vBN1UJgcLlJOjZCWs/Uot66ZNclh9J0BiA3wRZC5wMeQRFz/tI2a7n2D6waLpxP4FbqWnKriVIWQMn6NE+z4F9e2GgoFyDp5x+F0smFWKrl31L8cxUvDz546b+2VyOqbzqe/BiSyvk=
2023-05-12T09:14:03.408 INFO:teuthology.kill:  smithi162.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxXb0vsO1pPHSnPg5h5ug3o756ywukqg97g+aRf942LFmZfdVELjJvx3FzuV1qoRRkM9xKxH73aGyaA3bGEvlxCYjtW+YlUlbQFFt4t2QhXZiMC3mJM5vW6OlEtrRSyjfzGgZwPLQJWsUTgY63RqWL78Lw+3CHx0Ukipc7xBQv1fp7vxwjkuBQLkKsd3pNOFL1e4CHRJta5v1nNuTQYmyAgudIdQeIRNdoBCmqqQJBva/7WmNQa4rtz2rOcS1T7piY73OoeAahBjBFgPmn78oFdoyw7dW/Qrkcc/k+YGQ7AXTzP+An1U8OeBcMUyTjUncOI09h0PpTZXT36yCBHFa7WTJ8G267n/5RUn243X2wZmJ8dsTRAU+o0kyJGQr6INwPzaPr4bU6refofcfL+3zYHa1FFVnamfiRuc7qrIfpyN5Ke+GYrZTC0q4fHbzXVjl9EtRbPP48uAliLSfcDPVq4RNZVnTizH/mNHuua1S/HrqRWNswR1yE87G6PpW2nRM=
2023-05-12T09:14:03.408 INFO:teuthology.kill:2023-05-12 09:14:03,407.407 INFO:teuthology.nuke:Checking targets against current locks
2023-05-12T09:14:03.464 INFO:teuthology.kill:2023-05-12 09:14:03,464.464 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-05-12T09:14:03.489 INFO:teuthology.kill:2023-05-12 09:14:03,489.489 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-05-12T09:14:03.546 INFO:teuthology.kill:2023-05-12 09:14:03,545.545 INFO:teuthology.orchestra.console:Power off smithi161
2023-05-12T09:14:03.561 INFO:teuthology.kill:2023-05-12 09:14:03,561.561 INFO:teuthology.orchestra.console:Power off smithi162
2023-05-12T09:14:16.033 INFO:teuthology.kill:2023-05-12 09:14:16,033.033 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2023-05-12T09:14:16.040 INFO:teuthology.kill:2023-05-12 09:14:16,040.040 INFO:teuthology.orchestra.console:Power off for smithi162 completed
2023-05-12T09:14:16.193 INFO:teuthology.kill:2023-05-12 09:14:16,193.193 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com
2023-05-12T09:14:16.202 INFO:teuthology.kill:2023-05-12 09:14:16,201.201 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com
2023-05-12T09:16:16.477 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-05-12T09:16:16.588 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi161 but it was locked by another job: /home/teuthworker/archive/vshankar-2023-05-12_08:25:27-fs-wip-vshankar-testing-20230509.090020-1-testing-default-smithi/7272443
2023-05-12T09:16:16.588 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi162 but it was locked by another job: /home/teuthworker/archive/vshankar-2023-05-12_08:25:27-fs-wip-vshankar-testing-20230509.090020-1-testing-default-smithi/7272442