2023-05-12T00:59:18.723 INFO:root:teuthology version: 0.0.1.dev98+g69caab8
2023-05-12T00:59:18.900 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging
2023-05-12T00:59:18.902 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server
2023-05-12T00:59:18.902 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-05-12T00:59:18.931 INFO:teuthology.lock.ops:Node 'smithi062.front.sepia.ceph.com' reimaging is complete
2023-05-12T00:59:18.931 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging
2023-05-12T00:59:18.931 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server
2023-05-12T00:59:18.932 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server
2023-05-12T00:59:18.955 INFO:teuthology.lock.ops:Node 'smithi096.front.sepia.ceph.com' reimaging is complete
2023-05-12T00:59:19.124 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of centos 8.stream
2023-05-12T00:59:19.128 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 8.stream
2023-05-12T00:59:39.382 INFO:teuthology.orchestra.console:Power off smithi062
2023-05-12T00:59:39.401 INFO:teuthology.orchestra.console:Power off smithi096
2023-05-12T01:00:23.545 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2023-05-12T01:00:23.647 INFO:teuthology.orchestra.console:Power on smithi062
2023-05-12T01:00:24.549 INFO:teuthology.orchestra.console:Power off for smithi096 completed
2023-05-12T01:00:24.650 INFO:teuthology.orchestra.console:Power on smithi096
2023-05-12T01:00:54.461 INFO:teuthology.orchestra.console:Power on for smithi096 completed
2023-05-12T01:00:54.562 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish
2023-05-12T01:00:59.674 INFO:teuthology.orchestra.console:Power on for smithi062 completed
2023-05-12T01:00:59.775 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2023-05-12T01:01:04.781 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-05-12T01:01:15.790 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-05-12T01:01:18.872 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-05-12T01:01:31.801 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-05-12T01:01:34.864 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-05-12T01:01:56.208 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-05-12T01:02:04.400 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-05-12T01:02:04.814 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-05-12T01:02:20.489 ERROR:teuthology.orchestra.connection:Error authenticating with smithi096.front.sepia.ceph.com: Authentication failed.
2023-05-12T01:02:20.498 ERROR:teuthology.orchestra.connection:Error authenticating with smithi062.front.sepia.ceph.com: Authentication failed.
2023-05-12T01:02:26.563 ERROR:teuthology.orchestra.connection:Error authenticating with smithi096.front.sepia.ceph.com: Authentication failed.
2023-05-12T01:02:26.582 ERROR:teuthology.orchestra.connection:Error authenticating with smithi062.front.sepia.ceph.com: Authentication failed.
2023-05-12T01:02:42.639 ERROR:teuthology.orchestra.connection:Error authenticating with smithi096.front.sepia.ceph.com: Authentication failed.
2023-05-12T01:02:42.650 ERROR:teuthology.orchestra.connection:Error authenticating with smithi062.front.sepia.ceph.com: Authentication failed.
2023-05-12T01:02:48.722 ERROR:teuthology.orchestra.connection:Error authenticating with smithi096.front.sepia.ceph.com: Authentication failed.
2023-05-12T01:02:48.734 ERROR:teuthology.orchestra.connection:Error authenticating with smithi062.front.sepia.ceph.com: Authentication failed.
2023-05-12T01:02:59.798 ERROR:teuthology.orchestra.connection:Error authenticating with smithi096.front.sepia.ceph.com: Authentication failed.
2023-05-12T01:02:59.809 ERROR:teuthology.orchestra.connection:Error authenticating with smithi062.front.sepia.ceph.com: Authentication failed.
2023-05-12T01:03:10.875 ERROR:teuthology.orchestra.connection:Error authenticating with smithi096.front.sepia.ceph.com: Authentication failed.
2023-05-12T01:03:16.058 ERROR:teuthology.orchestra.connection:Error authenticating with smithi096.front.sepia.ceph.com: Authentication failed.
2023-05-12T01:03:17.129 ERROR:teuthology.orchestra.connection:Error authenticating with smithi096.front.sepia.ceph.com: Authentication failed.
2023-05-12T01:03:18.241 ERROR:teuthology.orchestra.connection:Error authenticating with smithi096.front.sepia.ceph.com: Authentication failed.
2023-05-12T01:03:45.268 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-05-12T01:03:54.324 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-05-12T01:04:03.376 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-05-12T01:04:24.246 WARNING:teuthology.provision.fog:timed out
2023-05-12T01:04:38.320 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-05-12T01:04:46.189 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-05-12T01:04:47.376 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-05-12T01:04:56.432 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-05-12T01:05:02.695 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-05-12T01:05:06.851 INFO:teuthology.provision.fog.smithi062:Node is ready
2023-05-12T01:05:06.877 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com
2023-05-12T01:05:06.938 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062
2023-05-12T01:05:07.302 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2023-05-12T01:05:28.440 INFO:teuthology.provision.fog.smithi096:Node is ready
2023-05-12T01:05:28.463 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com
2023-05-12T01:05:28.525 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096
2023-05-12T01:05:28.873 INFO:teuthology.provision.fog.smithi096:Deploy complete!
2023-05-12T01:06:04.047 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com
2023-05-12T01:06:04.049 INFO:teuthology.lock.ops:New key found. Updating...
2023-05-12T01:06:05.837 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com
2023-05-12T01:06:05.838 INFO:teuthology.lock.ops:New key found. Updating...
2023-05-12T01:06:05.863 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server
2023-05-12T01:06:05.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-05-12T01:06:09.515 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64
2023-05-12T01:06:09.574 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2023-05-12T01:06:09.575 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8"
2023-05-12T01:06:09.575 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2023-05-12T01:06:09.575 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2023-05-12T01:06:09.575 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8"
2023-05-12T01:06:09.575 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-05-12T01:06:09.575 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8"
2023-05-12T01:06:09.575 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-05-12T01:06:09.576 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-05-12T01:06:09.576 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2023-05-12T01:06:09.576 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-05-12T01:06:09.576 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-05-12T01:06:09.576 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-05-12T01:06:09.577 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-05-12T01:06:14.602 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server
2023-05-12T01:06:14.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com'
2023-05-12T01:06:19.873 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64
2023-05-12T01:06:19.932 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream"
2023-05-12T01:06:19.933 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8"
2023-05-12T01:06:19.933 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos"
2023-05-12T01:06:19.933 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora"
2023-05-12T01:06:19.933 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8"
2023-05-12T01:06:19.933 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8"
2023-05-12T01:06:19.933 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8"
2023-05-12T01:06:19.933 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31"
2023-05-12T01:06:19.934 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-05-12T01:06:19.934 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/"
2023-05-12T01:06:19.934 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-05-12T01:06:19.934 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-05-12T01:06:19.934 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-05-12T01:06:19.935 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server
2023-05-12T01:06:30.079 INFO:teuthology.dispatcher.supervisor:Running job 7271916
2023-05-12T01:06:30.080 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-05-11_20:55:58-rados-wip-yuri11-testing-2023-05-11-0817-pacific-distro-default-smithi/7271916 --name yuriw-2023-05-11_20:55:58-rados-wip-yuri11-testing-2023-05-11-0817-pacific-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-05-11_20:55:58-rados-wip-yuri11-testing-2023-05-11-0817-pacific-distro-default-smithi/7271916/orig.config.yaml
2023-05-12T01:06:30.084 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-05-11_20:55:58-rados-wip-yuri11-testing-2023-05-11-0817-pacific-distro-default-smithi/7271916
2023-05-12T01:06:30.085 INFO:teuthology.dispatcher.supervisor:Job PID: 28264
2023-05-12T01:06:30.085 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-05-12T13:07:06.442 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-05-12T13:07:06.643 INFO:teuthology.kill:Killing Pids: {28264}
2023-05-12T13:07:07.517 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2023-05-12T13:07:07.518 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2023-05-12T13:07:07.518 INFO:teuthology.misc:Compressing logs...
2023-05-12T13:07:07.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-05-12T13:07:07.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com'
2023-05-12T13:07:08.011 INFO:teuthology.misc:Compressing logs...
2023-05-12T13:07:08.054 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-05-12T13:07:08.055 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-05-12T13:07:08.056 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	/home/ubuntu/cephtest/archive/syslog/misc.log:	 87.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-05-12T13:07:08.083 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-05-12T13:07:08.083 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-05-12T13:07:08.084 INFO:teuthology.orchestra.run.smithi096.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	/home/ubuntu/cephtest/archive/syslog/misc.log:	 76.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-05-12T13:07:08.161 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-05-12T13:07:08.161 INFO:teuthology.orchestra.run.smithi062.stderr: 92.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-05-12T13:07:08.179 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-05-12T13:07:08.179 INFO:teuthology.orchestra.run.smithi096.stderr: 92.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-05-12T13:07:08.284 INFO:teuthology.misc:Compressing logs...
2023-05-12T13:07:08.312 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2023-05-12T13:07:08.313 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-volume.log
2023-05-12T13:07:08.314 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.2.log
2023-05-12T13:07:08.314 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/cephadm.log:	gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi062.ljiwoo.log
2023-05-12T13:07:08.314 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-volume.log:	/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.2.log:	gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.0.log
2023-05-12T13:07:08.314 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mgr.smithi062.zlssyr.log
2023-05-12T13:07:08.316 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi062.ljiwoo.log:	/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.0.log:	gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.1.log
2023-05-12T13:07:08.316 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mgr.smithi062.zlssyr.log:	/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.1.log:	 91.7% -- replaced with /var/log/ceph/cephadm.log.gz
2023-05-12T13:07:08.316 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi062.zndosi.log
2023-05-12T13:07:08.317 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mon.smithi062.log
2023-05-12T13:07:08.323 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi062.zndosi.log:	/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mon.smithi062.log:	 90.1% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-volume.log.gz
2023-05-12T13:07:08.349 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2023-05-12T13:07:08.349 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-volume.log
2023-05-12T13:07:08.350 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mon.smithi096.log
2023-05-12T13:07:08.350 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/cephadm.log:	gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.3.log
2023-05-12T13:07:08.350 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-volume.log:	gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi096.imdvnb.log
2023-05-12T13:07:08.351 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mon.smithi096.log:	/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.3.log:	gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.4.log
2023-05-12T13:07:08.353 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi096.imdvnb.log:	/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.4.log:	 89.0% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-volume.log.gz
2023-05-12T13:07:08.353 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.5.log
2023-05-12T13:07:08.354 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mgr.smithi096.fdjjig.log
2023-05-12T13:07:08.354 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.5.log:	 87.8% -- replaced with /var/log/ceph/cephadm.log.gz
2023-05-12T13:07:08.354 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mgr.smithi096.fdjjig.log:	gzip -5 --verbose -- /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi096.telbnr.log
2023-05-12T13:07:08.495 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi096.telbnr.log:	gzip: /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mgr.smithi096.fdjjig.log: file size changed while zipping
2023-05-12T13:07:08.496 INFO:teuthology.orchestra.run.smithi096.stderr: 94.7% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mgr.smithi096.fdjjig.log.gz
2023-05-12T13:07:13.006 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi096.telbnr.log: file size changed while zipping
2023-05-12T13:07:13.007 INFO:teuthology.orchestra.run.smithi096.stderr: 95.1% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi096.telbnr.log.gz
2023-05-12T13:07:15.030 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mon.smithi096.log: file size changed while zipping
2023-05-12T13:07:15.031 INFO:teuthology.orchestra.run.smithi096.stderr: 92.7% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mon.smithi096.log.gz
2023-05-12T13:07:16.218 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mgr.smithi062.zlssyr.log: file size changed while zipping
2023-05-12T13:07:16.218 INFO:teuthology.orchestra.run.smithi062.stderr: 92.2% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mgr.smithi062.zlssyr.log.gz
2023-05-12T13:07:17.064 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi062.ljiwoo.log: file size changed while zipping
2023-05-12T13:07:17.065 INFO:teuthology.orchestra.run.smithi062.stderr: 95.1% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi062.ljiwoo.log.gz
2023-05-12T13:07:23.257 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2023-05-12T13:07:23.257 INFO:teuthology.orchestra.run.smithi096.stderr: 93.4% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.4.log.gz
2023-05-12T13:07:23.440 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2023-05-12T13:07:23.441 INFO:teuthology.orchestra.run.smithi062.stderr: 93.4% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.2.log.gz
2023-05-12T13:07:25.599 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mon.smithi062.log: file size changed while zipping
2023-05-12T13:07:25.599 INFO:teuthology.orchestra.run.smithi062.stderr: 90.0% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mon.smithi062.log.gz
2023-05-12T13:07:26.338 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2023-05-12T13:07:26.339 INFO:teuthology.orchestra.run.smithi062.stderr: 93.6% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.1.log.gz
2023-05-12T13:07:27.528 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2023-05-12T13:07:27.528 INFO:teuthology.orchestra.run.smithi062.stderr: 93.5% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.0.log.gz
2023-05-12T13:07:30.597 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2023-05-12T13:07:30.597 INFO:teuthology.orchestra.run.smithi096.stderr: 93.6% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.5.log.gz
2023-05-12T13:07:35.870 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2023-05-12T13:07:35.870 INFO:teuthology.orchestra.run.smithi096.stderr: 93.7% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-osd.3.log.gz
2023-05-12T13:07:45.466 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi062.zndosi.log: file size changed while zipping
2023-05-12T13:07:45.466 INFO:teuthology.orchestra.run.smithi062.stderr: 93.5% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi062.zndosi.log.gz
2023-05-12T13:07:59.307 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi096.imdvnb.log: file size changed while zipping
2023-05-12T13:07:59.307 INFO:teuthology.orchestra.run.smithi096.stderr: 93.3% -- replaced with /var/log/ceph/4ab8e3bc-f063-11ed-9b02-001a4aab830c/ceph-mds.cephfs.smithi096.imdvnb.log.gz
2023-05-12T13:08:25.746 INFO:teuthology.kill:No teuthology processes running
2023-05-12T13:08:26.581 INFO:teuthology.kill:Nuking machines: ['smithi062', 'smithi096']
2023-05-12T13:08:27.193 INFO:teuthology.kill:2023-05-12 13:08:27,193.193 INFO:teuthology.nuke:targets:
2023-05-12T13:08:27.195 INFO:teuthology.kill:  smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCv9b9d1Pcfn30fR3ZUG82d1+O509eBnCL3K9abdOAHdH4YS3T+tC+/v9OgmpDQ8XgyW/bB2yQlQ6aZBvw9jT5OskdPTUW/e3YJ87/2t0hzpoz3iK1P19pD4e+z+Uk6w3OTDYRubinfFtuw++poyf+UvYPD616dK7eNc8prGK7PLpDVP0ZNK+ehma6TbOWHsgfBG8PCHhcuJ3YTp3sxXEdf52PFJUC3fICBlDzocfmHq8imfgK3c6mFp+M6/SMNhAQAmZWBdygeAc3BUUXRPHgQ+Is2sHIC7CuPkc1ittZ0/oakuztmZeUGX5ITao1WWTiQQYeyuDemzgQ1ZTNdfIXbOejL843EqMt5pX8zW4aNZGQTbGhH9A3GKKKNFD0c5aLUUfhEsH+P/JbLFJbO/Tw6Bnoj21FlCJRJrd8sKRlg/P5APgwQyATwGGj5wmQdeqPzo7cc9pkq+OgTyfqa58M9Dt+G22xirHt/QwVgMfNIWci5ilK1SUDbHcaYmgJGSvc=
2023-05-12T13:08:27.195 INFO:teuthology.kill:  smithi096.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCm7/9L3dbHapcyV/C4FEU69FTBB+2z9gJqsVDX1Uob2BwdIEUS6ti50K9jzH/7unujd3rmTOGxcVFD+EE4pLCPDdnbGN094SESOF01/4zFABR4cTlhOKb8t+4QSqNfGhVzlx963qElfOiyKbQutIdsetm73wmwsiB1o6WZ6Nvnh6uJWTB8til2m1KOaIm+cn9ShXJG02GLRApvi1fCKVwS4WrXg/A29kciDv2tUHKj67GBwwr85kDlhGhZTzFMM1aTd4tHnHmFehwu03ZnLRF7NPfFsa2zm15UJ0MbH1V8r9sFG0PtOy1oBdO9Lpw/oRuvQoe8xLcEx0er3FwbEElWLuMReXPFc3k6bK8iYswZjgnafnIOOglqt5bB+XgvN3F03WB9HaVFZ3eFyKZov23TPN68M67A+RPXW86SKvVjzBmyeRJliKacC3cjG/dhQOV1+fmkxlQptdM+2twndcJdRjYVh4OWvYuc+y3HXqLNs43BgREEI6RhFmgqBMmGFzM=
2023-05-12T13:08:27.195 INFO:teuthology.kill:2023-05-12 13:08:27,193.193 INFO:teuthology.nuke:Checking targets against current locks
2023-05-12T13:08:27.251 INFO:teuthology.kill:2023-05-12 13:08:27,251.251 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-05-12T13:08:27.267 INFO:teuthology.kill:2023-05-12 13:08:27,267.267 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-05-12T13:08:27.327 INFO:teuthology.kill:2023-05-12 13:08:27,326.326 INFO:teuthology.orchestra.console:Power off smithi062
2023-05-12T13:08:27.343 INFO:teuthology.kill:2023-05-12 13:08:27,343.343 INFO:teuthology.orchestra.console:Power off smithi096
2023-05-12T13:08:35.707 INFO:teuthology.kill:2023-05-12 13:08:35,706.706 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2023-05-12T13:08:35.714 INFO:teuthology.kill:2023-05-12 13:08:35,713.713 INFO:teuthology.orchestra.console:Power off for smithi096 completed
2023-05-12T13:08:35.868 INFO:teuthology.kill:2023-05-12 13:08:35,868.868 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com
2023-05-12T13:08:35.876 INFO:teuthology.kill:2023-05-12 13:08:35,876.876 INFO:teuthology.lock.ops:unlocked: smithi096.front.sepia.ceph.com
2023-05-12T13:10:36.150 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-05-12T13:10:36.263 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi062 but it was locked by another job: /home/teuthworker/archive/pdonnell-2023-05-11_23:23:58-fs-wip-pdonnell-testing-20230511.185220-distro-default-smithi/7272255
2023-05-12T13:10:36.264 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi096 but it was locked by another job: /home/teuthworker/archive/pdonnell-2023-05-11_23:23:58-fs-wip-pdonnell-testing-20230511.185220-distro-default-smithi/7272256