2023-05-06T15:00:32.073 INFO:root:teuthology version: 0.0.1.dev98+g69caab8
2023-05-06T15:00:32.220 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging
2023-05-06T15:00:32.221 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server
2023-05-06T15:00:32.221 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2023-05-06T15:00:32.242 INFO:teuthology.lock.ops:Node 'smithi052.front.sepia.ceph.com' reimaging is complete
2023-05-06T15:00:32.243 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging
2023-05-06T15:00:32.243 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server
2023-05-06T15:00:32.243 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server
2023-05-06T15:00:32.266 INFO:teuthology.lock.ops:Node 'smithi129.front.sepia.ceph.com' reimaging is complete
2023-05-06T15:00:32.405 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 8.stream
2023-05-06T15:00:32.412 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 8.stream
2023-05-06T15:00:32.661 INFO:teuthology.orchestra.console:Power off smithi129
2023-05-06T15:00:32.677 INFO:teuthology.orchestra.console:Power off smithi052
2023-05-06T15:00:32.822 INFO:teuthology.orchestra.console:Power off for smithi052 completed
2023-05-06T15:00:32.923 INFO:teuthology.orchestra.console:Power on smithi052
2023-05-06T15:00:37.173 INFO:teuthology.orchestra.console:Power on for smithi052 completed
2023-05-06T15:00:37.274 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish
2023-05-06T15:00:45.144 INFO:teuthology.orchestra.console:Power off for smithi129 completed
2023-05-06T15:00:45.245 INFO:teuthology.orchestra.console:Power on smithi129
2023-05-06T15:00:53.615 INFO:teuthology.orchestra.console:Power on for smithi129 completed
2023-05-06T15:00:53.716 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish
2023-05-06T15:03:41.680 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-05-06T15:03:42.544 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-05-06T15:03:50.736 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-05-06T15:03:51.600 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-05-06T15:03:59.792 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-05-06T15:04:00.656 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-05-06T15:04:09.712 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-05-06T15:04:18.768 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-05-06T15:04:27.828 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-05-06T15:04:36.912 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-05-06T15:05:05.812 WARNING:teuthology.provision.fog:timed out
2023-05-06T15:05:12.058 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-05-06T15:05:12.294 INFO:teuthology.provision.fog.smithi052:Node is ready
2023-05-06T15:05:12.313 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com
2023-05-06T15:05:12.373 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052
2023-05-06T15:05:12.712 INFO:teuthology.provision.fog.smithi052:Deploy complete!
2023-05-06T15:05:42.944 WARNING:teuthology.provision.fog:timed out
2023-05-06T15:05:49.157 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-05-06T15:05:49.436 INFO:teuthology.provision.fog.smithi129:Node is ready
2023-05-06T15:05:49.456 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com
2023-05-06T15:05:49.518 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129
2023-05-06T15:05:49.863 INFO:teuthology.provision.fog.smithi129:Deploy complete!
2023-05-06T15:05:50.037 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com
2023-05-06T15:05:50.037 INFO:teuthology.lock.ops:New key found. Updating...
2023-05-06T15:05:50.063 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com
2023-05-06T15:05:50.063 INFO:teuthology.lock.ops:New key found. Updating...
2023-05-06T15:05:50.088 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server
2023-05-06T15:05:50.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2023-05-06T15:05:50.360 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64
2023-05-06T15:05:50.420 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream"
2023-05-06T15:05:50.420 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8"
2023-05-06T15:05:50.420 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos"
2023-05-06T15:05:50.421 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora"
2023-05-06T15:05:50.421 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8"
2023-05-06T15:05:50.421 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8"
2023-05-06T15:05:50.421 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 8"
2023-05-06T15:05:50.421 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2023-05-06T15:05:50.421 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-05-06T15:05:50.421 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/"
2023-05-06T15:05:50.422 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-05-06T15:05:50.422 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-05-06T15:05:50.422 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-05-06T15:05:50.423 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2023-05-06T15:05:50.446 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server
2023-05-06T15:05:50.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com'
2023-05-06T15:05:50.639 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64
2023-05-06T15:05:50.699 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream"
2023-05-06T15:05:50.699 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8"
2023-05-06T15:05:50.699 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos"
2023-05-06T15:05:50.699 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora"
2023-05-06T15:05:50.699 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8"
2023-05-06T15:05:50.699 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8"
2023-05-06T15:05:50.700 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 8"
2023-05-06T15:05:50.700 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31"
2023-05-06T15:05:50.700 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-05-06T15:05:50.700 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/"
2023-05-06T15:05:50.700 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-05-06T15:05:50.700 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-05-06T15:05:50.700 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-05-06T15:05:50.701 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server
2023-05-06T15:05:50.827 INFO:teuthology.dispatcher.supervisor:Running job 7263494
2023-05-06T15:05:50.827 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-05-06_14:38:26-fs-pacific-release-distro-default-smithi/7263494 --name yuriw-2023-05-06_14:38:26-fs-pacific-release-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-05-06_14:38:26-fs-pacific-release-distro-default-smithi/7263494/orig.config.yaml
2023-05-06T15:05:50.830 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-05-06_14:38:26-fs-pacific-release-distro-default-smithi/7263494
2023-05-06T15:05:50.831 INFO:teuthology.dispatcher.supervisor:Job PID: 22811
2023-05-06T15:05:50.831 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-05-07T03:06:48.846 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-05-07T03:06:49.019 INFO:teuthology.kill:Killing Pids: {22811}
2023-05-07T03:06:50.097 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2023-05-07T03:06:50.098 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2023-05-07T03:06:50.098 INFO:teuthology.misc:Compressing logs...
2023-05-07T03:06:50.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2023-05-07T03:06:50.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com'
2023-05-07T03:06:50.573 INFO:teuthology.misc:Compressing logs...
2023-05-07T03:06:50.616 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-05-07T03:06:50.616 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-05-07T03:06:50.617 INFO:teuthology.orchestra.run.smithi052.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	/home/ubuntu/cephtest/archive/syslog/misc.log:	 86.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-05-07T03:06:50.642 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-05-07T03:06:50.642 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-05-07T03:06:50.643 INFO:teuthology.orchestra.run.smithi129.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	/home/ubuntu/cephtest/archive/syslog/misc.log:	 76.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-05-07T03:06:50.729 INFO:teuthology.orchestra.run.smithi129.stderr: 91.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-05-07T03:06:50.780 INFO:teuthology.orchestra.run.smithi052.stderr: 94.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-05-07T03:06:50.912 INFO:teuthology.misc:Compressing logs...
2023-05-07T03:06:50.941 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2023-05-07T03:06:50.942 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi052.giqndb.log
2023-05-07T03:06:50.942 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mgr.smithi052.ovsprx.log
2023-05-07T03:06:50.943 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/cephadm.log:	gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-volume.log
2023-05-07T03:06:50.943 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi052.giqndb.log:	/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mgr.smithi052.ovsprx.log:	gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.2.log
2023-05-07T03:06:50.943 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-volume.log:	gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.0.log
2023-05-07T03:06:50.943 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.2.log:	gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi052.oyeuxq.log
2023-05-07T03:06:50.945 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.0.log:	/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi052.oyeuxq.log:	 91.6% -- replaced with /var/log/ceph/cephadm.log.gz
2023-05-07T03:06:50.947 INFO:teuthology.orchestra.run.smithi052.stderr: 90.5% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-volume.log.gz
2023-05-07T03:06:50.948 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.1.log
2023-05-07T03:06:50.948 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mon.smithi052.log
2023-05-07T03:06:50.977 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2023-05-07T03:06:50.977 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi129.notdvm.log
2023-05-07T03:06:50.977 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-volume.log
2023-05-07T03:06:50.978 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/cephadm.log:	gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mgr.smithi129.ebpcmu.log
2023-05-07T03:06:50.978 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi129.notdvm.log:	/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-volume.log:	gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.3.log
2023-05-07T03:06:50.978 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mgr.smithi129.ebpcmu.log:	gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi129.ixplwk.log
2023-05-07T03:06:50.980 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.3.log:	/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi129.ixplwk.log:	 89.0% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-volume.log.gz
2023-05-07T03:06:50.982 INFO:teuthology.orchestra.run.smithi129.stderr: 89.1% -- replaced with /var/log/ceph/cephadm.log.gz
2023-05-07T03:06:50.982 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.4.log
2023-05-07T03:06:50.983 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.5.log
2023-05-07T03:06:50.983 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.4.log:	/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.5.log:	gzip -5 --verbose -- /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mon.smithi129.log
2023-05-07T03:06:51.078 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.1.log:	/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mon.smithi052.log:	 95.0% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi052.giqndb.log.gz
2023-05-07T03:06:51.110 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mon.smithi129.log:	 95.0% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi129.ixplwk.log.gz
2023-05-07T03:06:51.145 INFO:teuthology.orchestra.run.smithi129.stderr: 93.9% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mgr.smithi129.ebpcmu.log.gz
2023-05-07T03:06:54.893 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mgr.smithi052.ovsprx.log: file size changed while zipping
2023-05-07T03:06:54.894 INFO:teuthology.orchestra.run.smithi052.stderr: 92.4% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mgr.smithi052.ovsprx.log.gz
2023-05-07T03:06:56.003 INFO:teuthology.orchestra.run.smithi129.stderr:gzip: /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mon.smithi129.log: file size changed while zipping
2023-05-07T03:06:56.003 INFO:teuthology.orchestra.run.smithi129.stderr: 93.6% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mon.smithi129.log.gz
2023-05-07T03:07:04.353 INFO:teuthology.orchestra.run.smithi129.stderr:gzip: /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2023-05-07T03:07:04.353 INFO:teuthology.orchestra.run.smithi129.stderr: 93.0% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.4.log.gz
2023-05-07T03:07:04.581 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2023-05-07T03:07:04.581 INFO:teuthology.orchestra.run.smithi052.stderr: 93.4% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.2.log.gz
2023-05-07T03:07:05.197 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2023-05-07T03:07:05.198 INFO:teuthology.orchestra.run.smithi052.stderr: 93.9% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.1.log.gz
2023-05-07T03:07:06.942 INFO:teuthology.orchestra.run.smithi129.stderr:gzip: /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2023-05-07T03:07:06.942 INFO:teuthology.orchestra.run.smithi129.stderr: 93.4% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.5.log.gz
2023-05-07T03:07:07.687 INFO:teuthology.orchestra.run.smithi129.stderr:gzip: /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2023-05-07T03:07:07.688 INFO:teuthology.orchestra.run.smithi129.stderr: 93.5% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.3.log.gz
2023-05-07T03:07:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mon.smithi052.log: file size changed while zipping
2023-05-07T03:07:10.196 INFO:teuthology.orchestra.run.smithi052.stderr: 89.9% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mon.smithi052.log.gz
2023-05-07T03:07:10.800 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2023-05-07T03:07:10.800 INFO:teuthology.orchestra.run.smithi052.stderr: 93.7% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.0.log.gz
2023-05-07T03:07:34.703 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi052.oyeuxq.log: file size changed while zipping
2023-05-07T03:07:34.704 INFO:teuthology.orchestra.run.smithi052.stderr: 93.4% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi052.oyeuxq.log.gz
2023-05-07T03:07:37.488 INFO:teuthology.orchestra.run.smithi129.stderr:gzip: /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi129.notdvm.log: file size changed while zipping
2023-05-07T03:07:37.488 INFO:teuthology.orchestra.run.smithi129.stderr: 93.3% -- replaced with /var/log/ceph/0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi129.notdvm.log.gz
2023-05-07T03:08:49.411 INFO:teuthology.orchestra.run.smithi052.stderr:tar: ./0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi052.oyeuxq.log-20230507: file changed as we read it
2023-05-07T03:09:13.861 INFO:teuthology.orchestra.run.smithi052.stderr:tar: ./0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.2.log-20230507: file changed as we read it
2023-05-07T03:09:39.054 INFO:teuthology.orchestra.run.smithi052.stderr:tar: ./0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.1.log-20230507: file changed as we read it
2023-05-07T03:10:03.923 INFO:teuthology.orchestra.run.smithi052.stderr:tar: ./0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-mon.smithi052.log-20230507: file changed as we read it
2023-05-07T03:10:37.768 INFO:teuthology.orchestra.run.smithi052.stderr:tar: ./0ffc7950-ec21-11ed-9b01-001a4aab830c/ceph-osd.0.log-20230507: file changed as we read it
2023-05-07T03:10:51.512 INFO:teuthology.kill:No teuthology processes running
2023-05-07T03:10:52.452 INFO:teuthology.kill:Nuking machines: ['smithi052', 'smithi129']
2023-05-07T03:10:53.167 INFO:teuthology.kill:2023-05-07 03:10:53,166.166 INFO:teuthology.nuke:targets:
2023-05-07T03:10:53.168 INFO:teuthology.kill:  smithi052.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzsTlQHOdvjOkO0IkVwKf9bSieg+HGX2jpQPC41szDKZSMqRd1tulRPr3yaO/udYO8pVIsp2otD9O0b/iAxZ1qNMRfA0IBALZA1B9sZsWB2T+eHxKTXPamsG65RCcvoc2+6XKiB9swx+tASqZt6Dsn28UBtBaKPQBC4ghx+d0fZZTryPxYeRfkDFi/OHxnX/PN5wfcLcdxH2+76JqtTSjMMTTMGiJ3UZ3WmwjB+0jkRItG27lwiMDcKLj4shcJq4Y+5PKRsKFJNlfSxUxHHm7wO4RhEhBIydXRmIa30ygMeSuwCfOJh7L4FRuVddDeLg3vAQFppR0dadzN+moc1d6fRvCjoqE0lDKV36UHxd25GUWolsNZqi1SF6IpN/0y7nLZEKJRMQa0Knlly3AAui9ObpuMXPTqPmT7W5LGRoj30ixCh08GdQrxmdLdO6f4/7DaTitShLBHDa1IBKmNNdRw2ixP74w8GeyYUpHB05j2iyR0cZ9Scce1M4BLK8uUwE0=
2023-05-07T03:10:53.168 INFO:teuthology.kill:  smithi129.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2gvC7Y2nm7yky8JPNmIkwaq3WRKrzFch/kjXO3jCfbefeWXUSr3hoxgaPWZ0x29xKwiRRjcbMxpF1AU9okmRnOI/U1Wr6d2w5LncDrOPWIGsQUOPw7R4ByB9gxO1nt/sNtJfLr5RZiaeov8bIu3WUoHQ4Pb+3uW/OT+hoYlAZHLWKfVB3i370toN1/GOXYLlbqxHzfmUJS26uTt1zMNyBQrgA9HCwamh60Bo0mh43MKMOPETnDZz0j5JC2MulOy94zBdiVy0t/TJPuco1SwllYDAU49URFKcyJKGfYXTbJ2We7k+G3ZUHht0ZwAfFiE+TDjcU+VE9KsVFEMhfinUiAWBAA+1a6bdgXiV6wTFIpr6KPkKnyi+lBP/L3jL7wKPysTloiNAza+iMcerqGFpBVQ0iooGNseRZHQi2mdXZRnKgH6OOvqD8YrNhiOIIk50AuSiPE0LPLC4H/nGv3Z28YeGNv1DPlAsUqQEkyMWj5vEjAVK/hB3h2xf+PiviKxs=
2023-05-07T03:10:53.168 INFO:teuthology.kill:2023-05-07 03:10:53,166.166 INFO:teuthology.nuke:Checking targets against current locks
2023-05-07T03:10:53.226 INFO:teuthology.kill:2023-05-07 03:10:53,226.226 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-05-07T03:10:53.254 INFO:teuthology.kill:2023-05-07 03:10:53,254.254 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-05-07T03:10:53.312 INFO:teuthology.kill:2023-05-07 03:10:53,310.310 INFO:teuthology.orchestra.console:Power off smithi052
2023-05-07T03:10:53.355 INFO:teuthology.kill:2023-05-07 03:10:53,355.355 INFO:teuthology.orchestra.console:Power off smithi129
2023-05-07T03:11:01.699 INFO:teuthology.kill:2023-05-07 03:11:01,699.699 INFO:teuthology.orchestra.console:Power off for smithi052 completed
2023-05-07T03:11:01.855 INFO:teuthology.kill:2023-05-07 03:11:01,855.855 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com
2023-05-07T03:11:05.855 INFO:teuthology.kill:2023-05-07 03:11:05,855.855 INFO:teuthology.orchestra.console:Power off for smithi129 completed
2023-05-07T03:11:06.012 INFO:teuthology.kill:2023-05-07 03:11:06,012.012 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com
2023-05-07T03:13:06.378 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-05-07T03:13:06.491 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi052 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-05-06_14:35:27-rados-reef-distro-default-smithi/7263281
2023-05-07T03:13:06.491 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi129 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-05-06_14:35:27-rados-reef-distro-default-smithi/7263281