2023-03-06T13:58:41.993 INFO:root:teuthology version: 0.0.1.dev51+ga2dfb05 2023-03-06T13:58:42.168 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging 2023-03-06T13:58:42.170 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server 2023-03-06T13:58:42.170 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-03-06T13:58:42.192 INFO:teuthology.lock.ops:Node 'smithi007.front.sepia.ceph.com' reimaging is complete 2023-03-06T13:58:42.192 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging 2023-03-06T13:58:42.192 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server 2023-03-06T13:58:42.193 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2023-03-06T13:58:42.224 INFO:teuthology.lock.ops:Node 'smithi063.front.sepia.ceph.com' reimaging is complete 2023-03-06T13:58:42.224 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2023-03-06T13:58:42.225 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2023-03-06T13:58:42.225 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-03-06T13:58:42.249 INFO:teuthology.lock.ops:Node 'smithi081.front.sepia.ceph.com' reimaging is complete 2023-03-06T13:58:42.344 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of rhel 8.6 2023-03-06T13:58:42.399 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of rhel 8.6 2023-03-06T13:58:42.402 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of rhel 8.6 2023-03-06T13:58:42.718 INFO:teuthology.orchestra.console:Power off smithi007 2023-03-06T13:58:42.736 INFO:teuthology.orchestra.console:Power off smithi063 2023-03-06T13:58:42.748 INFO:teuthology.orchestra.console:Power off smithi081 2023-03-06T13:58:42.888 INFO:teuthology.orchestra.console:Power off for smithi063 completed 2023-03-06T13:58:42.890 INFO:teuthology.orchestra.console:Power off for smithi007 completed 2023-03-06T13:58:42.899 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2023-03-06T13:58:42.989 INFO:teuthology.orchestra.console:Power on smithi063 2023-03-06T13:58:42.998 INFO:teuthology.orchestra.console:Power on smithi007 2023-03-06T13:58:43.007 INFO:teuthology.orchestra.console:Power on smithi081 2023-03-06T13:58:51.376 INFO:teuthology.orchestra.console:Power on for smithi007 completed 2023-03-06T13:58:51.384 INFO:teuthology.orchestra.console:Power on for smithi063 completed 2023-03-06T13:58:51.392 INFO:teuthology.orchestra.console:Power on for smithi081 completed 2023-03-06T13:58:51.478 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2023-03-06T13:58:51.486 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish 2023-03-06T13:58:51.494 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2023-03-06T14:01:25.545 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-03-06T14:01:34.629 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-03-06T14:01:40.613 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-03-06T14:01:40.614 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-03-06T14:01:43.685 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-03-06T14:01:49.669 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-03-06T14:01:49.670 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-03-06T14:01:52.741 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-03-06T14:01:58.725 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-03-06T14:01:58.725 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-03-06T14:02:01.797 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-03-06T14:02:07.786 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-03-06T14:02:07.786 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-03-06T14:02:10.853 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-03-06T14:02:16.873 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-03-06T14:02:16.874 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-03-06T14:02:25.957 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-03-06T14:02:25.957 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-03-06T14:02:35.013 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-03-06T14:02:50.505 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-03-06T14:02:59.461 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-03-06T14:02:59.589 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-03-06T14:03:08.521 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-03-06T14:03:08.645 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-03-06T14:03:14.969 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-06T14:03:15.244 INFO:teuthology.provision.fog.smithi081:Node is ready 2023-03-06T14:03:15.261 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2023-03-06T14:03:15.319 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2023-03-06T14:03:15.660 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2023-03-06T14:03:16.373 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-06T14:03:16.703 INFO:teuthology.provision.fog.smithi063:Node is ready 2023-03-06T14:03:16.761 INFO:teuthology.orchestra.run.smithi063.stdout:smithi022 2023-03-06T14:03:16.818 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-03-06T14:03:16.858 WARNING:teuthology.provision.fog:timed out 2023-03-06T14:03:17.226 INFO:teuthology.provision.fog.smithi063:Deploy complete! 2023-03-06T14:03:23.205 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-06T14:03:23.512 INFO:teuthology.provision.fog.smithi007:Node is ready 2023-03-06T14:03:23.530 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com 2023-03-06T14:03:23.589 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007 2023-03-06T14:03:23.953 INFO:teuthology.provision.fog.smithi007:Deploy complete! 2023-03-06T14:03:24.187 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com 2023-03-06T14:03:24.188 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com 2023-03-06T14:03:24.189 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-06T14:03:24.216 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2023-03-06T14:03:24.219 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server 2023-03-06T14:03:24.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-03-06T14:03:24.412 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2023-03-06T14:03:24.469 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux" 2023-03-06T14:03:24.470 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.6 (Ootpa)" 2023-03-06T14:03:24.470 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel" 2023-03-06T14:03:24.470 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora" 2023-03-06T14:03:24.470 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.6" 2023-03-06T14:03:24.470 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8" 2023-03-06T14:03:24.470 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-06T14:03:24.471 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2023-03-06T14:03:24.471 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-06T14:03:24.471 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/" 2023-03-06T14:03:24.471 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-06T14:03:24.471 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-06T14:03:24.471 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-03-06T14:03:24.471 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-06T14:03:24.472 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-06T14:03:24.472 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-06T14:03:24.472 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-06T14:03:24.473 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-03-06T14:03:24.499 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server 2023-03-06T14:03:24.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-03-06T14:03:24.699 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2023-03-06T14:03:24.758 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Red Hat Enterprise Linux" 2023-03-06T14:03:24.758 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8.6 (Ootpa)" 2023-03-06T14:03:24.759 INFO:teuthology.orchestra.run.smithi063.stdout:ID="rhel" 2023-03-06T14:03:24.759 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="fedora" 2023-03-06T14:03:24.759 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8.6" 2023-03-06T14:03:24.759 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8" 2023-03-06T14:03:24.759 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-06T14:03:24.760 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2023-03-06T14:03:24.760 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-06T14:03:24.760 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.redhat.com/" 2023-03-06T14:03:24.760 INFO:teuthology.orchestra.run.smithi063.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-06T14:03:24.760 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-06T14:03:24.760 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-03-06T14:03:24.761 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-06T14:03:24.761 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-06T14:03:24.761 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-06T14:03:24.761 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-06T14:03:24.762 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2023-03-06T14:03:24.783 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2023-03-06T14:03:24.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-03-06T14:03:24.937 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-03-06T14:03:24.995 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2023-03-06T14:03:24.995 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)" 2023-03-06T14:03:24.996 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2023-03-06T14:03:24.996 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2023-03-06T14:03:24.996 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6" 2023-03-06T14:03:24.996 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-03-06T14:03:24.996 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-06T14:03:24.996 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-03-06T14:03:24.996 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-06T14:03:24.997 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2023-03-06T14:03:24.997 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-06T14:03:24.997 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-06T14:03:24.997 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-03-06T14:03:24.997 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-06T14:03:24.997 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-06T14:03:24.997 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-06T14:03:24.998 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-06T14:03:24.998 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-03-06T14:03:25.124 INFO:teuthology.dispatcher.supervisor:Running job 7195213 2023-03-06T14:03:25.125 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195213 --name vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195213/orig.config.yaml 2023-03-06T14:03:25.129 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-03-06_13:28:53-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7195213 2023-03-06T14:03:25.129 INFO:teuthology.dispatcher.supervisor:Job PID: 25700 2023-03-06T14:03:25.130 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-03-07T02:04:20.509 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-03-07T02:04:21.977 INFO:teuthology.kill:Killing Pids: {25700} 2023-03-07T02:04:22.837 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-03-07T02:04:22.837 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-03-07T02:04:22.838 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-03-07T02:04:22.838 INFO:teuthology.misc:Compressing logs... 2023-03-07T02:04:22.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-03-07T02:04:23.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-03-07T02:04:23.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-03-07T02:04:23.750 INFO:teuthology.misc:Compressing logs... 2023-03-07T02:04:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-03-07T02:04:24.132 INFO:teuthology.misc:Compressing logs... 2023-03-07T02:05:25.650 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-osd.10.log: file size changed while zipping 2023-03-07T02:05:27.474 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-mds.h.log: file size changed while zipping 2023-03-07T02:05:44.808 INFO:teuthology.orchestra.run.smithi007.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2023-03-07T02:06:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2023-03-07T02:07:06.167 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2023-03-07T02:07:18.813 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2023-03-07T02:07:51.539 INFO:teuthology.orchestra.run.smithi007.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2023-03-07T02:07:57.338 INFO:teuthology.orchestra.run.smithi007.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-mgr.x.log: file size changed while zipping 2023-03-07T02:08:10.847 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2023-03-07T02:08:22.087 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-osd.11.log: file size changed while zipping 2023-03-07T02:08:23.876 INFO:teuthology.orchestra.run.smithi007.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-mds.j.log: file size changed while zipping 2023-03-07T02:08:52.725 INFO:teuthology.orchestra.run.smithi007.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2023-03-07T02:09:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-osd.8.log: file size changed while zipping 2023-03-07T02:09:35.924 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2023-03-07T02:09:36.440 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2023-03-07T02:09:50.248 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2023-03-07T02:09:57.582 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-mds.b.log: file size changed while zipping 2023-03-07T02:09:57.923 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/89730744-bc2a-11ed-9aea-001a4aab830c/ceph-mgr.y.log: file size changed while zipping 2023-03-07T02:12:58.397 INFO:teuthology.kill:No teuthology processes running 2023-03-07T02:12:59.216 INFO:teuthology.kill:Nuking machines: ['smithi007', 'smithi063', 'smithi081'] 2023-03-07T02:12:59.812 INFO:teuthology.kill:2023-03-07 02:12:59,811.811 INFO:teuthology.nuke:targets: 2023-03-07T02:12:59.813 INFO:teuthology.kill: smithi007.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-03-07T02:12:59.813 INFO:teuthology.kill: smithi063.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-03-07T02:12:59.813 INFO:teuthology.kill: smithi081.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-03-07T02:12:59.813 INFO:teuthology.kill:2023-03-07 02:12:59,813.813 INFO:teuthology.nuke:Checking targets against current locks 2023-03-07T02:12:59.881 INFO:teuthology.kill:2023-03-07 02:12:59,881.881 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-07T02:12:59.907 INFO:teuthology.kill:2023-03-07 02:12:59,907.907 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-07T02:12:59.932 INFO:teuthology.kill:2023-03-07 02:12:59,931.931 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-07T02:12:59.966 INFO:teuthology.kill:2023-03-07 02:12:59,965.965 INFO:teuthology.orchestra.console:Power off smithi007 2023-03-07T02:13:00.016 INFO:teuthology.kill:2023-03-07 02:13:00,016.016 INFO:teuthology.orchestra.console:Power off smithi063 2023-03-07T02:13:00.059 INFO:teuthology.kill:2023-03-07 02:13:00,059.059 INFO:teuthology.orchestra.console:Power off smithi081 2023-03-07T02:13:08.356 INFO:teuthology.kill:2023-03-07 02:13:08,356.356 INFO:teuthology.orchestra.console:Power off for smithi007 completed 2023-03-07T02:13:08.392 INFO:teuthology.kill:2023-03-07 02:13:08,392.392 INFO:teuthology.orchestra.console:Power off for smithi063 completed 2023-03-07T02:13:08.431 INFO:teuthology.kill:2023-03-07 02:13:08,430.430 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2023-03-07T02:13:08.514 INFO:teuthology.kill:2023-03-07 02:13:08,514.514 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com 2023-03-07T02:13:08.551 INFO:teuthology.kill:2023-03-07 02:13:08,551.551 INFO:teuthology.lock.ops:unlocked: smithi063.front.sepia.ceph.com 2023-03-07T02:13:08.589 INFO:teuthology.kill:2023-03-07 02:13:08,589.589 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com 2023-03-07T02:15:08.947 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-03-07T02:15:09.139 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi007 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-03-06_23:13:27-rados-wip-yuri6-testing-2023-03-06-1200-quincy-distro-default-smithi/7195742 2023-03-07T02:15:09.139 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi063 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-03-06_23:13:27-rados-wip-yuri6-testing-2023-03-06-1200-quincy-distro-default-smithi/7195742 2023-03-07T02:15:09.140 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi081 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-03-06_23:13:27-rados-wip-yuri6-testing-2023-03-06-1200-quincy-distro-default-smithi/7195742