2023-04-07T15:35:22.854 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae 2023-04-07T15:35:22.994 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2023-04-07T15:35:22.995 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2023-04-07T15:35:22.996 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-04-07T15:35:23.021 INFO:teuthology.lock.ops:Node 'smithi040.front.sepia.ceph.com' reimaging is complete 2023-04-07T15:35:23.021 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-04-07T15:35:23.021 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-04-07T15:35:23.022 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-04-07T15:35:23.045 INFO:teuthology.lock.ops:Node 'smithi167.front.sepia.ceph.com' reimaging is complete 2023-04-07T15:35:23.188 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 8.stream 2023-04-07T15:35:23.204 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 8.stream 2023-04-07T15:35:23.408 INFO:teuthology.orchestra.console:Power off smithi040 2023-04-07T15:35:23.424 INFO:teuthology.orchestra.console:Power off smithi167 2023-04-07T15:35:31.788 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2023-04-07T15:35:31.889 INFO:teuthology.orchestra.console:Power on smithi167 2023-04-07T15:35:35.895 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-04-07T15:35:35.997 INFO:teuthology.orchestra.console:Power on smithi040 2023-04-07T15:35:40.251 INFO:teuthology.orchestra.console:Power on for smithi040 completed 2023-04-07T15:35:40.257 INFO:teuthology.orchestra.console:Power on for smithi167 completed 2023-04-07T15:35:40.352 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2023-04-07T15:35:40.358 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-04-07T15:38:29.317 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-04-07T15:38:29.318 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-04-07T15:38:38.377 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-04-07T15:38:38.377 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-04-07T15:38:47.461 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-04-07T15:38:47.461 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-04-07T15:38:56.517 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-04-07T15:38:56.517 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-04-07T15:39:05.573 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-04-07T15:39:05.573 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-04-07T15:39:14.629 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-04-07T15:39:14.629 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-04-07T15:39:23.685 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-04-07T15:40:20.685 WARNING:teuthology.provision.fog:timed out 2023-04-07T15:40:27.031 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-07T15:40:27.345 INFO:teuthology.provision.fog.smithi040:Node is ready 2023-04-07T15:40:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2023-04-07T15:40:27.424 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2023-04-07T15:40:27.780 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2023-04-07T15:40:29.689 WARNING:teuthology.provision.fog:timed out 2023-04-07T15:40:36.044 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-07T15:40:36.304 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-04-07T15:40:36.362 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2023-04-07T15:40:36.419 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-04-07T15:40:36.773 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-04-07T15:40:36.944 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2023-04-07T15:40:36.945 INFO:teuthology.lock.ops:New key found. Updating... 2023-04-07T15:40:36.967 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-04-07T15:40:36.967 INFO:teuthology.lock.ops:New key found. Updating... 2023-04-07T15:40:36.984 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2023-04-07T15:40:36.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-04-07T15:40:37.179 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-04-07T15:40:37.237 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-04-07T15:40:37.238 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2023-04-07T15:40:37.238 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-04-07T15:40:37.238 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-04-07T15:40:37.238 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2023-04-07T15:40:37.238 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-04-07T15:40:37.238 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2023-04-07T15:40:37.239 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-04-07T15:40:37.239 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-04-07T15:40:37.239 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-04-07T15:40:37.239 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-04-07T15:40:37.239 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-04-07T15:40:37.239 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-04-07T15:40:37.240 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-04-07T15:40:37.258 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-04-07T15:40:37.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-04-07T15:40:37.447 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-04-07T15:40:37.505 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2023-04-07T15:40:37.505 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8" 2023-04-07T15:40:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2023-04-07T15:40:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2023-04-07T15:40:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8" 2023-04-07T15:40:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-04-07T15:40:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 8" 2023-04-07T15:40:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-04-07T15:40:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-04-07T15:40:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2023-04-07T15:40:37.507 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-04-07T15:40:37.507 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-04-07T15:40:37.507 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-04-07T15:40:37.507 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-04-07T15:40:37.617 INFO:teuthology.dispatcher.supervisor:Running job 7235160 2023-04-07T15:40:37.617 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-04-07_15:10:00-orch:cephadm-wip-guits-testing-2-2023-04-06-1217-pacific-distro-default-smithi/7235160 --name gabrioux-2023-04-07_15:10:00-orch:cephadm-wip-guits-testing-2-2023-04-06-1217-pacific-distro-default-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/gabrioux-2023-04-07_15:10:00-orch:cephadm-wip-guits-testing-2-2023-04-06-1217-pacific-distro-default-smithi/7235160/orig.config.yaml 2023-04-07T15:40:37.621 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-04-07_15:10:00-orch:cephadm-wip-guits-testing-2-2023-04-06-1217-pacific-distro-default-smithi/7235160 2023-04-07T15:40:37.621 INFO:teuthology.dispatcher.supervisor:Job PID: 27671 2023-04-07T15:40:37.622 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-04-08T03:41:34.517 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-04-08T03:41:34.688 INFO:teuthology.kill:Killing Pids: {27671} 2023-04-08T03:41:35.572 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-04-08T03:41:35.572 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-04-08T03:41:35.573 INFO:teuthology.misc:Compressing logs... 2023-04-08T03:41:35.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-04-08T03:41:35.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-04-08T03:41:36.086 INFO:teuthology.misc:Compressing logs... 2023-04-08T03:41:36.116 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-04-08T03:41:36.117 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-04-08T03:41:36.117 INFO:teuthology.orchestra.run.smithi040.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 87.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-04-08T03:41:36.157 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-04-08T03:41:36.157 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-04-08T03:41:36.158 INFO:teuthology.orchestra.run.smithi167.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 80.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-04-08T03:41:36.275 INFO:teuthology.orchestra.run.smithi040.stderr: 91.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-04-08T03:41:36.299 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-04-08T03:41:36.412 INFO:teuthology.misc:Compressing logs... 2023-04-08T03:41:36.441 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-04-08T03:41:36.441 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-volume.log 2023-04-08T03:41:36.442 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.2.log 2023-04-08T03:41:36.442 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/cephadm.log: 0.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-04-08T03:41:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.1.log 2023-04-08T03:41:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mon.smithi040.log 2023-04-08T03:41:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.2.log: /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.0.log 2023-04-08T03:41:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mgr.smithi040.anstkz.log 2023-04-08T03:41:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mon.smithi040.log: /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.0.log: /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mgr.smithi040.anstkz.log: 90.2% -- replaced with /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-volume.log.gz 2023-04-08T03:41:36.475 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-04-08T03:41:36.475 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-volume.log 2023-04-08T03:41:36.476 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.5.log 2023-04-08T03:41:36.476 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.3.log 2023-04-08T03:41:36.477 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-volume.log: /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.4.log 2023-04-08T03:41:36.477 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mgr.smithi167.destit.log 2023-04-08T03:41:36.477 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.4.log: /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mgr.smithi167.destit.log: 89.5% -- replaced with /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-volume.log.gz 2023-04-08T03:41:36.478 INFO:teuthology.orchestra.run.smithi167.stderr: 89.5% -- replaced with /var/log/ceph/cephadm.log.gz 2023-04-08T03:41:36.486 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mon.smithi167.log 2023-04-08T03:41:36.602 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mon.smithi167.log: 94.6% -- replaced with /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mgr.smithi167.destit.log.gz 2023-04-08T03:41:42.552 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mon.smithi167.log: file size changed while zipping 2023-04-08T03:41:42.552 INFO:teuthology.orchestra.run.smithi167.stderr: 93.0% -- replaced with /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mon.smithi167.log.gz 2023-04-08T03:41:44.323 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2023-04-08T03:41:44.324 INFO:teuthology.orchestra.run.smithi167.stderr: 93.8% -- replaced with /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.4.log.gz 2023-04-08T03:41:44.386 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2023-04-08T03:41:44.387 INFO:teuthology.orchestra.run.smithi040.stderr: 93.6% -- replaced with /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.2.log.gz 2023-04-08T03:41:44.865 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2023-04-08T03:41:44.866 INFO:teuthology.orchestra.run.smithi167.stderr: 93.8% -- replaced with /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.5.log.gz 2023-04-08T03:41:45.191 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mgr.smithi040.anstkz.log: file size changed while zipping 2023-04-08T03:41:45.192 INFO:teuthology.orchestra.run.smithi040.stderr: 92.4% -- replaced with /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mgr.smithi040.anstkz.log.gz 2023-04-08T03:41:45.259 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2023-04-08T03:41:45.259 INFO:teuthology.orchestra.run.smithi040.stderr: 93.8% -- replaced with /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.0.log.gz 2023-04-08T03:41:46.429 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2023-04-08T03:41:46.429 INFO:teuthology.orchestra.run.smithi167.stderr: 94.1% -- replaced with /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.3.log.gz 2023-04-08T03:41:48.617 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2023-04-08T03:41:48.617 INFO:teuthology.orchestra.run.smithi040.stderr: 93.9% -- replaced with /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-osd.1.log.gz 2023-04-08T03:41:55.916 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mon.smithi040.log: file size changed while zipping 2023-04-08T03:41:55.917 INFO:teuthology.orchestra.run.smithi040.stderr: 89.9% -- replaced with /var/log/ceph/3a6eacce-d567-11ed-9aff-001a4aab830c/ceph-mon.smithi040.log.gz 2023-04-08T03:42:05.916 INFO:teuthology.kill:No teuthology processes running 2023-04-08T03:42:06.757 INFO:teuthology.kill:Nuking machines: ['smithi040', 'smithi167'] 2023-04-08T03:42:07.401 INFO:teuthology.kill:2023-04-08 03:42:07,401.401 INFO:teuthology.nuke:targets: 2023-04-08T03:42:07.402 INFO:teuthology.kill: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB8J+4sIKhwMmJtFKQKKHRfOaYuOL7w0dgRNTK7lqB0Tp9sqomdMmy+9bAImY56+1NJ8hVhV88nQmBpEjpMpScM= 2023-04-08T03:42:07.402 INFO:teuthology.kill: smithi167.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC12KpwPKMldSdk2tdW7a0MFfbvJdEPsNcLuuUvsIhnQFfsGrT8vP/uEUmTDEAFIQckXkOoNXvbAJlAkL5FpgXh+aWzfj1Ya/ncKPeE+MimLEi7AjvJbZlL6Mrf/4hNP///K9GRWXQlsMRIGvKC8cd+qpLZ4XZ1WyaYtuOsildeVQMEOPcs5IVxuBVa3FQJwyc17qFRCfnI13pzD4cF5qfOCA+vftpOzwDS1N2RJKnkOBdOpUFUs92PvuWtkAPBr6gU/r1ih/4rmYTpouKkQ4alKHmTUyEogPsD738ZaqrX2sazQpf8sHCOa9ILUeqqQybHVYf0HNAe4eJbfG63pFMZ1D5xVHpEoj7t8qoKHppOXPnEmtAT81+z/ynI94M4f/G+/ikyHQHBt94nRvitRa31ntYmDZhjzjBgEKTE5qBbKKaw2yLgfmg9TPUYAso4VLzwfJrO7ru3A0MpXrY9v54Ug1C/PBP8fP9x4wWfkSVFYDRoIOJWUHowDSNpJtKGbBE= 2023-04-08T03:42:07.403 INFO:teuthology.kill:2023-04-08 03:42:07,401.401 INFO:teuthology.nuke:Checking targets against current locks 2023-04-08T03:42:07.456 INFO:teuthology.kill:2023-04-08 03:42:07,456.456 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-08T03:42:07.481 INFO:teuthology.kill:2023-04-08 03:42:07,481.481 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-08T03:42:07.529 INFO:teuthology.kill:2023-04-08 03:42:07,528.528 INFO:teuthology.orchestra.console:Power off smithi040 2023-04-08T03:42:07.571 INFO:teuthology.kill:2023-04-08 03:42:07,571.571 INFO:teuthology.orchestra.console:Power off smithi167 2023-04-08T03:42:15.902 INFO:teuthology.kill:2023-04-08 03:42:15,902.902 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-04-08T03:42:15.934 INFO:teuthology.kill:2023-04-08 03:42:15,934.934 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2023-04-08T03:42:16.061 INFO:teuthology.kill:2023-04-08 03:42:16,061.061 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2023-04-08T03:42:16.077 INFO:teuthology.kill:2023-04-08 03:42:16,077.077 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com 2023-04-08T03:44:16.343 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-04-08T03:44:16.454 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi040 but it was locked by another job: /home/teuthworker/archive/cbodley-2023-04-07_15:39:07-rgw-wip-cbodley-testing-distro-default-smithi/7235230 2023-04-08T03:44:16.454 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi167 but it was locked by another job: /home/teuthworker/archive/cbodley-2023-04-07_15:39:07-rgw-wip-cbodley-testing-distro-default-smithi/7235230