2023-04-06T16:18:20.237 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae 2023-04-06T16:18:20.376 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging 2023-04-06T16:18:20.377 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server 2023-04-06T16:18:20.377 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-04-06T16:18:20.400 INFO:teuthology.lock.ops:Node 'smithi043.front.sepia.ceph.com' reimaging is complete 2023-04-06T16:18:20.400 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-04-06T16:18:20.401 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-04-06T16:18:20.401 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-04-06T16:18:20.425 INFO:teuthology.lock.ops:Node 'smithi169.front.sepia.ceph.com' reimaging is complete 2023-04-06T16:18:20.569 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 8.stream 2023-04-06T16:18:20.597 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 8.stream 2023-04-06T16:18:20.855 INFO:teuthology.orchestra.console:Power off smithi043 2023-04-06T16:18:20.871 INFO:teuthology.orchestra.console:Power off smithi169 2023-04-06T16:18:21.010 INFO:teuthology.orchestra.console:Power off for smithi169 completed 2023-04-06T16:18:21.111 INFO:teuthology.orchestra.console:Power on smithi169 2023-04-06T16:18:29.492 INFO:teuthology.orchestra.console:Power on for smithi169 completed 2023-04-06T16:18:29.594 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-04-06T16:18:33.336 INFO:teuthology.orchestra.console:Power off for smithi043 completed 2023-04-06T16:18:33.437 INFO:teuthology.orchestra.console:Power on smithi043 2023-04-06T16:18:41.807 INFO:teuthology.orchestra.console:Power on for smithi043 completed 2023-04-06T16:18:41.908 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2023-04-06T16:21:30.697 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-04-06T16:21:33.829 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-04-06T16:21:39.781 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-04-06T16:21:42.885 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-04-06T16:21:48.837 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-04-06T16:21:51.941 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-04-06T16:21:57.893 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-04-06T16:22:00.997 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-04-06T16:22:10.053 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-04-06T16:22:19.109 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-04-06T16:23:03.932 WARNING:teuthology.provision.fog:timed out 2023-04-06T16:23:10.279 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-06T16:23:10.552 INFO:teuthology.provision.fog.smithi043:Node is ready 2023-04-06T16:23:10.612 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com 2023-04-06T16:23:10.674 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043 2023-04-06T16:23:11.040 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2023-04-06T16:23:25.129 WARNING:teuthology.provision.fog:timed out 2023-04-06T16:23:31.461 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-06T16:23:31.738 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-04-06T16:23:31.757 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-04-06T16:23:31.816 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-04-06T16:23:32.194 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-04-06T16:23:32.361 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com 2023-04-06T16:23:32.362 INFO:teuthology.lock.ops:New key found. Updating... 2023-04-06T16:23:32.386 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-04-06T16:23:32.386 INFO:teuthology.lock.ops:New key found. Updating... 2023-04-06T16:23:32.412 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server 2023-04-06T16:23:32.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-04-06T16:23:32.720 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2023-04-06T16:23:32.780 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2023-04-06T16:23:32.780 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8" 2023-04-06T16:23:32.780 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2023-04-06T16:23:32.780 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2023-04-06T16:23:32.780 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8" 2023-04-06T16:23:32.781 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2023-04-06T16:23:32.781 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8" 2023-04-06T16:23:32.781 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-04-06T16:23:32.781 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-04-06T16:23:32.782 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2023-04-06T16:23:32.782 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-04-06T16:23:32.782 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-04-06T16:23:32.782 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-04-06T16:23:32.783 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-04-06T16:23:32.819 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-04-06T16:23:32.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-04-06T16:23:33.011 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-04-06T16:23:33.068 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-04-06T16:23:33.068 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2023-04-06T16:23:33.068 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-04-06T16:23:33.068 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-04-06T16:23:33.069 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2023-04-06T16:23:33.069 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-04-06T16:23:33.069 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2023-04-06T16:23:33.069 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-04-06T16:23:33.069 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-04-06T16:23:33.069 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-04-06T16:23:33.069 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-04-06T16:23:33.070 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-04-06T16:23:33.070 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-04-06T16:23:33.070 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-04-06T16:23:33.183 INFO:teuthology.dispatcher.supervisor:Running job 7234310 2023-04-06T16:23:33.183 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-04-06_15:37:58-rados-wip-yuri3-testing-2023-04-04-0833-pacific-distro-default-smithi/7234310 --name yuriw-2023-04-06_15:37:58-rados-wip-yuri3-testing-2023-04-04-0833-pacific-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-04-06_15:37:58-rados-wip-yuri3-testing-2023-04-04-0833-pacific-distro-default-smithi/7234310/orig.config.yaml 2023-04-06T16:23:33.188 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-04-06_15:37:58-rados-wip-yuri3-testing-2023-04-04-0833-pacific-distro-default-smithi/7234310 2023-04-06T16:23:33.189 INFO:teuthology.dispatcher.supervisor:Job PID: 4543 2023-04-06T16:23:33.189 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-04-07T04:24:30.441 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-04-07T04:24:30.629 INFO:teuthology.kill:Killing Pids: {4543} 2023-04-07T04:24:31.561 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-04-07T04:24:31.562 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-04-07T04:24:31.562 INFO:teuthology.misc:Compressing logs... 2023-04-07T04:24:31.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-04-07T04:24:31.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-04-07T04:24:32.108 INFO:teuthology.misc:Compressing logs... 2023-04-07T04:24:32.139 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-04-07T04:24:32.139 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-04-07T04:24:32.139 INFO:teuthology.orchestra.run.smithi043.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 87.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-04-07T04:24:32.140 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-04-07T04:24:32.141 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-04-07T04:24:32.141 INFO:teuthology.orchestra.run.smithi169.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 80.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-04-07T04:24:32.282 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-04-07T04:24:32.295 INFO:teuthology.orchestra.run.smithi043.stderr: 91.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-04-07T04:24:32.439 INFO:teuthology.misc:Compressing logs... 2023-04-07T04:24:32.468 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-volume.log 2023-04-07T04:24:32.468 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.2.log 2023-04-07T04:24:32.469 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.1.log 2023-04-07T04:24:32.469 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-volume.log: /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mgr.smithi043.evbapv.log 2023-04-07T04:24:32.470 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.0.log 2023-04-07T04:24:32.471 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mgr.smithi043.evbapv.log: gzip -5 --verbose -- /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mon.smithi043.log 2023-04-07T04:24:32.474 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-04-07T04:24:32.474 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mon.smithi043.log: /var/log/ceph/cephadm.log: 91.6% -- replaced with /var/log/ceph/cephadm.log.gz 2023-04-07T04:24:32.474 INFO:teuthology.orchestra.run.smithi043.stderr: 89.5% -- replaced with /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-volume.log.gz 2023-04-07T04:24:32.497 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-volume.log 2023-04-07T04:24:32.498 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.5.log 2023-04-07T04:24:32.499 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mon.smithi169.log 2023-04-07T04:24:32.499 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-volume.log: /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.3.log 2023-04-07T04:24:32.499 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mgr.smithi169.gqfxup.log 2023-04-07T04:24:32.499 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mon.smithi169.log: /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.4.log 2023-04-07T04:24:32.501 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mgr.smithi169.gqfxup.log: /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.4.log: 89.1% -- replaced with /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-volume.log.gz 2023-04-07T04:24:32.501 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-04-07T04:24:32.505 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/cephadm.log: 88.6% -- replaced with /var/log/ceph/cephadm.log.gz 2023-04-07T04:24:32.579 INFO:teuthology.orchestra.run.smithi169.stderr: 94.6% -- replaced with /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mgr.smithi169.gqfxup.log.gz 2023-04-07T04:24:38.669 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mon.smithi169.log: file size changed while zipping 2023-04-07T04:24:38.669 INFO:teuthology.orchestra.run.smithi169.stderr: 93.0% -- replaced with /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mon.smithi169.log.gz 2023-04-07T04:24:40.283 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2023-04-07T04:24:40.284 INFO:teuthology.orchestra.run.smithi043.stderr: 93.6% -- replaced with /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.2.log.gz 2023-04-07T04:24:40.341 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2023-04-07T04:24:40.342 INFO:teuthology.orchestra.run.smithi169.stderr: 93.7% -- replaced with /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.4.log.gz 2023-04-07T04:24:40.702 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2023-04-07T04:24:40.702 INFO:teuthology.orchestra.run.smithi169.stderr: 93.8% -- replaced with /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.5.log.gz 2023-04-07T04:24:41.105 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mgr.smithi043.evbapv.log: file size changed while zipping 2023-04-07T04:24:41.106 INFO:teuthology.orchestra.run.smithi043.stderr: 92.5% -- replaced with /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mgr.smithi043.evbapv.log.gz 2023-04-07T04:24:41.399 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2023-04-07T04:24:41.399 INFO:teuthology.orchestra.run.smithi043.stderr: 93.8% -- replaced with /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.0.log.gz 2023-04-07T04:24:41.666 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2023-04-07T04:24:41.666 INFO:teuthology.orchestra.run.smithi043.stderr: 93.9% -- replaced with /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.1.log.gz 2023-04-07T04:24:42.401 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2023-04-07T04:24:42.401 INFO:teuthology.orchestra.run.smithi169.stderr: 94.1% -- replaced with /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-osd.3.log.gz 2023-04-07T04:24:54.399 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mon.smithi043.log: file size changed while zipping 2023-04-07T04:24:54.400 INFO:teuthology.orchestra.run.smithi043.stderr: 89.8% -- replaced with /var/log/ceph/f47f993e-d4a4-11ed-9aff-001a4aab830c/ceph-mon.smithi043.log.gz 2023-04-07T04:25:04.784 INFO:teuthology.kill:No teuthology processes running 2023-04-07T04:25:05.630 INFO:teuthology.kill:Nuking machines: ['smithi043', 'smithi169'] 2023-04-07T04:25:06.244 INFO:teuthology.kill:2023-04-07 04:25:06,244.244 INFO:teuthology.nuke:targets: 2023-04-07T04:25:06.245 INFO:teuthology.kill: smithi043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaV6Mowxw0pG+rw80GGzO0x3LqExr7UrPdNx1tGA1s97KEqHBd4djg3CELrS8iPAf2plSC43Mr909r20wQls3e1ZdttNoqJw1DnlGTOSfK8/P+TgWNOH0hfhVO9klx+uTQdU0ZAAhE6jkAdH+f2lmxwiphUZTOrrdbL+vlxmXahdlk/qVZu2pu7vHWixNb6suZaf9wKQwcBGr++KHY3qMHwNik7GV3AQyo/PMdMhrPo0wSixev8mabvR3nueqPI/20OzH08QdGZWfLe3+k2r1AxMlZrH8jULiY5y/E5GyUH8IZxWcuY8BHSgBbeBWzXYosDisXrR15Mg4e6FGyt3AKZXHa7rPYwHjCTG8GcVetRYu8GqLjLTh/0D/S8qDwVcVcu6EPfIHN2eZTHyLzPfuwU02t1mJ0PVg9Z3tXobHLIUOCRqqVRyuJNGrv9H5e8z5K6CNs8wBbXFntssdOizyJCGukg/9gMMzC7EmM4p3HouMKa0/awNVCfSmErpERCek= 2023-04-07T04:25:06.245 INFO:teuthology.kill: smithi169.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLMmYCNWAbrB4kaJNPz60G1XKOkSbq+Y25MAfUXEanerOFGT0D5RRuX/i4vTTZ/jbmhiX2CeuhJVmMmWSwMBi4t3FVvkzLfHEPRLtUfshIPu8ziTCQ9kLefW/aCEBvcmVAIwi4Kn8KlQxw3RYacbAza01oXOhpxbJV8N1k2WV/gCDAh5xnLPiZabOVgS4BEVmpXuLctqsfXZBumL188NqaS6O3FvcWIGZp+bBbU0HZQCQY6Nglwv2deg7I4lxxFDndx+xXTbWiDv6eTubizwZWM/QZtt387783XX90R3n4c+BpgqktBRQ1fiUUjh0tNuhNjgrxUnCMQ/ujaCeqAv5FgLrHzdMdw08oGSLYsKIKjUG6K6DWv82S/C0UWydoZ/2RF112K3NAUjh6XsQsqpdl9/DgnfxBixIjZyBUjeWiUr4Z6NtzoQpa4LahsQU07ERC6lpiKzKcv8mH/23HM6U1lpI6opeXLx7/gLe0pmbgp5/1Mycj32mByM408N+zJh0= 2023-04-07T04:25:06.245 INFO:teuthology.kill:2023-04-07 04:25:06,244.244 INFO:teuthology.nuke:Checking targets against current locks 2023-04-07T04:25:06.302 INFO:teuthology.kill:2023-04-07 04:25:06,301.301 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-07T04:25:06.329 INFO:teuthology.kill:2023-04-07 04:25:06,328.328 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-07T04:25:06.379 INFO:teuthology.kill:2023-04-07 04:25:06,379.379 INFO:teuthology.orchestra.console:Power off smithi043 2023-04-07T04:25:06.416 INFO:teuthology.kill:2023-04-07 04:25:06,415.415 INFO:teuthology.orchestra.console:Power off smithi169 2023-04-07T04:25:14.786 INFO:teuthology.kill:2023-04-07 04:25:14,786.786 INFO:teuthology.orchestra.console:Power off for smithi169 completed 2023-04-07T04:25:14.944 INFO:teuthology.kill:2023-04-07 04:25:14,943.943 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com 2023-04-07T04:25:18.867 INFO:teuthology.kill:2023-04-07 04:25:18,867.867 INFO:teuthology.orchestra.console:Power off for smithi043 completed 2023-04-07T04:25:19.025 INFO:teuthology.kill:2023-04-07 04:25:19,024.024 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com 2023-04-07T04:27:19.367 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-04-07T04:27:19.479 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi043 but it was locked by another job: /home/teuthworker/archive/dis-2023-04-06_22:44:28-rbd-wip-rbd-reef-backports-1-distro-default-smithi/7234918 2023-04-07T04:27:19.480 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi169 but it was locked by another job: /home/teuthworker/archive/dis-2023-04-06_22:44:28-rbd-wip-rbd-reef-backports-1-distro-default-smithi/7234918