2023-04-24T14:23:43.147 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae 2023-04-24T14:23:43.294 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2023-04-24T14:23:43.295 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2023-04-24T14:23:43.295 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-04-24T14:23:43.317 INFO:teuthology.lock.ops:Node 'smithi029.front.sepia.ceph.com' reimaging is complete 2023-04-24T14:23:43.318 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging 2023-04-24T14:23:43.319 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server 2023-04-24T14:23:43.319 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-04-24T14:23:43.342 INFO:teuthology.lock.ops:Node 'smithi077.front.sepia.ceph.com' reimaging is complete 2023-04-24T14:23:43.491 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of centos 8.stream 2023-04-24T14:23:43.498 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 8.stream 2023-04-24T14:23:43.710 INFO:teuthology.orchestra.console:Power off smithi077 2023-04-24T14:23:43.727 INFO:teuthology.orchestra.console:Power off smithi029 2023-04-24T14:23:43.859 INFO:teuthology.orchestra.console:Power off for smithi077 completed 2023-04-24T14:23:43.870 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2023-04-24T14:23:43.961 INFO:teuthology.orchestra.console:Power on smithi077 2023-04-24T14:23:43.971 INFO:teuthology.orchestra.console:Power on smithi029 2023-04-24T14:23:48.232 INFO:teuthology.orchestra.console:Power on for smithi029 completed 2023-04-24T14:23:48.334 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2023-04-24T14:23:52.337 INFO:teuthology.orchestra.console:Power on for smithi077 completed 2023-04-24T14:23:52.438 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish 2023-04-24T14:26:56.389 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-04-24T14:27:05.445 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-04-24T14:27:14.501 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-04-24T14:27:23.557 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-04-24T14:27:37.605 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-04-24T14:27:46.661 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-04-24T14:27:55.717 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-04-24T14:28:04.773 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-04-24T14:28:13.829 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-04-24T14:28:22.889 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-04-24T14:28:29.563 WARNING:teuthology.provision.fog:timed out 2023-04-24T14:28:35.858 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-24T14:28:36.128 INFO:teuthology.provision.fog.smithi077:Node is ready 2023-04-24T14:28:36.146 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com 2023-04-24T14:28:36.206 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077 2023-04-24T14:28:36.553 INFO:teuthology.provision.fog.smithi077:Deploy complete! 2023-04-24T14:29:28.944 WARNING:teuthology.provision.fog:timed out 2023-04-24T14:29:35.341 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-24T14:29:35.637 INFO:teuthology.provision.fog.smithi029:Node is ready 2023-04-24T14:29:35.657 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2023-04-24T14:29:35.716 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2023-04-24T14:29:36.125 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2023-04-24T14:29:36.295 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2023-04-24T14:29:36.296 INFO:teuthology.lock.ops:New key found. Updating... 2023-04-24T14:29:36.322 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com 2023-04-24T14:29:36.323 INFO:teuthology.lock.ops:New key found. Updating... 2023-04-24T14:29:36.349 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2023-04-24T14:29:36.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-04-24T14:29:36.542 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-04-24T14:29:36.600 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2023-04-24T14:29:36.601 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8" 2023-04-24T14:29:36.601 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2023-04-24T14:29:36.601 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2023-04-24T14:29:36.601 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8" 2023-04-24T14:29:36.601 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2023-04-24T14:29:36.602 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8" 2023-04-24T14:29:36.602 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-04-24T14:29:36.602 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-04-24T14:29:36.602 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2023-04-24T14:29:36.602 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-04-24T14:29:36.602 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-04-24T14:29:36.602 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-04-24T14:29:36.603 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-04-24T14:29:36.631 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server 2023-04-24T14:29:36.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-04-24T14:29:36.879 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2023-04-24T14:29:36.938 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2023-04-24T14:29:36.939 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8" 2023-04-24T14:29:36.939 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2023-04-24T14:29:36.939 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2023-04-24T14:29:36.939 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8" 2023-04-24T14:29:36.939 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8" 2023-04-24T14:29:36.939 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 8" 2023-04-24T14:29:36.940 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2023-04-24T14:29:36.940 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-04-24T14:29:36.940 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2023-04-24T14:29:36.940 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-04-24T14:29:36.940 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-04-24T14:29:36.940 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-04-24T14:29:36.941 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-04-24T14:29:37.056 INFO:teuthology.dispatcher.supervisor:Running job 7249263 2023-04-24T14:29:37.057 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-04-23_18:59:17-orch-pacific-distro-default-smithi/7249263 --name yuriw-2023-04-23_18:59:17-orch-pacific-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-04-23_18:59:17-orch-pacific-distro-default-smithi/7249263/orig.config.yaml 2023-04-24T14:29:37.060 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-04-23_18:59:17-orch-pacific-distro-default-smithi/7249263 2023-04-24T14:29:37.061 INFO:teuthology.dispatcher.supervisor:Job PID: 14201 2023-04-24T14:29:37.061 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-04-25T02:30:34.726 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-04-25T02:30:34.884 INFO:teuthology.kill:Killing Pids: {14201} 2023-04-25T02:30:35.768 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-04-25T02:30:35.768 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-04-25T02:30:35.769 INFO:teuthology.misc:Compressing logs... 2023-04-25T02:30:35.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-04-25T02:30:35.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-04-25T02:30:36.267 INFO:teuthology.misc:Compressing logs... 2023-04-25T02:30:36.306 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-04-25T02:30:36.307 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-04-25T02:30:36.308 INFO:teuthology.orchestra.run.smithi029.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 86.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-04-25T02:30:36.336 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-04-25T02:30:36.337 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-04-25T02:30:36.338 INFO:teuthology.orchestra.run.smithi077.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 78.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-04-25T02:30:36.419 INFO:teuthology.orchestra.run.smithi077.stderr: 91.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-04-25T02:30:36.455 INFO:teuthology.orchestra.run.smithi029.stderr: 94.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-04-25T02:30:36.584 INFO:teuthology.misc:Compressing logs... 2023-04-25T02:30:36.613 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-04-25T02:30:36.613 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-volume.log 2023-04-25T02:30:36.614 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mon.smithi029.log 2023-04-25T02:30:36.614 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.2.log 2023-04-25T02:30:36.615 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.1.log 2023-04-25T02:30:36.615 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mon.smithi029.log: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mgr.smithi029.cimlro.log 2023-04-25T02:30:36.617 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.1.log: 91.6% -- replaced with /var/log/ceph/cephadm.log.gz 2023-04-25T02:30:36.617 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi029.whzqcf.log 2023-04-25T02:30:36.620 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mgr.smithi029.cimlro.log: 90.4% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-volume.log.gz 2023-04-25T02:30:36.625 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi029.whzqcf.log: gzip -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi029.dmtqlu.log 2023-04-25T02:30:36.626 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.0.log 2023-04-25T02:30:36.650 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-04-25T02:30:36.651 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-volume.log 2023-04-25T02:30:36.652 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.5.log 2023-04-25T02:30:36.652 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mon.smithi077.log 2023-04-25T02:30:36.652 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-volume.log: gzip /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.5.log: -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi077.dlrzxp.log 2023-04-25T02:30:36.652 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mon.smithi077.log: gzip -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.3.log 2023-04-25T02:30:36.655 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi077.dlrzxp.log: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.3.log: 89.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-04-25T02:30:36.655 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi077.zwohun.log 2023-04-25T02:30:36.656 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0%gzip -5 -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-volume.log.gz--verbose 2023-04-25T02:30:36.656 INFO:teuthology.orchestra.run.smithi077.stderr:-- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mgr.smithi077.hjhizp.log 2023-04-25T02:30:36.657 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi077.zwohun.log: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mgr.smithi077.hjhizp.log: gzip -5 --verbose -- /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.4.log 2023-04-25T02:30:36.726 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.4.log: gzip: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi077.dlrzxp.log: file size changed while zipping 2023-04-25T02:30:36.726 INFO:teuthology.orchestra.run.smithi077.stderr: 95.1% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi077.dlrzxp.log.gz 2023-04-25T02:30:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi029.dmtqlu.log: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.0.log: 95.1% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi029.whzqcf.log.gz 2023-04-25T02:30:36.790 INFO:teuthology.orchestra.run.smithi077.stderr: 93.7% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mgr.smithi077.hjhizp.log.gz 2023-04-25T02:30:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mgr.smithi029.cimlro.log: file size changed while zipping 2023-04-25T02:30:38.998 INFO:teuthology.orchestra.run.smithi029.stderr: 92.4% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mgr.smithi029.cimlro.log.gz 2023-04-25T02:30:41.056 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mon.smithi077.log: file size changed while zipping 2023-04-25T02:30:41.056 INFO:teuthology.orchestra.run.smithi077.stderr: 93.6% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mon.smithi077.log.gz 2023-04-25T02:30:49.239 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2023-04-25T02:30:49.239 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.4.log.gz 2023-04-25T02:30:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2023-04-25T02:30:49.461 INFO:teuthology.orchestra.run.smithi077.stderr: 93.6% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.5.log.gz 2023-04-25T02:30:50.247 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2023-04-25T02:30:50.248 INFO:teuthology.orchestra.run.smithi029.stderr: 93.6% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.0.log.gz 2023-04-25T02:30:51.385 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2023-04-25T02:30:51.385 INFO:teuthology.orchestra.run.smithi077.stderr: 93.7% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.3.log.gz 2023-04-25T02:30:51.482 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mon.smithi029.log: file size changed while zipping 2023-04-25T02:30:51.483 INFO:teuthology.orchestra.run.smithi029.stderr: 89.7% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mon.smithi029.log.gz 2023-04-25T02:30:52.338 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2023-04-25T02:30:52.339 INFO:teuthology.orchestra.run.smithi029.stderr: 93.4% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.2.log.gz 2023-04-25T02:30:54.384 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2023-04-25T02:30:54.385 INFO:teuthology.orchestra.run.smithi029.stderr: 93.9% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-osd.1.log.gz 2023-04-25T02:31:20.644 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi029.dmtqlu.log: file size changed while zipping 2023-04-25T02:31:20.645 INFO:teuthology.orchestra.run.smithi029.stderr: 93.6% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi029.dmtqlu.log.gz 2023-04-25T02:31:20.966 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi077.zwohun.log: file size changed while zipping 2023-04-25T02:31:20.967 INFO:teuthology.orchestra.run.smithi077.stderr: 93.6% -- replaced with /var/log/ceph/14231f02-e2bc-11ed-9b00-001a4aab830c/ceph-mds.cephfs.smithi077.zwohun.log.gz 2023-04-25T02:31:42.188 INFO:teuthology.kill:No teuthology processes running 2023-04-25T02:31:43.015 INFO:teuthology.kill:Nuking machines: ['smithi029', 'smithi077'] 2023-04-25T02:31:43.743 INFO:teuthology.kill:2023-04-25 02:31:43,742.742 INFO:teuthology.nuke:targets: 2023-04-25T02:31:43.744 INFO:teuthology.kill: smithi029.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEJQ4xZx/PH5XJwCwTMT08AJY7fpIdxptXrbNjNGtVQFcDfpO0Dfemoj/Um/n5VLhfBCVLQApuTOESpUwgCyFjE5KM8pg+ntDZNjjLYuQYnQnLDk5LxcfbNJcNt1UCtTgSMA2kQGpveMnZHs6TwLxfVGYETpgpNg/AKi47QlByYoC9phiK81Pk84V1VhB77QD/sNL3WJuYhXyfKdCbwGGbcA8WQv4AqanqfJuQ6U1tdEXSq63uDDp8ODxMTfLjlYN2a3EvqeHalp9wl2v4lBVE/malVTfX6wkUCuSb99hBHOWVp5YWTUa/Q9NA8TpRuUZiFELjO/pac8Z3+RpDYEi//PLfECl2ycaS0rTd1O8t2m6QpAztT6jiJzNRgw06BMr7FbJdYaAKA0OW73ebFXJCgn2ZiS8eLX3SYehKrA/UPRgJ5VFzkwicge+MNXq6NoBRsGEkY1newZThWD08s2lcmk5wb/ul3+hS2WKN+2KsaaGaHX3BtX3RjJ12F+gB1gk= 2023-04-25T02:31:43.744 INFO:teuthology.kill: smithi077.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkfwflGza0+LuY9TsfZs8zBBq5XrfpubIclFQCtGxafTVngaXjLZ7Lzj+Xi8ideRv3FKKhPpFYDTUHqJKDvNcyDX5wf0cREVZWlKaHwzExMIcQf1CanY/dV4+93BqYfQ3jzhOtJaLUx+AbjjnO0p6BhIXpWHob6tuSmiFmkUV+NrIuqQxoojYhy8+I3ViWUzhPiDGjNOYXiXPOQEb5+4MdBoNZFB3+b1KvA78UHRECoKX6mhER26AFBwzf8vrp1D7nlLNm5v607EZu7jk2BTIo/yOIfBdblgVvWy37SuAEq2ZICYlBWom5T7QJbYbtq8e2XznbxzhXFhzNynG96ZwfGCReZCDBt/pM9mJQCQDAxEqjiaj0w9xPtu19U+hWkRUnLRulrS67FOM7YUDIROygTDM10l3eZ7fdE67APFm66K8YBJZlgYv/sAXeAxQWLVu+4sgOheUcABzwqcqFXTDR/dLfV8X2VIdvnK9Ib37ivsDX1n8pBgoSaQkn3a7/fAc= 2023-04-25T02:31:43.744 INFO:teuthology.kill:2023-04-25 02:31:43,743.743 INFO:teuthology.nuke:Checking targets against current locks 2023-04-25T02:31:43.800 INFO:teuthology.kill:2023-04-25 02:31:43,800.800 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-25T02:31:43.825 INFO:teuthology.kill:2023-04-25 02:31:43,824.824 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-25T02:31:43.883 INFO:teuthology.kill:2023-04-25 02:31:43,883.883 INFO:teuthology.orchestra.console:Power off smithi029 2023-04-25T02:31:43.899 INFO:teuthology.kill:2023-04-25 02:31:43,898.898 INFO:teuthology.orchestra.console:Power off smithi077 2023-04-25T02:31:56.372 INFO:teuthology.kill:2023-04-25 02:31:56,372.372 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2023-04-25T02:31:56.378 INFO:teuthology.kill:2023-04-25 02:31:56,378.378 INFO:teuthology.orchestra.console:Power off for smithi077 completed 2023-04-25T02:31:56.530 INFO:teuthology.kill:2023-04-25 02:31:56,529.529 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com 2023-04-25T02:31:56.538 INFO:teuthology.kill:2023-04-25 02:31:56,538.538 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com 2023-04-25T02:33:57.009 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-04-25T02:33:57.127 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi029 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-04-24_22:49:32-rados-wip-yuri6-testing-2023-04-12-0732-reef-distro-default-smithi/7249838 2023-04-25T02:33:57.127 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi077 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-04-24_22:49:32-rados-wip-yuri6-testing-2023-04-12-0732-reef-distro-default-smithi/7249837