2023-05-06T15:36:34.892 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-06T15:36:35.040 INFO:teuthology.lock.ops:Start node 'smithi101.front.sepia.ceph.com' reimaging 2023-05-06T15:36:35.041 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: reset os type and version on server 2023-05-06T15:36:35.042 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-05-06T15:36:35.070 INFO:teuthology.lock.ops:Node 'smithi101.front.sepia.ceph.com' reimaging is complete 2023-05-06T15:36:35.071 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-05-06T15:36:35.071 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-05-06T15:36:35.071 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-05-06T15:36:35.103 INFO:teuthology.lock.ops:Node 'smithi174.front.sepia.ceph.com' reimaging is complete 2023-05-06T15:36:35.236 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of centos 8.stream 2023-05-06T15:36:35.266 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of centos 8.stream 2023-05-06T15:36:35.501 INFO:teuthology.orchestra.console:Power off smithi101 2023-05-06T15:36:35.542 INFO:teuthology.orchestra.console:Power off smithi174 2023-05-06T15:36:43.881 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-05-06T15:36:43.911 INFO:teuthology.orchestra.console:Power off for smithi174 completed 2023-05-06T15:36:43.983 INFO:teuthology.orchestra.console:Power on smithi101 2023-05-06T15:36:44.014 INFO:teuthology.orchestra.console:Power on smithi174 2023-05-06T15:36:52.363 INFO:teuthology.orchestra.console:Power on for smithi101 completed 2023-05-06T15:36:52.379 INFO:teuthology.orchestra.console:Power on for smithi174 completed 2023-05-06T15:36:52.465 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish 2023-05-06T15:36:52.480 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-05-06T15:39:41.552 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-05-06T15:39:41.556 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-05-06T15:39:50.608 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-05-06T15:39:50.609 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-05-06T15:39:59.664 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-05-06T15:39:59.665 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-05-06T15:40:08.724 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-05-06T15:40:08.724 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-05-06T15:40:17.808 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-05-06T15:40:17.809 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-05-06T15:40:26.869 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-05-06T15:40:26.869 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-05-06T15:40:51.440 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-05-06T15:41:00.496 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-05-06T15:41:07.416 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-05-06T15:41:32.519 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-05-06T15:41:32.544 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2023-05-06T15:41:32.604 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-05-06T15:41:32.881 WARNING:teuthology.provision.fog:timed out 2023-05-06T15:41:32.958 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-05-06T15:41:39.116 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-05-06T15:41:39.341 INFO:teuthology.provision.fog.smithi101:Node is ready 2023-05-06T15:41:39.360 INFO:teuthology.orchestra.run.smithi101.stdout:smithi101.front.sepia.ceph.com 2023-05-06T15:41:39.420 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101.front.sepia.ceph.com smithi101 2023-05-06T15:41:39.759 INFO:teuthology.provision.fog.smithi101:Deploy complete! 2023-05-06T15:41:39.929 INFO:teuthology.lock.ops:Checking smithi101.front.sepia.ceph.com 2023-05-06T15:41:39.929 INFO:teuthology.lock.ops:New key found. Updating... 2023-05-06T15:41:39.967 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2023-05-06T15:41:39.967 INFO:teuthology.lock.ops:New key found. Updating... 2023-05-06T15:41:39.993 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: set os type and version on server 2023-05-06T15:41:39.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-05-06T15:41:40.183 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64 2023-05-06T15:41:40.241 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="CentOS Stream" 2023-05-06T15:41:40.241 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8" 2023-05-06T15:41:40.241 INFO:teuthology.orchestra.run.smithi101.stdout:ID="centos" 2023-05-06T15:41:40.242 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="rhel fedora" 2023-05-06T15:41:40.242 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8" 2023-05-06T15:41:40.242 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8" 2023-05-06T15:41:40.242 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="CentOS Stream 8" 2023-05-06T15:41:40.242 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2023-05-06T15:41:40.242 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-05-06T15:41:40.242 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://centos.org/" 2023-05-06T15:41:40.243 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-06T15:41:40.243 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-06T15:41:40.243 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-05-06T15:41:40.244 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-05-06T15:41:40.267 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2023-05-06T15:41:40.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-05-06T15:41:40.471 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-05-06T15:41:40.532 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2023-05-06T15:41:40.532 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8" 2023-05-06T15:41:40.532 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2023-05-06T15:41:40.532 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2023-05-06T15:41:40.532 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8" 2023-05-06T15:41:40.533 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-05-06T15:41:40.533 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 8" 2023-05-06T15:41:40.533 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-05-06T15:41:40.533 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-05-06T15:41:40.533 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2023-05-06T15:41:40.533 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-06T15:41:40.533 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-06T15:41:40.534 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-05-06T15:41:40.534 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-05-06T15:41:40.652 INFO:teuthology.dispatcher.supervisor:Running job 7263585 2023-05-06T15:41:40.652 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-05-06_14:38:26-fs-pacific-release-distro-default-smithi/7263585 --name yuriw-2023-05-06_14:38:26-fs-pacific-release-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-05-06_14:38:26-fs-pacific-release-distro-default-smithi/7263585/orig.config.yaml 2023-05-06T15:41:40.656 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-05-06_14:38:26-fs-pacific-release-distro-default-smithi/7263585 2023-05-06T15:41:40.656 INFO:teuthology.dispatcher.supervisor:Job PID: 32251 2023-05-06T15:41:40.656 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-05-07T03:42:38.360 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-05-07T03:42:38.538 INFO:teuthology.kill:Killing Pids: {32251} 2023-05-07T03:42:39.481 INFO:teuthology.task.internal:roles: ubuntu@smithi101.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-05-07T03:42:39.482 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-05-07T03:42:39.482 INFO:teuthology.misc:Compressing logs... 2023-05-07T03:42:39.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-05-07T03:42:39.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-05-07T03:42:39.969 INFO:teuthology.misc:Compressing logs... 2023-05-07T03:42:40.009 INFO:teuthology.orchestra.run.smithi101.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-07T03:42:40.009 INFO:teuthology.orchestra.run.smithi101.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-07T03:42:40.009 INFO:teuthology.orchestra.run.smithi101.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 86.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-05-07T03:42:40.044 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-07T03:42:40.045 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-07T03:42:40.045 INFO:teuthology.orchestra.run.smithi174.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 77.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-05-07T03:42:40.129 INFO:teuthology.orchestra.run.smithi101.stderr: 93.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-05-07T03:42:40.131 INFO:teuthology.orchestra.run.smithi174.stderr: 92.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-05-07T03:42:40.261 INFO:teuthology.misc:Compressing logs... 2023-05-07T03:42:40.289 INFO:teuthology.orchestra.run.smithi101.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-05-07T03:42:40.289 INFO:teuthology.orchestra.run.smithi101.stderr:gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-volume.log 2023-05-07T03:42:40.291 INFO:teuthology.orchestra.run.smithi101.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.2.log 2023-05-07T03:42:40.291 INFO:teuthology.orchestra.run.smithi101.stderr: 0.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-05-07T03:42:40.291 INFO:teuthology.orchestra.run.smithi101.stderr:gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.0.log 2023-05-07T03:42:40.291 INFO:teuthology.orchestra.run.smithi101.stderr:/var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-volume.log: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi101.vrhqgr.log 2023-05-07T03:42:40.291 INFO:teuthology.orchestra.run.smithi101.stderr:/var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mgr.smithi101.jglias.log 2023-05-07T03:42:40.291 INFO:teuthology.orchestra.run.smithi101.stderr:gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mon.smithi101.log 2023-05-07T03:42:40.295 INFO:teuthology.orchestra.run.smithi101.stderr:/var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi101.vrhqgr.log: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mgr.smithi101.jglias.log: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mon.smithi101.log: 90.5% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-volume.log.gz 2023-05-07T03:42:40.295 INFO:teuthology.orchestra.run.smithi101.stderr:gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi101.pfyvyq.log 2023-05-07T03:42:40.296 INFO:teuthology.orchestra.run.smithi101.stderr:gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.1.log 2023-05-07T03:42:40.322 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-05-07T03:42:40.323 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi174.sbpgnx.log 2023-05-07T03:42:40.323 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-volume.log 2023-05-07T03:42:40.324 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/cephadm.log: 0.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-05-07T03:42:40.324 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mgr.smithi174.ltxrfk.log 2023-05-07T03:42:40.325 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi174.sbpgnx.log: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mon.smithi174.log 2023-05-07T03:42:40.325 INFO:teuthology.orchestra.run.smithi174.stderr: 0.0% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-volume.log.gz 2023-05-07T03:42:40.325 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mgr.smithi174.ltxrfk.log: gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.3.log 2023-05-07T03:42:40.326 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mon.smithi174.log: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi174.cnbstd.log 2023-05-07T03:42:40.326 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.4.log 2023-05-07T03:42:40.326 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi174.cnbstd.log: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.5.log 2023-05-07T03:42:40.327 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.5.log: 94.6% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mgr.smithi174.ltxrfk.log.gz 2023-05-07T03:42:40.408 INFO:teuthology.orchestra.run.smithi174.stderr: 95.0% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi174.sbpgnx.log.gz 2023-05-07T03:42:40.419 INFO:teuthology.orchestra.run.smithi174.stderr: 94.8% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi174.cnbstd.log.gz 2023-05-07T03:42:40.553 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mon.smithi174.log: file size changed while zipping 2023-05-07T03:42:40.553 INFO:teuthology.orchestra.run.smithi174.stderr: 93.6% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mon.smithi174.log.gz 2023-05-07T03:42:40.877 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2023-05-07T03:42:40.877 INFO:teuthology.orchestra.run.smithi174.stderr: 92.9% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.4.log.gz 2023-05-07T03:42:40.954 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2023-05-07T03:42:40.960 INFO:teuthology.orchestra.run.smithi174.stderr: 93.2% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.3.log.gz 2023-05-07T03:42:41.004 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2023-05-07T03:42:41.004 INFO:teuthology.orchestra.run.smithi174.stderr: 93.0% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.5.log.gz 2023-05-07T03:42:44.211 INFO:teuthology.orchestra.run.smithi101.stderr:/var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi101.pfyvyq.log: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.1.log: gzip: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mgr.smithi101.jglias.log: file size changed while zipping 2023-05-07T03:42:44.211 INFO:teuthology.orchestra.run.smithi101.stderr: 92.4% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mgr.smithi101.jglias.log.gz 2023-05-07T03:42:45.474 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi101.vrhqgr.log: file size changed while zipping 2023-05-07T03:42:45.474 INFO:teuthology.orchestra.run.smithi101.stderr: 95.1% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi101.vrhqgr.log.gz 2023-05-07T03:42:54.654 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2023-05-07T03:42:54.654 INFO:teuthology.orchestra.run.smithi101.stderr: 93.4% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.2.log.gz 2023-05-07T03:42:57.564 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mon.smithi101.log: file size changed while zipping 2023-05-07T03:42:57.564 INFO:teuthology.orchestra.run.smithi101.stderr: 89.9% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mon.smithi101.log.gz 2023-05-07T03:43:03.528 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2023-05-07T03:43:03.528 INFO:teuthology.orchestra.run.smithi101.stderr: 93.5% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.0.log.gz 2023-05-07T03:43:04.669 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2023-05-07T03:43:04.669 INFO:teuthology.orchestra.run.smithi101.stderr: 94.1% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-osd.1.log.gz 2023-05-07T03:43:24.675 INFO:teuthology.orchestra.run.smithi101.stderr:gzip: /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi101.pfyvyq.log: file size changed while zipping 2023-05-07T03:43:24.675 INFO:teuthology.orchestra.run.smithi101.stderr: 93.5% -- replaced with /var/log/ceph/b48652c6-ec25-11ed-9b01-001a4aab830c/ceph-mds.cephfs.smithi101.pfyvyq.log.gz 2023-05-07T03:43:50.612 INFO:teuthology.kill:No teuthology processes running 2023-05-07T03:43:51.531 INFO:teuthology.kill:Nuking machines: ['smithi101', 'smithi174'] 2023-05-07T03:43:52.128 INFO:teuthology.kill:2023-05-07 03:43:52,128.128 INFO:teuthology.nuke:targets: 2023-05-07T03:43:52.129 INFO:teuthology.kill: smithi101.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaL5oObOQqikEnwmMVraygRv3bFFYdj0+JdqrFKTcwYBjbP9H0UN72blUvhBLJm8etR9rmk7oCtRff5OviNhRONyIVFkLk/nOhdX+sLP9ZjrBz2nOQQfpcF1IRURJWlwaf+jtYd2F2z07Zfj4un4WF5zSUjGCjHKNELlKW/6BmfQEPfpbhJ0UhWC6KMwKg7QejBQ7x09tgdMmxHRxaxtlwktekjxj0owvP16Qs9BjGW4YfheDEGSOPzSWfzgVSaOaGGT+cMwOS+zBEiv8NYoqjVc0bxat9+QB7zi3p3BMQgcHBBXGFXq/r8ydJzgnexBYcU8KwWHsDE0EaCYdr/se8vIZ/ccjmmdYfy0EZJiHoZqUTqXg+PRNIKLNJIPHEF1dzcKOW+BTi65vL32/vL6xkHC9dbWpiDmYB1+wl3ftOLHNvA/V7yHOJTDbZD7SERtFh9dx+w+XNg41+jwYHeLNYaXYuOvRozor/JED/uj64evc3lv+oiQA5cQL8uKFyQz0= 2023-05-07T03:43:52.130 INFO:teuthology.kill: smithi174.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRmDawca9FTdpT2ih8djyZlUe/43PizXG5yWO7Y6EcU8Fnl1IoTFiQmTehDxe6E4cGO+uJT8bDIHhZ1vW5XIxuRfyYTd4Di9sl6gSEoSuFKTEwh58QgRBNJhKnsAExR7nC3dXfqq05B/kP5z8EIcmFRQtLr35F6ZLLh244ZB3YByVRwNWILr9cmyRSUBioSTxEt1rHYoBvBJnBti2plKoXSnWIwd3RYjoVUfTyZ9DmHTtiH4knJnelTFN0G15nTFymQ2+sVFB98kvKxiZ8ozfdbL6jYcA0nXRhIlLfqfYyL6Zw7qv4EdF2ROFaCAXWlhpBZNXxN+Mhr2AoBrFdHqSFSEAQPlc624GZeLXOTsYu1u3M7f/hfHPFEpOk3gU4FmuOPMxiE6tfMxZavO96k5AZEAxTPGVNkvGWRm+r5aZcwZP6FDf8Ws2ejfwcHUraA3Ef8DCV2lqy0D9B57huj13mQrqK20HP2Asvu70vpobxy9EjVZuTGNfvZezion2FdDU= 2023-05-07T03:43:52.130 INFO:teuthology.kill:2023-05-07 03:43:52,128.128 INFO:teuthology.nuke:Checking targets against current locks 2023-05-07T03:43:52.185 INFO:teuthology.kill:2023-05-07 03:43:52,185.185 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-07T03:43:52.210 INFO:teuthology.kill:2023-05-07 03:43:52,210.210 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-07T03:43:52.269 INFO:teuthology.kill:2023-05-07 03:43:52,269.269 INFO:teuthology.orchestra.console:Power off smithi101 2023-05-07T03:43:52.307 INFO:teuthology.kill:2023-05-07 03:43:52,306.306 INFO:teuthology.orchestra.console:Power off smithi174 2023-05-07T03:44:04.754 INFO:teuthology.kill:2023-05-07 03:44:04,754.754 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-05-07T03:44:04.786 INFO:teuthology.kill:2023-05-07 03:44:04,786.786 INFO:teuthology.orchestra.console:Power off for smithi174 completed 2023-05-07T03:44:04.916 INFO:teuthology.kill:2023-05-07 03:44:04,915.915 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com 2023-05-07T03:44:04.949 INFO:teuthology.kill:2023-05-07 03:44:04,949.949 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com 2023-05-07T03:46:05.293 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-05-07T03:46:05.399 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi101 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-05-06_14:35:27-rados-reef-distro-default-smithi/7263334 2023-05-07T03:46:05.400 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi174 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-05-06_14:35:27-rados-reef-distro-default-smithi/7263334