2023-04-25T14:44:52.692 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae 2023-04-25T14:44:52.830 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging 2023-04-25T14:44:52.831 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server 2023-04-25T14:44:52.832 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2023-04-25T14:44:52.849 INFO:teuthology.lock.ops:Node 'smithi047.front.sepia.ceph.com' reimaging is complete 2023-04-25T14:44:52.849 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2023-04-25T14:44:52.850 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2023-04-25T14:44:52.850 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-04-25T14:44:52.873 INFO:teuthology.lock.ops:Node 'smithi158.front.sepia.ceph.com' reimaging is complete 2023-04-25T14:44:53.019 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of centos 8.stream 2023-04-25T14:44:53.037 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of centos 8.stream 2023-04-25T14:44:53.247 INFO:teuthology.orchestra.console:Power off smithi047 2023-04-25T14:44:53.263 INFO:teuthology.orchestra.console:Power off smithi158 2023-04-25T14:45:01.632 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2023-04-25T14:45:01.733 INFO:teuthology.orchestra.console:Power on smithi158 2023-04-25T14:45:05.735 INFO:teuthology.orchestra.console:Power off for smithi047 completed 2023-04-25T14:45:05.837 INFO:teuthology.orchestra.console:Power on smithi047 2023-04-25T14:45:10.092 INFO:teuthology.orchestra.console:Power on for smithi047 completed 2023-04-25T14:45:10.098 INFO:teuthology.orchestra.console:Power on for smithi158 completed 2023-04-25T14:45:10.194 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish 2023-04-25T14:45:10.199 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2023-04-25T14:47:59.109 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-04-25T14:48:08.197 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-04-25T14:48:14.181 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-04-25T14:48:17.257 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-04-25T14:48:23.237 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-04-25T14:48:26.309 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-04-25T14:48:32.293 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-04-25T14:48:35.365 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-04-25T14:48:41.349 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-04-25T14:48:50.409 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-04-25T14:48:59.493 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-04-25T14:49:08.549 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-04-25T14:49:17.605 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-04-25T14:49:26.661 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-04-25T14:49:41.373 WARNING:teuthology.provision.fog:timed out 2023-04-25T14:49:47.743 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-25T14:49:48.022 INFO:teuthology.provision.fog.smithi047:Node is ready 2023-04-25T14:49:48.042 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com 2023-04-25T14:49:48.102 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047 2023-04-25T14:49:48.459 INFO:teuthology.provision.fog.smithi047:Deploy complete! 2023-04-25T14:50:32.713 WARNING:teuthology.provision.fog:timed out 2023-04-25T14:50:38.976 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-25T14:50:39.259 INFO:teuthology.provision.fog.smithi158:Node is ready 2023-04-25T14:50:39.318 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2023-04-25T14:50:39.377 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2023-04-25T14:50:39.725 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2023-04-25T14:50:39.896 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com 2023-04-25T14:50:39.897 INFO:teuthology.lock.ops:New key found. Updating... 2023-04-25T14:50:39.922 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2023-04-25T14:50:39.922 INFO:teuthology.lock.ops:New key found. Updating... 2023-04-25T14:50:39.949 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server 2023-04-25T14:50:39.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2023-04-25T14:50:40.211 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2023-04-25T14:50:40.270 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2023-04-25T14:50:40.270 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8" 2023-04-25T14:50:40.271 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2023-04-25T14:50:40.271 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2023-04-25T14:50:40.271 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8" 2023-04-25T14:50:40.272 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8" 2023-04-25T14:50:40.272 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 8" 2023-04-25T14:50:40.272 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2023-04-25T14:50:40.272 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-04-25T14:50:40.273 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2023-04-25T14:50:40.273 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-04-25T14:50:40.273 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-04-25T14:50:40.273 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-04-25T14:50:40.275 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2023-04-25T14:50:40.298 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2023-04-25T14:50:40.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-04-25T14:50:40.487 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-04-25T14:50:40.543 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2023-04-25T14:50:40.544 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2023-04-25T14:50:40.544 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2023-04-25T14:50:40.544 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2023-04-25T14:50:40.544 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2023-04-25T14:50:40.544 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-04-25T14:50:40.544 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2023-04-25T14:50:40.545 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-04-25T14:50:40.545 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-04-25T14:50:40.545 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2023-04-25T14:50:40.545 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-04-25T14:50:40.545 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-04-25T14:50:40.545 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-04-25T14:50:40.546 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-04-25T14:50:40.651 INFO:teuthology.dispatcher.supervisor:Running job 7252014 2023-04-25T14:50:40.652 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-04-25_14:33:31-orch-wip-vshankar-testing-20230420.132447-testing-default-smithi/7252014 --name vshankar-2023-04-25_14:33:31-orch-wip-vshankar-testing-20230420.132447-testing-default-smithi --description orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/vshankar-2023-04-25_14:33:31-orch-wip-vshankar-testing-20230420.132447-testing-default-smithi/7252014/orig.config.yaml 2023-04-25T14:50:40.655 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-04-25_14:33:31-orch-wip-vshankar-testing-20230420.132447-testing-default-smithi/7252014 2023-04-25T14:50:40.656 INFO:teuthology.dispatcher.supervisor:Job PID: 4893 2023-04-25T14:50:40.656 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-04-26T02:51:39.121 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-04-26T02:51:39.295 INFO:teuthology.kill:Killing Pids: {4893} 2023-04-26T02:51:40.111 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-04-26T02:51:40.112 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-04-26T02:51:40.112 INFO:teuthology.misc:Compressing logs... 2023-04-26T02:51:40.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2023-04-26T02:51:40.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-04-26T02:51:40.394 INFO:teuthology.orchestra.run.smithi047.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2023-04-26T02:51:40.643 INFO:teuthology.orchestra.run.smithi158.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2023-04-26T02:51:40.726 INFO:teuthology.orchestra.run.smithi047.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2023-04-26T02:51:40.727 INFO:teuthology.orchestra.run.smithi047.stderr:tar: Error is not recoverable: exiting now 2023-04-26T02:51:40.805 INFO:teuthology.orchestra.run.smithi158.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2023-04-26T02:51:40.806 INFO:teuthology.orchestra.run.smithi158.stderr:tar: Error is not recoverable: exiting now 2023-04-26T02:51:40.807 INFO:teuthology.misc:Compressing logs... 2023-04-26T02:51:40.871 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-04-26T02:51:40.871 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-04-26T02:51:40.873 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-04-26T02:51:40.874 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-04-26T02:51:40.874 INFO:teuthology.orchestra.run.smithi047.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 89.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-04-26T02:51:40.876 INFO:teuthology.orchestra.run.smithi158.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 89.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-04-26T02:51:40.972 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-04-26T02:51:40.973 INFO:teuthology.orchestra.run.smithi158.stderr: 91.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-04-26T02:51:40.980 INFO:teuthology.orchestra.run.smithi047.stderr: 91.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-04-26T02:51:41.143 INFO:teuthology.misc:Compressing logs... 2023-04-26T02:51:41.206 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-volume.log 2023-04-26T02:51:41.207 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.2.log 2023-04-26T02:51:41.208 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.1.log 2023-04-26T02:51:41.209 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mds.foofs.smithi047.hqxuat.log 2023-04-26T02:51:41.210 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.3.log 2023-04-26T02:51:41.211 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-volume.log 2023-04-26T02:51:41.211 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mds.foofs.smithi047.hqxuat.log: 75.4% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mds.foofs.smithi047.hqxuat.log.gz 2023-04-26T02:51:41.211 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.0.log 2023-04-26T02:51:41.212 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.5.log 2023-04-26T02:51:41.212 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mgr.smithi047.bxrkgz.log 2023-04-26T02:51:41.213 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.7.log 2023-04-26T02:51:41.213 INFO:teuthology.orchestra.run.smithi047.stderr: 90.2% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-volume.log.gz 2023-04-26T02:51:41.214 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mon.smithi158.log 2023-04-26T02:51:41.214 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mon.smithi047.log 2023-04-26T02:51:41.215 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-volume.log: /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.7.log: /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mds.foofs.smithi158.ulufif.log 2023-04-26T02:51:41.215 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mgr.smithi047.bxrkgz.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-04-26T02:51:41.216 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mon.smithi158.log: gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mgr.smithi158.spnrvd.log 2023-04-26T02:51:41.216 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mds.foofs.smithi158.ulufif.log: 70.7% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mds.foofs.smithi158.ulufif.log.gz 2023-04-26T02:51:41.217 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.6.log 2023-04-26T02:51:41.218 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mgr.smithi158.spnrvd.log: gzip -5 --verbose -- /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.4.log 2023-04-26T02:51:41.220 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.6.log: 89.8% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-volume.log.gz 2023-04-26T02:51:41.220 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-04-26T02:51:41.227 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.4.log: /var/log/ceph/cephadm.log: 89.4% -- replaced with /var/log/ceph/cephadm.log.gz 2023-04-26T02:51:41.230 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mon.smithi047.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-04-26T02:51:41.550 INFO:teuthology.orchestra.run.smithi047.stderr: 93.2% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mgr.smithi047.bxrkgz.log.gz 2023-04-26T02:51:45.613 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mgr.smithi158.spnrvd.log: file size changed while zipping 2023-04-26T02:51:45.613 INFO:teuthology.orchestra.run.smithi158.stderr: 91.4% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mgr.smithi158.spnrvd.log.gz 2023-04-26T02:51:49.197 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mon.smithi158.log: file size changed while zipping 2023-04-26T02:51:49.197 INFO:teuthology.orchestra.run.smithi158.stderr: 92.3% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mon.smithi158.log.gz 2023-04-26T02:51:58.197 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mon.smithi047.log: file size changed while zipping 2023-04-26T02:51:58.198 INFO:teuthology.orchestra.run.smithi047.stderr: 90.3% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-mon.smithi047.log.gz 2023-04-26T02:52:05.667 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2023-04-26T02:52:05.667 INFO:teuthology.orchestra.run.smithi047.stderr: 93.9% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.2.log.gz 2023-04-26T02:52:11.588 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2023-04-26T02:52:11.588 INFO:teuthology.orchestra.run.smithi158.stderr: 93.8% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.4.log.gz 2023-04-26T02:52:13.703 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2023-04-26T02:52:13.704 INFO:teuthology.orchestra.run.smithi047.stderr: 93.8% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.0.log.gz 2023-04-26T02:52:14.519 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2023-04-26T02:52:14.520 INFO:teuthology.orchestra.run.smithi158.stderr: 93.9% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.6.log.gz 2023-04-26T02:52:17.235 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2023-04-26T02:52:17.235 INFO:teuthology.orchestra.run.smithi158.stderr: 93.9% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.5.log.gz 2023-04-26T02:52:21.652 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2023-04-26T02:52:21.652 INFO:teuthology.orchestra.run.smithi047.stderr: 94.0% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.1.log.gz 2023-04-26T02:52:26.224 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2023-04-26T02:52:26.225 INFO:teuthology.orchestra.run.smithi158.stderr: 93.9% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.7.log.gz 2023-04-26T02:52:27.344 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2023-04-26T02:52:27.344 INFO:teuthology.orchestra.run.smithi047.stderr: 93.7% -- replaced with /var/log/ceph/2c19f7d6-e382-11ed-9b00-001a4aab830c/ceph-osd.3.log.gz 2023-04-26T02:53:01.179 INFO:teuthology.kill:No teuthology processes running 2023-04-26T02:53:02.034 INFO:teuthology.kill:Nuking machines: ['smithi047', 'smithi158'] 2023-04-26T02:53:02.630 INFO:teuthology.kill:2023-04-26 02:53:02,630.630 INFO:teuthology.nuke:targets: 2023-04-26T02:53:02.631 INFO:teuthology.kill: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIFwg9UyruaaIzMIhXzqSj9lkAl4FAVIdG63fJbvDzCuu2+JKlTpA6nyy3ar11Cz4YlhC7UR3PDgaH6pbyccbcQ= 2023-04-26T02:53:02.631 INFO:teuthology.kill: smithi158.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7CXkq46/rekZW+iMz6ubmHGUCVi9AQOkkYhp/rEWHbXONG+kelcQRdlATVhPlvb3uCxl0t2XeHO9OkPJvX2lbPqlueG+RfnUfXCXre5fuHcrC/nFb//zMgvsurBDSf+94kMH7PZ+aZR68SsPEiYoHDF8O/lw2JHNs+3YS6IT0xNN/gDZ04jqv+/QO/RS2WAkZzYoNRfZe0CqJMmRr9eI00TgMu6cQ85GSA6AmBrtvAMf8b30UTOnL978/ISYUzxuPYg0C4xVGt+OQ3KnfukHq+M2MeHNuYwH+gihvUnB9/WJ5Yxy6KXBuQVTosUrnjzpOdjOKzVt6ygLzADdOy/t1O6YLQ7BgPZ0IeyqHeks8S5xnAUA2yD4yvCTHvFnifPPfULnl8USd62jPlXa48QIpXSiT712uDW9aVKy+M9uc2cS8G8vgMXKSteLbTrKykBh8ST/b1Zvl9k26f6OWnPWLSWiLOJKTYn0NNNJrlctrMzc7UDmM3ZFcWucYtfuqptU= 2023-04-26T02:53:02.632 INFO:teuthology.kill:2023-04-26 02:53:02,630.630 INFO:teuthology.nuke:Checking targets against current locks 2023-04-26T02:53:02.692 INFO:teuthology.kill:2023-04-26 02:53:02,692.692 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-26T02:53:02.710 INFO:teuthology.kill:2023-04-26 02:53:02,709.709 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-26T02:53:02.773 INFO:teuthology.kill:2023-04-26 02:53:02,772.772 INFO:teuthology.orchestra.console:Power off smithi047 2023-04-26T02:53:02.789 INFO:teuthology.kill:2023-04-26 02:53:02,789.789 INFO:teuthology.orchestra.console:Power off smithi158 2023-04-26T02:53:11.150 INFO:teuthology.kill:2023-04-26 02:53:11,149.149 INFO:teuthology.orchestra.console:Power off for smithi047 completed 2023-04-26T02:53:11.306 INFO:teuthology.kill:2023-04-26 02:53:11,306.306 INFO:teuthology.lock.ops:unlocked: smithi047.front.sepia.ceph.com 2023-04-26T02:53:15.270 INFO:teuthology.kill:2023-04-26 02:53:15,270.270 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2023-04-26T02:53:15.421 INFO:teuthology.kill:2023-04-26 02:53:15,421.421 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com 2023-04-26T02:55:15.776 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-04-26T02:55:15.876 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi047 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-04-25_14:21:53-powercycle-pacific-release-distro-default-smithi/7251658 2023-04-26T02:55:15.877 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi158 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-04-25_14:21:53-powercycle-pacific-release-distro-default-smithi/7251658