2023-06-14T07:19:12.978 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd
2023-06-14T07:19:13.145 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging
2023-06-14T07:19:13.147 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server
2023-06-14T07:19:13.148 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2023-06-14T07:19:13.176 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging
2023-06-14T07:19:13.176 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server
2023-06-14T07:19:13.177 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2023-06-14T07:19:13.350 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 8.stream
2023-06-14T07:19:13.354 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of centos 8.stream
2023-06-14T07:19:13.574 INFO:teuthology.orchestra.console:Power off smithi002
2023-06-14T07:19:13.593 INFO:teuthology.orchestra.console:Power off smithi177
2023-06-14T07:19:21.961 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2023-06-14T07:19:22.063 INFO:teuthology.orchestra.console:Power on smithi002
2023-06-14T07:19:26.082 INFO:teuthology.orchestra.console:Power off for smithi177 completed
2023-06-14T07:19:26.184 INFO:teuthology.orchestra.console:Power on smithi177
2023-06-14T07:19:30.432 INFO:teuthology.orchestra.console:Power on for smithi002 completed
2023-06-14T07:19:30.534 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2023-06-14T07:19:34.553 INFO:teuthology.orchestra.console:Power on for smithi177 completed
2023-06-14T07:19:34.654 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish
2023-06-14T07:22:19.892 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-06-14T07:22:23.984 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-06-14T07:22:28.976 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-06-14T07:22:33.044 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-06-14T07:22:38.032 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-06-14T07:22:42.128 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-06-14T07:22:47.088 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2
2023-06-14T07:22:51.184 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-06-14T07:23:00.244 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-06-14T07:23:24.656 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-06-14T07:23:33.712 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-06-14T07:23:41.793 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-14T07:23:53.093 WARNING:teuthology.provision.fog:timed out
2023-06-14T07:23:59.298 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-14T07:23:59.575 INFO:teuthology.provision.fog.smithi002:Node is ready
2023-06-14T07:23:59.595 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com
2023-06-14T07:23:59.656 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002
2023-06-14T07:24:00.059 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2023-06-14T07:24:00.060 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8"
2023-06-14T07:24:00.060 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2023-06-14T07:24:00.060 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2023-06-14T07:24:00.061 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8"
2023-06-14T07:24:00.061 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8"
2023-06-14T07:24:00.061 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-14T07:24:00.061 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2023-06-14T07:24:00.061 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-14T07:24:00.062 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2023-06-14T07:24:00.062 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-14T07:24:00.062 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-14T07:24:00.062 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-14T07:24:00.063 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2023-06-14T07:24:06.929 INFO:teuthology.provision.fog.smithi177:Node is ready
2023-06-14T07:24:06.953 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com
2023-06-14T07:24:07.014 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177
2023-06-14T07:24:07.421 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream"
2023-06-14T07:24:07.421 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8"
2023-06-14T07:24:07.421 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos"
2023-06-14T07:24:07.421 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora"
2023-06-14T07:24:07.421 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8"
2023-06-14T07:24:07.422 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8"
2023-06-14T07:24:07.422 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-14T07:24:07.422 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2023-06-14T07:24:07.422 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-14T07:24:07.422 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/"
2023-06-14T07:24:07.422 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-14T07:24:07.422 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-14T07:24:07.422 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-14T07:24:07.423 INFO:teuthology.provision.fog.smithi177:Deploy complete!
2023-06-14T07:24:07.577 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2023-06-14T07:24:07.578 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-14T07:24:07.596 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com
2023-06-14T07:24:07.597 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-14T07:24:07.623 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2023-06-14T07:24:07.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2023-06-14T07:24:07.826 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2023-06-14T07:24:07.887 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2023-06-14T07:24:07.887 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8"
2023-06-14T07:24:07.888 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2023-06-14T07:24:07.888 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2023-06-14T07:24:07.888 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8"
2023-06-14T07:24:07.888 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8"
2023-06-14T07:24:07.888 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-14T07:24:07.888 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2023-06-14T07:24:07.889 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-14T07:24:07.889 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2023-06-14T07:24:07.889 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-14T07:24:07.889 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-14T07:24:07.889 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-14T07:24:07.890 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2023-06-14T07:24:07.913 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server
2023-06-14T07:24:07.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com'
2023-06-14T07:24:08.110 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64
2023-06-14T07:24:08.170 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream"
2023-06-14T07:24:08.170 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8"
2023-06-14T07:24:08.170 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos"
2023-06-14T07:24:08.170 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora"
2023-06-14T07:24:08.170 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8"
2023-06-14T07:24:08.171 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8"
2023-06-14T07:24:08.171 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-14T07:24:08.171 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2023-06-14T07:24:08.171 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-14T07:24:08.171 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/"
2023-06-14T07:24:08.171 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-14T07:24:08.171 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-14T07:24:08.171 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-14T07:24:08.172 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2023-06-14T07:24:08.301 INFO:teuthology.dispatcher.supervisor:Running job 7303086
2023-06-14T07:24:08.301 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-06-13_18:58:18-orch:cephadm-wip-adk4-testing-2023-06-13-1048-distro-default-smithi/7303086 --name adking-2023-06-13_18:58:18-orch:cephadm-wip-adk4-testing-2023-06-13-1048-distro-default-smithi --description orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/adking-2023-06-13_18:58:18-orch:cephadm-wip-adk4-testing-2023-06-13-1048-distro-default-smithi/7303086/orig.config.yaml
2023-06-14T07:24:08.305 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-06-13_18:58:18-orch:cephadm-wip-adk4-testing-2023-06-13-1048-distro-default-smithi/7303086
2023-06-14T07:24:08.306 INFO:teuthology.dispatcher.supervisor:Job PID: 28200
2023-06-14T07:24:08.307 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-06-14T19:25:10.777 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-06-14T19:25:10.949 INFO:teuthology.kill:Killing Pids: {28200}
2023-06-14T19:25:11.787 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2023-06-14T19:25:11.788 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2023-06-14T19:25:11.788 INFO:teuthology.misc:Compressing logs...
2023-06-14T19:25:11.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2023-06-14T19:25:11.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com'
2023-06-14T19:25:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2023-06-14T19:25:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2023-06-14T19:25:12.247 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2023-06-14T19:25:12.248 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now
2023-06-14T19:25:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2023-06-14T19:25:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:tar: Error is not recoverable: exiting now
2023-06-14T19:25:12.287 INFO:teuthology.misc:Compressing logs...
2023-06-14T19:25:12.323 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-06-14T19:25:12.323 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-06-14T19:25:12.324 INFO:teuthology.orchestra.run.smithi002.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	 84.2%/home/ubuntu/cephtest/archive/syslog/misc.log:	 -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-06-14T19:25:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log
2023-06-14T19:25:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log
2023-06-14T19:25:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log:	/home/ubuntu/cephtest/archive/syslog/misc.log:	 78.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz
2023-06-14T19:25:12.703 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-06-14T19:25:12.703 INFO:teuthology.orchestra.run.smithi177.stderr: 92.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-06-14T19:25:14.601 INFO:teuthology.orchestra.run.smithi002.stderr: 94.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz
2023-06-14T19:25:15.025 INFO:teuthology.misc:Compressing logs...
2023-06-14T19:25:15.060 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2023-06-14T19:25:15.060 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mds.foofs.smithi002.ehfmil.log
2023-06-14T19:25:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cephadm.log:	/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mds.foofs.smithi002.ehfmil.log:	 78.8% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mds.foofs.smithi002.ehfmil.log.gz
2023-06-14T19:25:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-volume.log
2023-06-14T19:25:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.2.log
2023-06-14T19:25:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-volume.log:	gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mon.smithi002.log
2023-06-14T19:25:15.066 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.2.log:	gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.3.log
2023-06-14T19:25:15.077 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mon.smithi002.log:	gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.0.log
2023-06-14T19:25:15.077 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mgr.smithi002.pypzcf.log
2023-06-14T19:25:15.081 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log
2023-06-14T19:25:15.081 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.6.log
2023-06-14T19:25:15.082 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/cephadm.log:	gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-volume.log
2023-06-14T19:25:15.082 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mon.smithi177.log
2023-06-14T19:25:15.082 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.6.log:	/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-volume.log:	gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mgr.smithi177.fqnfjp.log
2023-06-14T19:25:15.083 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mon.smithi177.log:	gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.7.log
2023-06-14T19:25:15.085 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mgr.smithi177.fqnfjp.log:	/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.7.log:	gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mds.foofs.smithi177.btpxiz.log
2023-06-14T19:25:15.086 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mds.foofs.smithi177.btpxiz.log:	 62.0% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mds.foofs.smithi177.btpxiz.log.gz
2023-06-14T19:25:15.086 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.4.log
2023-06-14T19:25:15.087 INFO:teuthology.orchestra.run.smithi177.stderr: 90.2% -- replaced with /var/log/ceph/cephadm.log.gz
2023-06-14T19:25:15.088 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.5.log
2023-06-14T19:25:15.095 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.4.log:	/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.5.log:	 91.6% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-volume.log.gz
2023-06-14T19:25:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.3.log:	/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.0.log:	gzip -5 --verbose -- /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.1.log
2023-06-14T19:25:15.233 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mgr.smithi002.pypzcf.log:	/var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.1.log:	 94.7% -- replaced with /var/log/ceph/cephadm.log.gz
2023-06-14T19:25:16.816 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-volume.log: file size changed while zipping
2023-06-14T19:25:16.854 INFO:teuthology.orchestra.run.smithi002.stderr: 92.1% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-volume.log.gz
2023-06-14T19:25:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mgr.smithi002.pypzcf.log: file size changed while zipping
2023-06-14T19:25:24.140 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mgr.smithi002.pypzcf.log.gz
2023-06-14T19:25:26.821 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mgr.smithi177.fqnfjp.log: file size changed while zipping
2023-06-14T19:25:26.822 INFO:teuthology.orchestra.run.smithi177.stderr: 86.7% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mgr.smithi177.fqnfjp.log.gz
2023-06-14T19:25:35.522 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2023-06-14T19:25:35.522 INFO:teuthology.orchestra.run.smithi177.stderr: 93.8% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.4.log.gz
2023-06-14T19:25:36.641 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2023-06-14T19:25:36.641 INFO:teuthology.orchestra.run.smithi002.stderr: 93.4% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.2.log.gz
2023-06-14T19:25:37.253 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2023-06-14T19:25:37.254 INFO:teuthology.orchestra.run.smithi177.stderr: 93.6% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.6.log.gz
2023-06-14T19:25:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2023-06-14T19:25:38.317 INFO:teuthology.orchestra.run.smithi177.stderr: 93.7% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.5.log.gz
2023-06-14T19:25:38.564 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mon.smithi177.log: file size changed while zipping
2023-06-14T19:25:38.564 INFO:teuthology.orchestra.run.smithi177.stderr: 92.4% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mon.smithi177.log.gz
2023-06-14T19:25:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2023-06-14T19:25:42.690 INFO:teuthology.orchestra.run.smithi002.stderr: 93.7% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.0.log.gz
2023-06-14T19:25:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2023-06-14T19:25:44.696 INFO:teuthology.orchestra.run.smithi002.stderr: 93.6% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.1.log.gz
2023-06-14T19:25:44.855 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2023-06-14T19:25:44.856 INFO:teuthology.orchestra.run.smithi177.stderr: 93.8% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.7.log.gz
2023-06-14T19:25:45.158 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2023-06-14T19:25:45.159 INFO:teuthology.orchestra.run.smithi002.stderr: 93.5% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-osd.3.log.gz
2023-06-14T19:25:51.826 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mon.smithi002.log: file size changed while zipping
2023-06-14T19:25:51.826 INFO:teuthology.orchestra.run.smithi002.stderr: 90.9% -- replaced with /var/log/ceph/f3743c90-0a85-11ee-9b2b-001a4aab830c/ceph-mon.smithi002.log.gz
2023-06-14T19:26:06.279 INFO:teuthology.orchestra.run.smithi002.stderr:tar: ./f3743c90-0a85-11ee-9b2b-001a4aab830c: file changed as we read it
2023-06-14T19:26:19.619 INFO:teuthology.orchestra.run.smithi177.stderr:tar: .: file changed as we read it
2023-06-14T19:26:19.678 INFO:teuthology.kill:No teuthology processes running
2023-06-14T19:26:20.478 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi177']
2023-06-14T19:26:21.167 INFO:teuthology.kill:2023-06-14 19:26:21,167.167 INFO:teuthology.nuke:targets:
2023-06-14T19:26:21.169 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/dispatcher/supervisor.py", line 320, in run_with_watchdog
    kill.kill_job(
  File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/kill.py", line 101, in kill_job
    nuke_targets(targets, owner)
  File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/kill.py", line 276, in nuke_targets
    sys.stdout.flush()
OSError: [Errno 5] Input/output error
2023-06-14T19:28:21.433 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-06-14T19:28:21.539 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi002 but it was locked by another job: /home/teuthworker/archive/adking-2023-06-14_18:35:42-orch:cephadm-wip-guits-testing-4-2023-06-14-1428-distro-default-smithi/7304499
2023-06-14T19:28:21.540 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi177 but it was locked by another job: /home/teuthworker/archive/adking-2023-06-14_18:35:42-orch:cephadm-wip-guits-testing-4-2023-06-14-1428-distro-default-smithi/7304500