2022-03-13T07:01:43.330 INFO:root:teuthology version: 1.1.0-fbfc7b38
2022-03-13T07:01:43.550 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi153.front.sepia.ceph.com' reimaging
2022-03-13T07:01:43.551 INFO:teuthology.lock.ops:Updating [ubuntu@smithi153.front.sepia.ceph.com]: reset os type and version on server
2022-03-13T07:01:43.552 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2022-03-13T07:01:43.575 INFO:teuthology.lock.ops:Node 'ubuntu@smithi153.front.sepia.ceph.com' reimaging is complete
2022-03-13T07:01:43.576 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi201.front.sepia.ceph.com' reimaging
2022-03-13T07:01:43.576 INFO:teuthology.lock.ops:Updating [ubuntu@smithi201.front.sepia.ceph.com]: reset os type and version on server
2022-03-13T07:01:43.576 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server
2022-03-13T07:01:43.619 INFO:teuthology.lock.ops:Node 'ubuntu@smithi201.front.sepia.ceph.com' reimaging is complete
2022-03-13T07:01:43.856 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 8.stream
2022-03-13T07:01:43.887 INFO:teuthology.provision.fog.smithi201:Scheduling deploy of centos 8.stream
2022-03-13T07:01:44.294 INFO:teuthology.orchestra.console:Power off smithi153
2022-03-13T07:01:44.354 INFO:teuthology.orchestra.console:Power off smithi201
2022-03-13T07:01:56.806 INFO:teuthology.orchestra.console:Power off for smithi153 completed
2022-03-13T07:01:56.843 INFO:teuthology.orchestra.console:Power off for smithi201 completed
2022-03-13T07:01:56.908 INFO:teuthology.orchestra.console:Power on smithi153
2022-03-13T07:01:56.945 INFO:teuthology.orchestra.console:Power on smithi201
2022-03-13T07:02:01.171 INFO:teuthology.orchestra.console:Power on for smithi153 completed
2022-03-13T07:02:01.200 INFO:teuthology.orchestra.console:Power on for smithi201 completed
2022-03-13T07:02:01.273 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2022-03-13T07:02:01.301 INFO:teuthology.provision.fog.smithi201:Waiting for deploy to finish
2022-03-13T07:06:07.918 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-13T07:06:33.574 INFO:teuthology.provision.fog.smithi201:Node is ready
2022-03-13T07:06:33.596 INFO:teuthology.orchestra.run.smithi201.stdout:smithi201.front.sepia.ceph.com
2022-03-13T07:06:33.657 INFO:teuthology.orchestra.run.smithi201.stdout:172.21.15.201 smithi201.front.sepia.ceph.com smithi201
2022-03-13T07:06:34.031 INFO:teuthology.provision.fog.smithi201:Deploy complete!
2022-03-13T07:06:48.468 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-13T07:06:48.719 INFO:teuthology.provision.fog.smithi153:Node is ready
2022-03-13T07:06:48.775 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com
2022-03-13T07:06:48.833 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2022-03-13T07:06:49.179 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2022-03-13T07:06:49.327 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2022-03-13T07:06:49.328 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-13T07:06:49.347 INFO:teuthology.lock.ops:Checking smithi201.front.sepia.ceph.com
2022-03-13T07:06:49.348 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-13T07:06:49.368 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2022-03-13T07:06:49.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2022-03-13T07:06:49.558 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2022-03-13T07:06:49.615 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream"
2022-03-13T07:06:49.615 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8"
2022-03-13T07:06:49.616 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos"
2022-03-13T07:06:49.616 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora"
2022-03-13T07:06:49.616 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8"
2022-03-13T07:06:49.616 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8"
2022-03-13T07:06:49.616 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-13T07:06:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2022-03-13T07:06:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-13T07:06:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/"
2022-03-13T07:06:49.617 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-13T07:06:49.618 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-13T07:06:49.618 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-13T07:06:49.619 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2022-03-13T07:06:49.637 INFO:teuthology.lock.ops:Updating [smithi201.front.sepia.ceph.com]: set os type and version on server
2022-03-13T07:06:49.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi201.front.sepia.ceph.com'
2022-03-13T07:06:49.887 INFO:teuthology.orchestra.run.smithi201.stdout:x86_64
2022-03-13T07:06:49.944 INFO:teuthology.orchestra.run.smithi201.stdout:NAME="CentOS Stream"
2022-03-13T07:06:49.944 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION="8"
2022-03-13T07:06:49.944 INFO:teuthology.orchestra.run.smithi201.stdout:ID="centos"
2022-03-13T07:06:49.945 INFO:teuthology.orchestra.run.smithi201.stdout:ID_LIKE="rhel fedora"
2022-03-13T07:06:49.945 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION_ID="8"
2022-03-13T07:06:49.945 INFO:teuthology.orchestra.run.smithi201.stdout:PLATFORM_ID="platform:el8"
2022-03-13T07:06:49.945 INFO:teuthology.orchestra.run.smithi201.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-13T07:06:49.946 INFO:teuthology.orchestra.run.smithi201.stdout:ANSI_COLOR="0;31"
2022-03-13T07:06:49.946 INFO:teuthology.orchestra.run.smithi201.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-13T07:06:49.946 INFO:teuthology.orchestra.run.smithi201.stdout:HOME_URL="https://centos.org/"
2022-03-13T07:06:49.946 INFO:teuthology.orchestra.run.smithi201.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-13T07:06:49.946 INFO:teuthology.orchestra.run.smithi201.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-13T07:06:49.947 INFO:teuthology.orchestra.run.smithi201.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-13T07:06:49.947 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server
2022-03-13T07:06:50.049 INFO:teuthology.dispatcher.supervisor:Running job 6734302
2022-03-13T07:06:50.050 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734302 --name teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734302/orig.config.yaml
2022-03-13T07:06:50.053 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-03-13_03:31:03-rados-pacific-distro-default-smithi/6734302
2022-03-13T07:06:50.054 INFO:teuthology.dispatcher.supervisor:Job PID: 14130
2022-03-13T07:06:50.055 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-13T13:37:19.635 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-13T13:37:20.211 INFO:teuthology.kill:Killing Pids: {14130}
2022-03-13T13:37:21.423 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-13T13:37:21.424 INFO:teuthology.task.internal:roles: ubuntu@smithi201.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-13T13:37:21.424 INFO:teuthology.misc:Compressing logs...
2022-03-13T13:37:21.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2022-03-13T13:37:21.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi201.front.sepia.ceph.com'
2022-03-13T13:37:21.667 INFO:teuthology.orchestra.run.smithi153.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-03-13T13:37:21.857 INFO:teuthology.orchestra.run.smithi201.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-03-13T13:37:21.902 INFO:teuthology.orchestra.run.smithi153.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-13T13:37:21.902 INFO:teuthology.orchestra.run.smithi153.stderr:tar: Error is not recoverable: exiting now
2022-03-13T13:37:21.942 INFO:teuthology.orchestra.run.smithi201.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-13T13:37:21.943 INFO:teuthology.orchestra.run.smithi201.stderr:tar: Error is not recoverable: exiting now
2022-03-13T13:37:21.944 INFO:teuthology.misc:Compressing logs...
2022-03-13T13:37:22.270 INFO:teuthology.misc:Compressing logs...
2022-03-13T13:37:37.645 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/4ef39ec8-a29d-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-03-13T13:37:38.407 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/4ef39ec8-a29d-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-03-13T13:37:49.118 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/4ef39ec8-a29d-11ec-8c35-001a4aab830c/ceph-mon.smithi153.log: file size changed while zipping
2022-03-13T13:37:57.117 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/4ef39ec8-a29d-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-03-13T13:38:00.861 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/4ef39ec8-a29d-11ec-8c35-001a4aab830c/ceph-mon.smithi201.log: file size changed while zipping
2022-03-13T13:38:00.944 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/4ef39ec8-a29d-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-03-13T13:38:03.338 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/4ef39ec8-a29d-11ec-8c35-001a4aab830c/ceph-mgr.smithi153.mzcpea.log: file size changed while zipping
2022-03-13T13:38:14.769 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/4ef39ec8-a29d-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-03-13T13:38:21.528 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/4ef39ec8-a29d-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-03-13T13:38:30.296 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /var/log/ceph/4ef39ec8-a29d-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-03-13T13:38:37.908 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/4ef39ec8-a29d-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-03-13T13:39:08.094 INFO:teuthology.orchestra.run.smithi201.stderr:tar: .: file changed as we read it
2022-03-13T13:39:08.170 INFO:teuthology.kill:No teuthology processes running
2022-03-13T13:39:09.612 INFO:teuthology.kill:Nuking machines: ['smithi153', 'smithi201']
2022-03-13T13:39:10.656 INFO:teuthology.kill:2022-03-13 13:39:10,655.655 INFO:teuthology.nuke:targets:
2022-03-13T13:39:10.657 INFO:teuthology.kill:  smithi153.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCU1q3GVA9stCnhtXi3CY40GMLzLk6BoJh8Ud9l5nTGsPJTl+xgNGP5a76mVcH1/S/1phvXaazksAmxJRhTmFof/cifupbCbqtkFfZv+b4ggx/LKxO/Yg2w8n684j7UbmWIH02OkiFWIWNo6XqmtDHHxuGd7MXP1qGcpyB/2Wvo8FFPbS/0O7zxDBRzcLpnjgBVkFWhFHJeVAduB5B6/UG8JQ4RxJ1lsrHV1DJFbq9xuPplaGTjjptqN+8tE3+yrOY+187eIYJnJvr+8OPAQqy+Ov2FyGjt/q7CskwuUefFVp7WyeFqmWiEMlqO19QmSeGW42D1Q1Ag/QWnWw3VziUSDheLSdaBcaK+aU4YQ6sTctxHfrBmBWBkocEqhfifmxKEj+RuA4wcn+bf9oAfrRGq6M7LitbcMgZGFFDn1X05mlJ7gY5Jb0y7fZsWntVz5MKCfkuHH75B3AtEYKP3xux83k+mlYOhpcXXoQ/gxcIwRELLVvKsS4+ksbL9xfHUJU=
2022-03-13T13:39:10.657 INFO:teuthology.kill:  smithi201.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzirmvyoPBTI67dgr8JuVUqqt12vFxPkOguifnYx4O12HCNTN6QYrshjoVjcNXlGXTZ/mAzAlMeZBEbYXpQAOyzGKrL0Ny1YMsKHSb42wyhVYht1AHBA0z4xBkY/FDs/Ml9tuXOV1ChoNLYum96f+B4UCfSBsatdBiUAFqpGUNt1vHxl8/YRFauW5whpx9U9wMFpHvxej13G8492AErGxo4hfNcVFtSMY73V1bx2yZjCrUoZqOi7kR8VMcxbq4kSlRg7wD6WGoG89CxUfaLX9BZthg+01TkAOr7lQ/iX5SVvnqrZ/AsYOX7KxxEKnZBJK21oCkZuETiJrpY/LxgrXgUQS6aonTA7YcjI/gpOkwBJq8nIGZ4EcD+7POpdOkEBQrqsstN24DhZiJPSqfBGOMvvf8/l1uWg2r7MeMZDOLXRBmOvt9f5VCA7TaNxRcwpd6Gca8gKRlcThhFPNOhfys/5BSBxdUPkCt15G1h2akwQddkldqLqjIzE05F/M/PoE=
2022-03-13T13:39:10.694 INFO:teuthology.kill:2022-03-13 13:39:10,691.691 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-13T13:39:10.696 INFO:teuthology.kill:2022-03-13 13:39:10,695.695 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-13T13:39:10.777 INFO:teuthology.kill:2022-03-13 13:39:10,777.777 INFO:teuthology.orchestra.console:Power off smithi201
2022-03-13T13:39:10.793 INFO:teuthology.kill:2022-03-13 13:39:10,792.792 INFO:teuthology.orchestra.console:Power off smithi153
2022-03-13T13:39:19.153 INFO:teuthology.kill:2022-03-13 13:39:19,153.153 INFO:teuthology.orchestra.console:Power off for smithi201 completed
2022-03-13T13:39:19.160 INFO:teuthology.kill:2022-03-13 13:39:19,160.160 INFO:teuthology.orchestra.console:Power off for smithi153 completed
2022-03-13T13:39:19.299 INFO:teuthology.kill:2022-03-13 13:39:19,299.299 INFO:teuthology.lock.ops:unlocked: smithi201.front.sepia.ceph.com
2022-03-13T13:39:19.302 INFO:teuthology.kill:2022-03-13 13:39:19,302.302 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com
2022-03-13T13:41:19.626 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15