2022-01-08T01:54:28.142 INFO:root:teuthology version: 1.1.0-95a7d479
2022-01-08T01:54:28.265 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging
2022-01-08T01:54:28.266 INFO:teuthology.lock.ops:Updating [ubuntu@smithi029.front.sepia.ceph.com]: reset os type and version on server
2022-01-08T01:54:28.266 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2022-01-08T01:54:28.284 INFO:teuthology.lock.ops:Node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging is complete
2022-01-08T01:54:28.285 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi115.front.sepia.ceph.com' reimaging
2022-01-08T01:54:28.286 INFO:teuthology.lock.ops:Updating [ubuntu@smithi115.front.sepia.ceph.com]: reset os type and version on server
2022-01-08T01:54:28.286 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2022-01-08T01:54:28.309 INFO:teuthology.lock.ops:Node 'ubuntu@smithi115.front.sepia.ceph.com' reimaging is complete
2022-01-08T01:54:28.515 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 8.stream
2022-01-08T01:54:28.531 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 8.stream
2022-01-08T01:54:28.828 INFO:teuthology.orchestra.console:Power off smithi029
2022-01-08T01:54:28.843 INFO:teuthology.orchestra.console:Power off smithi115
2022-01-08T01:54:37.200 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2022-01-08T01:54:37.302 INFO:teuthology.orchestra.console:Power on smithi029
2022-01-08T01:54:41.316 INFO:teuthology.orchestra.console:Power off for smithi115 completed
2022-01-08T01:54:41.417 INFO:teuthology.orchestra.console:Power on smithi115
2022-01-08T01:54:45.665 INFO:teuthology.orchestra.console:Power on for smithi029 completed
2022-01-08T01:54:45.670 INFO:teuthology.orchestra.console:Power on for smithi115 completed
2022-01-08T01:54:45.767 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2022-01-08T01:54:45.771 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish
2022-01-08T01:59:50.702 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-08T01:59:50.711 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-08T01:59:51.002 INFO:teuthology.provision.fog.smithi115:Node is ready
2022-01-08T01:59:51.018 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115
2022-01-08T01:59:51.075 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115
2022-01-08T01:59:51.079 INFO:teuthology.provision.fog.smithi029:Node is ready
2022-01-08T01:59:51.096 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2022-01-08T01:59:51.155 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2022-01-08T01:59:51.404 INFO:teuthology.provision.fog.smithi115:Deploy complete!
2022-01-08T01:59:51.506 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2022-01-08T01:59:51.653 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2022-01-08T01:59:51.654 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-08T01:59:51.681 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com
2022-01-08T01:59:51.682 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-08T01:59:51.699 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2022-01-08T01:59:51.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2022-01-08T01:59:51.894 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2022-01-08T01:59:51.951 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream"
2022-01-08T01:59:51.952 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8"
2022-01-08T01:59:51.952 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos"
2022-01-08T01:59:51.953 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora"
2022-01-08T01:59:51.955 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8"
2022-01-08T01:59:51.955 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8"
2022-01-08T01:59:51.956 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-08T01:59:51.956 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2022-01-08T01:59:51.956 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-08T01:59:51.956 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/"
2022-01-08T01:59:51.957 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-08T01:59:51.957 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-08T01:59:51.957 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-08T01:59:51.959 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2022-01-08T01:59:51.978 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server
2022-01-08T01:59:51.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com'
2022-01-08T01:59:52.168 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64
2022-01-08T01:59:52.225 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream"
2022-01-08T01:59:52.226 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8"
2022-01-08T01:59:52.226 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2022-01-08T01:59:52.226 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2022-01-08T01:59:52.227 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8"
2022-01-08T01:59:52.228 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8"
2022-01-08T01:59:52.228 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-08T01:59:52.228 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2022-01-08T01:59:52.229 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-08T01:59:52.229 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/"
2022-01-08T01:59:52.230 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-08T01:59:52.230 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-08T01:59:52.230 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-08T01:59:52.231 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2022-01-08T01:59:52.329 INFO:teuthology.dispatcher.supervisor:Running job 6601798
2022-01-08T01:59:52.330 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-07_20:51:42-rados-wip-yuri-testing-2022-01-07-0928-pacific-distro-default-smithi/6601798 --name yuriw-2022-01-07_20:51:42-rados-wip-yuri-testing-2022-01-07-0928-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2022-01-07_20:51:42-rados-wip-yuri-testing-2022-01-07-0928-pacific-distro-default-smithi/6601798/orig.config.yaml
2022-01-08T01:59:52.334 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-07_20:51:42-rados-wip-yuri-testing-2022-01-07-0928-pacific-distro-default-smithi/6601798
2022-01-08T01:59:52.335 INFO:teuthology.dispatcher.supervisor:Job PID: 17234
2022-01-08T01:59:52.335 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-08T14:00:47.672 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-01-08T14:00:47.869 INFO:teuthology.kill:Killing Pids: {17234}
2022-01-08T14:00:49.057 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-08T14:00:49.058 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-08T14:00:49.059 INFO:teuthology.misc:Compressing logs...
2022-01-08T14:00:49.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2022-01-08T14:00:49.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com'
2022-01-08T14:00:49.306 INFO:teuthology.orchestra.run.smithi029.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-08T14:00:49.487 INFO:teuthology.orchestra.run.smithi115.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-08T14:00:49.570 INFO:teuthology.orchestra.run.smithi029.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-08T14:00:49.571 INFO:teuthology.orchestra.run.smithi029.stderr:tar: Error is not recoverable: exiting now
2022-01-08T14:00:49.606 INFO:teuthology.orchestra.run.smithi115.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-08T14:00:49.606 INFO:teuthology.orchestra.run.smithi115.stderr:tar: Error is not recoverable: exiting now
2022-01-08T14:00:49.608 INFO:teuthology.misc:Compressing logs...
2022-01-08T14:00:50.025 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-08T14:00:50.237 INFO:teuthology.misc:Compressing logs...
2022-01-08T14:01:21.151 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/e08937ce-7027-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-08T14:01:21.346 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/e08937ce-7027-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-08T14:01:46.364 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/e08937ce-7027-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-08T14:01:46.388 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/e08937ce-7027-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-08T14:01:52.591 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/e08937ce-7027-11ec-8c32-001a4aab830c/ceph-mon.smithi115.log: file size changed while zipping
2022-01-08T14:02:04.732 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/e08937ce-7027-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-08T14:02:18.147 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/e08937ce-7027-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-08T14:02:27.662 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/e08937ce-7027-11ec-8c32-001a4aab830c/ceph-mon.smithi029.log: file size changed while zipping
2022-01-08T14:02:40.316 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/e08937ce-7027-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-08T14:02:57.396 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/e08937ce-7027-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-08T14:03:06.927 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/e08937ce-7027-11ec-8c32-001a4aab830c/ceph-mgr.smithi029.mrpthn.log: file size changed while zipping
2022-01-08T14:03:58.104 INFO:teuthology.orchestra.run.smithi115.stderr:tar: .: file changed as we read it
2022-01-08T14:03:58.175 INFO:teuthology.kill:No teuthology processes running
2022-01-08T14:03:59.436 INFO:teuthology.kill:Nuking machines: ['smithi029', 'smithi115']
2022-01-08T14:04:00.452 INFO:teuthology.kill:2022-01-08 14:04:00,450.450 INFO:teuthology.nuke:targets:
2022-01-08T14:04:00.454 INFO:teuthology.kill:  smithi029.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDY4fqgNMErdP6Ej9z1JIQY+fYOyvP6q6xcfO2HvncgDZwr1ROeX5JbHrOIky3+IvrGE8sD/8Y7VNQVZpoATWfJLBB+OqBI03GnnUA6W3GCvMtYmCkMrIW376cO0HGFJghHzTzUJ6gO8ay+MbVzaDrdYMhobyLxkbYTtwahI4Rpz1vFURXdCHyIEaTzm8r2lt1YKoxJMSoDVfUYOV40PPxEOoqoh92ibqOARZAeFIIBn5vhmcuWXeNmTiyTC0ZYCzOKQL5ZBiKp9lEySVtIfS3oyRg/ahA6bHwqe3mIw48B8aJLJMln1r4CpE+6lQW5H/GB+MMBvoEJGu7H6ocfYvD2PV9JlOfr8uppqeHaQNzIg/NmL+Dqm4dHhMRpDi3t87FQpCJAZTc4Y2xJ0BVyAS9u31ZdbJsQy0EeBFPLD5phRQKlrZVAGoI6+kgn0eEfD/sjxYAYdPIXW0uy5S00mZU96Q6L6R8VqhchOWGQp3eR9LUDXi9atbNjLCVFC9PB/7U=
2022-01-08T14:04:00.455 INFO:teuthology.kill:  smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLqTGAuSNlAoeUjIYMh2TF9WZ+802c59tdbxXuCm56QoA2GMo+vkG7jBcgu1g5DjBXxOiZRi2jJzKcmSAmp4XQlXtnZBFY8xkwyJLIhz867xhZYyGpNRN4k1SRY0WTvpdILTZQS0gyB+LiOu4nlWpJtz5RARFOBJtFrRpM6ekB/WYLFNC6QptOYrAl0/TtwZwuXL+NU7Z2ZqbEy+EL4mUT5yGIkvjwIueAZPVYCu//BAqALt2sJ7nvj4pNXvBW5LhtiLGTaQECqbFT6pQi86o2l8C6ffsTf9ybvrCHbn/0YzikdVDHISXWPvl9IaLJ9JB04vDIiC7fDkqW0BM4cmC9NjT2fSOs5OkPce2fcqd7yao/11rLxJVVajTzw5AZLCrxW2gjDvsn1j15CgymkTPo94vMavUWghyWxTmwIxgdM7X4Ia6iyk96TqwJRD02tqsbvWKI4uha+ywGKjPLtnhnvAthmyGcahSyfua18QZNodLgyDGMjLEvmP/WF7APW4E=
2022-01-08T14:04:00.483 INFO:teuthology.kill:2022-01-08 14:04:00,483.483 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-08T14:04:00.487 INFO:teuthology.kill:2022-01-08 14:04:00,487.487 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-08T14:04:00.580 INFO:teuthology.kill:2022-01-08 14:04:00,580.580 INFO:teuthology.orchestra.console:Power off smithi115
2022-01-08T14:04:00.595 INFO:teuthology.kill:2022-01-08 14:04:00,595.595 INFO:teuthology.orchestra.console:Power off smithi029
2022-01-08T14:04:09.006 INFO:teuthology.kill:2022-01-08 14:04:09,006.006 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2022-01-08T14:04:09.072 INFO:teuthology.kill:2022-01-08 14:04:09,072.072 INFO:teuthology.orchestra.console:Power off for smithi115 completed
2022-01-08T14:04:09.160 INFO:teuthology.kill:2022-01-08 14:04:09,159.159 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com
2022-01-08T14:04:09.218 INFO:teuthology.kill:2022-01-08 14:04:09,217.217 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com
2022-01-08T14:06:09.536 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-08T14:06:09.632 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi029 but it was locked by another job: /home/teuthworker/archive/dis-2022-01-08_10:51:32-rbd-wip-dis-testing-distro-default-smithi/6602361
2022-01-08T14:06:09.632 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi115 but it was locked by another job: /home/teuthworker/archive/dis-2022-01-08_10:51:32-rbd-wip-dis-testing-distro-default-smithi/6602361