2022-01-25T16:03:13.708 INFO:root:teuthology version: 1.1.0-7c0cb867
2022-01-25T16:03:13.832 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi005.front.sepia.ceph.com' reimaging
2022-01-25T16:03:13.833 INFO:teuthology.lock.ops:Updating [ubuntu@smithi005.front.sepia.ceph.com]: reset os type and version on server
2022-01-25T16:03:13.834 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server
2022-01-25T16:03:13.853 INFO:teuthology.lock.ops:Node 'ubuntu@smithi005.front.sepia.ceph.com' reimaging is complete
2022-01-25T16:03:13.854 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi041.front.sepia.ceph.com' reimaging
2022-01-25T16:03:13.854 INFO:teuthology.lock.ops:Updating [ubuntu@smithi041.front.sepia.ceph.com]: reset os type and version on server
2022-01-25T16:03:13.855 INFO:teuthology.lock.ops:Updating smithi041.front.sepia.ceph.com on lock server
2022-01-25T16:03:13.880 INFO:teuthology.lock.ops:Node 'ubuntu@smithi041.front.sepia.ceph.com' reimaging is complete
2022-01-25T16:03:14.114 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of centos 8.3
2022-01-25T16:03:14.120 INFO:teuthology.provision.fog.smithi041:Scheduling deploy of centos 8.3
2022-01-25T16:03:14.454 INFO:teuthology.orchestra.console:Power off smithi005
2022-01-25T16:03:14.471 INFO:teuthology.orchestra.console:Power off smithi041
2022-01-25T16:03:22.842 INFO:teuthology.orchestra.console:Power off for smithi005 completed
2022-01-25T16:03:22.943 INFO:teuthology.orchestra.console:Power on smithi005
2022-01-25T16:03:26.966 INFO:teuthology.orchestra.console:Power off for smithi041 completed
2022-01-25T16:03:27.067 INFO:teuthology.orchestra.console:Power on smithi041
2022-01-25T16:03:31.329 INFO:teuthology.orchestra.console:Power on for smithi041 completed
2022-01-25T16:03:31.386 INFO:teuthology.orchestra.console:Power on for smithi005 completed
2022-01-25T16:03:31.431 INFO:teuthology.provision.fog.smithi041:Waiting for deploy to finish
2022-01-25T16:03:31.487 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish
2022-01-25T16:07:39.090 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-25T16:07:39.394 INFO:teuthology.provision.fog.smithi005:Node is ready
2022-01-25T16:07:39.453 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com
2022-01-25T16:07:39.510 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005
2022-01-25T16:07:39.840 INFO:teuthology.provision.fog.smithi005:Deploy complete!
2022-01-25T16:07:48.115 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-25T16:07:48.405 INFO:teuthology.provision.fog.smithi041:Node is ready
2022-01-25T16:07:48.421 INFO:teuthology.orchestra.run.smithi041.stdout:smithi041.front.sepia.ceph.com
2022-01-25T16:07:48.477 INFO:teuthology.orchestra.run.smithi041.stdout:172.21.15.41 smithi041.front.sepia.ceph.com smithi041
2022-01-25T16:07:48.818 INFO:teuthology.provision.fog.smithi041:Deploy complete!
2022-01-25T16:07:48.966 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com
2022-01-25T16:07:48.967 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-25T16:07:48.990 INFO:teuthology.lock.ops:Checking smithi041.front.sepia.ceph.com
2022-01-25T16:07:48.990 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-25T16:07:49.008 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server
2022-01-25T16:07:49.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com'
2022-01-25T16:07:49.280 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64
2022-01-25T16:07:49.335 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Linux"
2022-01-25T16:07:49.335 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8"
2022-01-25T16:07:49.336 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos"
2022-01-25T16:07:49.336 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora"
2022-01-25T16:07:49.336 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8"
2022-01-25T16:07:49.336 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8"
2022-01-25T16:07:49.337 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Linux 8"
2022-01-25T16:07:49.337 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31"
2022-01-25T16:07:49.337 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-25T16:07:49.337 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/"
2022-01-25T16:07:49.338 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2022-01-25T16:07:49.338 INFO:teuthology.orchestra.run.smithi005.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2022-01-25T16:07:49.338 INFO:teuthology.orchestra.run.smithi005.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2022-01-25T16:07:49.339 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server
2022-01-25T16:07:49.357 INFO:teuthology.lock.ops:Updating [smithi041.front.sepia.ceph.com]: set os type and version on server
2022-01-25T16:07:49.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi041.front.sepia.ceph.com'
2022-01-25T16:07:49.620 INFO:teuthology.orchestra.run.smithi041.stdout:x86_64
2022-01-25T16:07:49.675 INFO:teuthology.orchestra.run.smithi041.stdout:NAME="CentOS Linux"
2022-01-25T16:07:49.675 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION="8"
2022-01-25T16:07:49.676 INFO:teuthology.orchestra.run.smithi041.stdout:ID="centos"
2022-01-25T16:07:49.676 INFO:teuthology.orchestra.run.smithi041.stdout:ID_LIKE="rhel fedora"
2022-01-25T16:07:49.676 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION_ID="8"
2022-01-25T16:07:49.676 INFO:teuthology.orchestra.run.smithi041.stdout:PLATFORM_ID="platform:el8"
2022-01-25T16:07:49.676 INFO:teuthology.orchestra.run.smithi041.stdout:PRETTY_NAME="CentOS Linux 8"
2022-01-25T16:07:49.677 INFO:teuthology.orchestra.run.smithi041.stdout:ANSI_COLOR="0;31"
2022-01-25T16:07:49.677 INFO:teuthology.orchestra.run.smithi041.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-25T16:07:49.677 INFO:teuthology.orchestra.run.smithi041.stdout:HOME_URL="https://centos.org/"
2022-01-25T16:07:49.677 INFO:teuthology.orchestra.run.smithi041.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2022-01-25T16:07:49.678 INFO:teuthology.orchestra.run.smithi041.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2022-01-25T16:07:49.678 INFO:teuthology.orchestra.run.smithi041.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2022-01-25T16:07:49.679 INFO:teuthology.lock.ops:Updating smithi041.front.sepia.ceph.com on lock server
2022-01-25T16:07:49.776 INFO:teuthology.dispatcher.supervisor:Running job 6639991
2022-01-25T16:07:49.777 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-25_15:47:07-rados-wip-yuri4-testing-2022-01-24-1706-pacific-distro-default-smithi/6639991 --name yuriw-2022-01-25_15:47:07-rados-wip-yuri4-testing-2022-01-24-1706-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2022-01-25_15:47:07-rados-wip-yuri4-testing-2022-01-24-1706-pacific-distro-default-smithi/6639991/orig.config.yaml
2022-01-25T16:07:49.781 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-25_15:47:07-rados-wip-yuri4-testing-2022-01-24-1706-pacific-distro-default-smithi/6639991
2022-01-25T16:07:49.782 INFO:teuthology.dispatcher.supervisor:Job PID: 9939
2022-01-25T16:07:49.782 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-25T22:38:18.939 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-25T22:38:19.118 INFO:teuthology.kill:Killing Pids: {9939}
2022-01-25T22:38:20.300 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-25T22:38:20.301 INFO:teuthology.task.internal:roles: ubuntu@smithi041.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-25T22:38:20.302 INFO:teuthology.misc:Compressing logs...
2022-01-25T22:38:20.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com'
2022-01-25T22:38:20.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi041.front.sepia.ceph.com'
2022-01-25T22:38:20.565 INFO:teuthology.orchestra.run.smithi005.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-25T22:38:20.776 INFO:teuthology.orchestra.run.smithi041.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-25T22:38:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-25T22:38:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:tar: Error is not recoverable: exiting now
2022-01-25T22:38:20.866 INFO:teuthology.orchestra.run.smithi041.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-25T22:38:20.867 INFO:teuthology.orchestra.run.smithi041.stderr:tar: Error is not recoverable: exiting now
2022-01-25T22:38:20.868 INFO:teuthology.misc:Compressing logs...
2022-01-25T22:38:21.107 INFO:teuthology.misc:Compressing logs...
2022-01-25T22:38:25.761 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/cde30b54-7dfb-11ec-8c35-001a4aab830c/ceph-mgr.smithi005.fdgtye.log: file size changed while zipping
2022-01-25T22:38:49.756 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/cde30b54-7dfb-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-25T22:38:50.360 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/cde30b54-7dfb-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-25T22:38:53.248 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/cde30b54-7dfb-11ec-8c35-001a4aab830c/ceph-mon.smithi041.log: file size changed while zipping
2022-01-25T22:39:01.944 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/cde30b54-7dfb-11ec-8c35-001a4aab830c/ceph-mon.smithi005.log: file size changed while zipping
2022-01-25T22:39:17.889 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/cde30b54-7dfb-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-25T22:39:23.052 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/cde30b54-7dfb-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-25T22:39:37.872 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/cde30b54-7dfb-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-25T22:39:38.583 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/cde30b54-7dfb-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-25T22:39:59.165 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/cde30b54-7dfb-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-25T22:40:02.179 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/cde30b54-7dfb-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-25T22:40:41.411 INFO:teuthology.kill:No teuthology processes running
2022-01-25T22:40:42.506 INFO:teuthology.kill:Nuking machines: ['smithi005', 'smithi041']
2022-01-25T22:40:43.445 INFO:teuthology.kill:2022-01-25 22:40:43,445.445 INFO:teuthology.nuke:targets:
2022-01-25T22:40:43.446 INFO:teuthology.kill:  smithi005.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCSGSamUi0PMNrRPncTCt3EwhFPFOvVChjwcOO7Hgg7XvMqrg7AyCxYz2zL6mS0QjDpycWEDd3oX386MzE4OYvLRYHfBf9aj65cFVWJHQG4JNhABnE7VefNzQEZIAYABbL72uZl1owO91pu344832id1Gp1GFskbL9fFsOqsGoTYNH3TQC+b7jALQIBHsZD+qQWLQbSPEHv2wpaKWOWZg+LiSJIE2OxzYdaMUWr+cT4CHdUl788qNWNa2Uh1Y1gn6NVEaFf2BRBEobqWAlNC5d20TbnM7rfc7s5jYMXtg9MMuit84CqRTviiTQxNZ7tQJKrHFin7Y2YrTJFZlno3dT1myFjh1MN1ia4tlHWIhfbnraVzeXVhrsK7hzfxiTZz1IUEGF0SkrfK1euDnoxmXBBu5VDWmACJo5GrXTM2WlL8roxAK8nEf8fBJc1vIG6YZjIYEg1JrNmEXjbEQpvWez7j7lJ5OcGrMiaftxDDiPLUeyWrHoMzoRFKO9AM8uWeIs=
2022-01-25T22:40:43.446 INFO:teuthology.kill:  smithi041.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwDVIR09Rb/PJ6GKa6SxjjFeBzmSDAV4UIoj3Jia3RhgpWtmuTuV0JHmzOOKSmcOo9hFlG55p16gPDczwnN3yvRCHjK3DYM+GTinniH6vxpqW7R5O7OqAw9/lxsDkXyHF5Ndkv/5i0kyvxHUaMoY6t1+GTf4TnGZXJtHp/gd1PhitildCj+ceg6KB3o2adKbVAVL9qKvx8vqI/JxQS2JKew5uA+uwc7LyZUnOKZqyE6hm4IweIewgrCztlTaTI8PkfFYGlGIPNb8cf79bgOavJYOClGqN/SqFx0jApwJ13FjGuQda2nKBuSq+5YtCIY990n8KpJOelNXwR8KOek0jwv132xTYf5IAY9bdu1uI/OsyH3NXKxII6tRFLRJy22Q2y9yyp1YcN/C3qiiB8i13QWTgJifbnNK1ElusiDburkrLp3Hl423kXQG64IB/uS8kLUizHtNCC8tachYkc98TB1LEXQpIQuCC5Bc1Pn1rlcoXj6RekArKXEHkXeF80Hhs=
2022-01-25T22:40:43.471 INFO:teuthology.kill:2022-01-25 22:40:43,471.471 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-25T22:40:43.474 INFO:teuthology.kill:2022-01-25 22:40:43,474.474 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-25T22:40:43.551 INFO:teuthology.kill:2022-01-25 22:40:43,551.551 INFO:teuthology.orchestra.console:Power off smithi041
2022-01-25T22:40:43.565 INFO:teuthology.kill:2022-01-25 22:40:43,565.565 INFO:teuthology.orchestra.console:Power off smithi005
2022-01-25T22:40:56.033 INFO:teuthology.kill:2022-01-25 22:40:56,033.033 INFO:teuthology.orchestra.console:Power off for smithi041 completed
2022-01-25T22:40:56.040 INFO:teuthology.kill:2022-01-25 22:40:56,040.040 INFO:teuthology.orchestra.console:Power off for smithi005 completed
2022-01-25T22:40:56.182 INFO:teuthology.kill:2022-01-25 22:40:56,181.181 INFO:teuthology.lock.ops:unlocked: smithi041.front.sepia.ceph.com
2022-01-25T22:40:56.186 INFO:teuthology.kill:2022-01-25 22:40:56,185.185 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com
2022-01-25T22:42:56.498 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-25T22:42:56.601 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi005 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-24_05:05:03-rgw-octopus-distro-default-smithi/6637434
2022-01-25T22:42:56.601 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi041 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-24_05:05:03-rgw-octopus-distro-default-smithi/6637434