2022-01-17T14:27:08.954 INFO:root:teuthology version: 1.1.0-3ff86a5d
2022-01-17T14:27:09.069 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging
2022-01-17T14:27:09.070 INFO:teuthology.lock.ops:Updating [ubuntu@smithi002.front.sepia.ceph.com]: reset os type and version on server
2022-01-17T14:27:09.071 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2022-01-17T14:27:09.090 INFO:teuthology.lock.ops:Node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging is complete
2022-01-17T14:27:09.091 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi099.front.sepia.ceph.com' reimaging
2022-01-17T14:27:09.091 INFO:teuthology.lock.ops:Updating [ubuntu@smithi099.front.sepia.ceph.com]: reset os type and version on server
2022-01-17T14:27:09.091 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2022-01-17T14:27:09.110 INFO:teuthology.lock.ops:Node 'ubuntu@smithi099.front.sepia.ceph.com' reimaging is complete
2022-01-17T14:27:09.316 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 8.stream
2022-01-17T14:27:09.319 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream
2022-01-17T14:27:09.668 INFO:teuthology.orchestra.console:Power off smithi002
2022-01-17T14:27:09.754 INFO:teuthology.orchestra.console:Power off smithi099
2022-01-17T14:27:18.037 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2022-01-17T14:27:18.113 INFO:teuthology.orchestra.console:Power off for smithi099 completed
2022-01-17T14:27:18.139 INFO:teuthology.orchestra.console:Power on smithi002
2022-01-17T14:27:18.214 INFO:teuthology.orchestra.console:Power on smithi099
2022-01-17T14:27:26.505 INFO:teuthology.orchestra.console:Power on for smithi002 completed
2022-01-17T14:27:26.576 INFO:teuthology.orchestra.console:Power on for smithi099 completed
2022-01-17T14:27:26.607 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2022-01-17T14:27:26.677 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2022-01-17T14:32:01.945 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-17T14:32:02.203 INFO:teuthology.provision.fog.smithi002:Node is ready
2022-01-17T14:32:02.220 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com
2022-01-17T14:32:02.279 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002
2022-01-17T14:32:02.621 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2022-01-17T14:32:16.740 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-17T14:32:16.991 INFO:teuthology.provision.fog.smithi099:Node is ready
2022-01-17T14:32:17.008 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2022-01-17T14:32:17.065 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2022-01-17T14:32:17.417 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2022-01-17T14:32:17.566 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2022-01-17T14:32:17.567 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-17T14:32:17.586 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2022-01-17T14:32:17.586 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-17T14:32:17.605 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2022-01-17T14:32:17.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2022-01-17T14:32:17.854 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2022-01-17T14:32:17.911 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2022-01-17T14:32:17.912 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8"
2022-01-17T14:32:17.912 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2022-01-17T14:32:17.912 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2022-01-17T14:32:17.912 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8"
2022-01-17T14:32:17.913 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8"
2022-01-17T14:32:17.913 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-17T14:32:17.913 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2022-01-17T14:32:17.913 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-17T14:32:17.914 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2022-01-17T14:32:17.914 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-17T14:32:17.914 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-17T14:32:17.914 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-17T14:32:17.916 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2022-01-17T14:32:17.940 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2022-01-17T14:32:17.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2022-01-17T14:32:18.130 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2022-01-17T14:32:18.186 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2022-01-17T14:32:18.186 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8"
2022-01-17T14:32:18.187 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2022-01-17T14:32:18.187 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2022-01-17T14:32:18.187 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8"
2022-01-17T14:32:18.187 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2022-01-17T14:32:18.188 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-17T14:32:18.188 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2022-01-17T14:32:18.188 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-17T14:32:18.188 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2022-01-17T14:32:18.188 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-17T14:32:18.189 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-17T14:32:18.189 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-17T14:32:18.189 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2022-01-17T14:32:18.279 INFO:teuthology.dispatcher.supervisor:Running job 6622247
2022-01-17T14:32:18.280 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_swagner@teuthology --archive /home/teuthworker/archive/swagner-2022-01-17_13:39:37-rados:cephadm-wip-swagner2-testing-2022-01-17-1019-pacific-distro-default-smithi/6622247 --name swagner-2022-01-17_13:39:37-rados:cephadm-wip-swagner2-testing-2022-01-17-1019-pacific-distro-default-smithi --description rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/swagner-2022-01-17_13:39:37-rados:cephadm-wip-swagner2-testing-2022-01-17-1019-pacific-distro-default-smithi/6622247/orig.config.yaml
2022-01-17T14:32:18.283 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/swagner-2022-01-17_13:39:37-rados:cephadm-wip-swagner2-testing-2022-01-17-1019-pacific-distro-default-smithi/6622247
2022-01-17T14:32:18.284 INFO:teuthology.dispatcher.supervisor:Job PID: 5343
2022-01-17T14:32:18.284 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-17T21:02:46.869 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-17T21:02:47.029 INFO:teuthology.kill:Killing Pids: {5343}
2022-01-17T21:02:48.114 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-17T21:02:48.115 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-17T21:02:48.116 INFO:teuthology.misc:Compressing logs...
2022-01-17T21:02:48.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2022-01-17T21:02:48.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2022-01-17T21:02:48.357 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-17T21:02:48.526 INFO:teuthology.orchestra.run.smithi099.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-17T21:02:48.565 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-17T21:02:48.566 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now
2022-01-17T21:02:48.603 INFO:teuthology.orchestra.run.smithi099.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-17T21:02:48.604 INFO:teuthology.orchestra.run.smithi099.stderr:tar: Error is not recoverable: exiting now
2022-01-17T21:02:48.605 INFO:teuthology.misc:Compressing logs...
2022-01-17T21:02:48.805 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-17T21:02:48.862 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-17T21:02:49.014 INFO:teuthology.misc:Compressing logs...
2022-01-17T21:02:52.431 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/74dd2b9c-77a3-11ec-8c34-001a4aab830c/ceph-mon.smithi099.log: file size changed while zipping
2022-01-17T21:03:01.592 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/74dd2b9c-77a3-11ec-8c34-001a4aab830c/ceph-mon.smithi002.log: file size changed while zipping
2022-01-17T21:03:12.516 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/74dd2b9c-77a3-11ec-8c34-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-17T21:03:21.567 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/74dd2b9c-77a3-11ec-8c34-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-17T21:03:26.782 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/74dd2b9c-77a3-11ec-8c34-001a4aab830c/ceph-mgr.smithi002.pzapmm.log: file size changed while zipping
2022-01-17T21:03:29.146 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/74dd2b9c-77a3-11ec-8c34-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-17T21:03:43.444 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/74dd2b9c-77a3-11ec-8c34-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-17T21:03:44.971 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/74dd2b9c-77a3-11ec-8c34-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-17T21:03:55.192 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/74dd2b9c-77a3-11ec-8c34-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-17T21:03:59.148 INFO:teuthology.orchestra.run.smithi099.stderr:gzip: /var/log/ceph/74dd2b9c-77a3-11ec-8c34-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-17T21:04:14.054 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/74dd2b9c-77a3-11ec-8c34-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-17T21:04:31.647 INFO:teuthology.orchestra.run.smithi002.stderr:tar: .: file changed as we read it
2022-01-17T21:04:46.101 INFO:teuthology.kill:No teuthology processes running
2022-01-17T21:04:47.146 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi099']
2022-01-17T21:04:48.027 INFO:teuthology.kill:2022-01-17 21:04:48,027.027 INFO:teuthology.nuke:targets:
2022-01-17T21:04:48.028 INFO:teuthology.kill:  smithi002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGNOqWc5DVQgu5uhXtKQFcQiKyeshYvuwWX5o8tRs91dl98daqowKjy8xZuolleaoz9PCc2nUC3i9PquPaAbDnsZnlI0ZrPO7D7zBJ0vEz3aQZjXgmVyvzMacy+sFAfiDu2rOzp3GhMOeDCKtT4To3nW/jcCzFHqTjvURJQ5Wh+NoSzatHK/0Xz3JoMBA8zm5TPHxKAAmQxRKiNj13d/ByG1/QV3n31IwDfTAPxAAci9EbPgGbu03xBZEgoJRxjVUdhvE1QnsyD/3DgmBIyTxBAzS0RPQ9Tv0+/dwsW+vVjCAD031CO4eVDfUaJKiA2ZgBYh0xLRGZYPBMYA53maBEy1zxnlO2kzEW/klqj8hV1qGG3kkncywJfBUDNnNCg7otT4zzUjahDGDpeSWfiPyrkDwwtfG5zvePO8L/xz3gc7BRQs0M9LSgSN+jbuRX63jDP6qJjGdtvktHoCd7R+uWTPIy95EUUEXg4UFEL84bdvH1HDoEqxrqLGbg1ZMl8Ds=
2022-01-17T21:04:48.028 INFO:teuthology.kill:  smithi099.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhXuCkvRK0Aw2eHdWWQiSD2cnmgrlqHMup7wr8xzU+Lc1HSQBagm5Qdpg2OZLtmnKCBZo3+BT2vrxbHxC3WW75v2cC5xoPnafVLKdYgCBzw/fxnRc/2V6/ECAnVAGeVcxYr2WYvEvOJRyiTwjAukbU+ERYDIuunozXP3QL7u+rPyK786UDrmeUFOi692ajPViEBqyf4z1mUSdXWhmtdBrvnsKxjiNmS6mP0tUrZ3C1C6Hniwh2apKeCZLfwUDWU/ttEAijDYEH+L8Nd0uiTtv7CQevwt6K7axT8MIssDQpv3kI81vTYXGMeRh83PDvGgWdEtkGOsuzfMNCezMD1IGxcxgOVgU9xdVrzr+qPMzi+MusNcw1eTrLgtX9h+TLY2ieoC3VYlKtURvOXNCWSwF0wCtV9L/DJa4e3gbZBsqa27uQNzz3DUZZm2IoYaoxLrfdn9qtKCQFAK8m00VZauz5dCtDsfhCBW0OTczmi7HUznhET4VWqYvIakTq0OOlOVs=
2022-01-17T21:04:48.053 INFO:teuthology.kill:2022-01-17 21:04:48,052.052 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-17T21:04:48.055 INFO:teuthology.kill:2022-01-17 21:04:48,055.055 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-17T21:04:48.125 INFO:teuthology.kill:2022-01-17 21:04:48,125.125 INFO:teuthology.orchestra.console:Power off smithi099
2022-01-17T21:04:48.137 INFO:teuthology.kill:2022-01-17 21:04:48,137.137 INFO:teuthology.orchestra.console:Power off smithi002
2022-01-17T21:04:56.495 INFO:teuthology.kill:2022-01-17 21:04:56,494.494 INFO:teuthology.orchestra.console:Power off for smithi099 completed
2022-01-17T21:04:56.500 INFO:teuthology.kill:2022-01-17 21:04:56,500.500 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2022-01-17T21:04:56.638 INFO:teuthology.kill:2022-01-17 21:04:56,638.638 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com
2022-01-17T21:04:56.642 INFO:teuthology.kill:2022-01-17 21:04:56,642.642 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com
2022-01-17T21:06:56.934 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15