2021-12-06T22:52:16.321 INFO:root:teuthology version: 1.1.0-844d1377
2021-12-06T22:52:16.450 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi041.front.sepia.ceph.com' reimaging
2021-12-06T22:52:16.451 INFO:teuthology.lock.ops:Updating [ubuntu@smithi041.front.sepia.ceph.com]: reset os type and version on server
2021-12-06T22:52:16.451 INFO:teuthology.lock.ops:Updating smithi041.front.sepia.ceph.com on lock server
2021-12-06T22:52:16.470 INFO:teuthology.lock.ops:Node 'ubuntu@smithi041.front.sepia.ceph.com' reimaging is complete
2021-12-06T22:52:16.471 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi081.front.sepia.ceph.com' reimaging
2021-12-06T22:52:16.471 INFO:teuthology.lock.ops:Updating [ubuntu@smithi081.front.sepia.ceph.com]: reset os type and version on server
2021-12-06T22:52:16.471 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2021-12-06T22:52:16.491 INFO:teuthology.lock.ops:Node 'ubuntu@smithi081.front.sepia.ceph.com' reimaging is complete
2021-12-06T22:52:16.702 INFO:teuthology.provision.fog.smithi041:Scheduling deploy of centos 8.stream
2021-12-06T22:52:16.706 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 8.stream
2021-12-06T22:52:17.083 INFO:teuthology.orchestra.console:Power off smithi081
2021-12-06T22:52:17.097 INFO:teuthology.orchestra.console:Power off smithi041
2021-12-06T22:52:29.568 INFO:teuthology.orchestra.console:Power off for smithi081 completed
2021-12-06T22:52:29.573 INFO:teuthology.orchestra.console:Power off for smithi041 completed
2021-12-06T22:52:29.669 INFO:teuthology.orchestra.console:Power on smithi081
2021-12-06T22:52:29.677 INFO:teuthology.orchestra.console:Power on smithi041
2021-12-06T22:52:33.923 INFO:teuthology.orchestra.console:Power on for smithi081 completed
2021-12-06T22:52:34.024 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2021-12-06T22:52:38.040 INFO:teuthology.orchestra.console:Power on for smithi041 completed
2021-12-06T22:52:38.141 INFO:teuthology.provision.fog.smithi041:Waiting for deploy to finish
2021-12-06T22:57:12.792 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-06T22:57:13.077 INFO:teuthology.provision.fog.smithi041:Node is ready
2021-12-06T22:57:13.096 INFO:teuthology.orchestra.run.smithi041.stdout:smithi041.front.sepia.ceph.com
2021-12-06T22:57:13.154 INFO:teuthology.orchestra.run.smithi041.stdout:172.21.15.41 smithi041.front.sepia.ceph.com smithi041
2021-12-06T22:57:13.504 INFO:teuthology.provision.fog.smithi041:Deploy complete!
2021-12-06T22:57:38.915 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-06T22:57:39.178 INFO:teuthology.provision.fog.smithi081:Node is ready
2021-12-06T22:57:39.195 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com
2021-12-06T22:57:39.251 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2021-12-06T22:57:39.586 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2021-12-06T22:57:39.779 INFO:teuthology.lock.ops:Checking smithi041.front.sepia.ceph.com
2021-12-06T22:57:39.780 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-06T22:57:39.800 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2021-12-06T22:57:39.801 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-06T22:57:39.822 INFO:teuthology.lock.ops:Updating [smithi041.front.sepia.ceph.com]: set os type and version on server
2021-12-06T22:57:39.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi041.front.sepia.ceph.com'
2021-12-06T22:57:40.068 INFO:teuthology.orchestra.run.smithi041.stdout:x86_64
2021-12-06T22:57:40.127 INFO:teuthology.orchestra.run.smithi041.stdout:NAME="CentOS Stream"
2021-12-06T22:57:40.127 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION="8"
2021-12-06T22:57:40.127 INFO:teuthology.orchestra.run.smithi041.stdout:ID="centos"
2021-12-06T22:57:40.128 INFO:teuthology.orchestra.run.smithi041.stdout:ID_LIKE="rhel fedora"
2021-12-06T22:57:40.128 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION_ID="8"
2021-12-06T22:57:40.128 INFO:teuthology.orchestra.run.smithi041.stdout:PLATFORM_ID="platform:el8"
2021-12-06T22:57:40.128 INFO:teuthology.orchestra.run.smithi041.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-06T22:57:40.128 INFO:teuthology.orchestra.run.smithi041.stdout:ANSI_COLOR="0;31"
2021-12-06T22:57:40.129 INFO:teuthology.orchestra.run.smithi041.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-06T22:57:40.129 INFO:teuthology.orchestra.run.smithi041.stdout:HOME_URL="https://centos.org/"
2021-12-06T22:57:40.129 INFO:teuthology.orchestra.run.smithi041.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-06T22:57:40.129 INFO:teuthology.orchestra.run.smithi041.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-06T22:57:40.130 INFO:teuthology.orchestra.run.smithi041.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-06T22:57:40.131 INFO:teuthology.lock.ops:Updating smithi041.front.sepia.ceph.com on lock server
2021-12-06T22:57:40.153 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2021-12-06T22:57:40.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2021-12-06T22:57:40.348 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2021-12-06T22:57:40.405 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream"
2021-12-06T22:57:40.405 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8"
2021-12-06T22:57:40.405 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos"
2021-12-06T22:57:40.405 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora"
2021-12-06T22:57:40.406 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8"
2021-12-06T22:57:40.406 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2021-12-06T22:57:40.406 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-06T22:57:40.406 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2021-12-06T22:57:40.407 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-06T22:57:40.407 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/"
2021-12-06T22:57:40.407 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-06T22:57:40.408 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-06T22:57:40.408 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-06T22:57:40.408 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2021-12-06T22:57:40.510 INFO:teuthology.dispatcher.supervisor:Running job 6548695
2021-12-06T22:57:40.511 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-12-06_22:03:31-rados-wip-yuri2-testing-2021-11-30-0754-distro-default-smithi/6548695 --name yuriw-2021-12-06_22:03:31-rados-wip-yuri2-testing-2021-11-30-0754-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2021-12-06_22:03:31-rados-wip-yuri2-testing-2021-11-30-0754-distro-default-smithi/6548695/orig.config.yaml
2021-12-06T22:57:40.515 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-12-06_22:03:31-rados-wip-yuri2-testing-2021-11-30-0754-distro-default-smithi/6548695
2021-12-06T22:57:40.516 INFO:teuthology.dispatcher.supervisor:Job PID: 18824
2021-12-06T22:57:40.517 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-07T10:58:00.785 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-07T10:58:00.939 INFO:teuthology.kill:Killing Pids: {18824}
2021-12-07T10:58:02.137 INFO:teuthology.task.internal:roles: ubuntu@smithi041.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-12-07T10:58:02.139 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-07T10:58:02.139 INFO:teuthology.misc:Compressing logs...
2021-12-07T10:58:02.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi041.front.sepia.ceph.com'
2021-12-07T10:58:02.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2021-12-07T10:58:02.391 INFO:teuthology.orchestra.run.smithi041.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-07T10:58:02.583 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-07T10:58:02.630 INFO:teuthology.orchestra.run.smithi041.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-07T10:58:02.631 INFO:teuthology.orchestra.run.smithi041.stderr:tar: Error is not recoverable: exiting now
2021-12-07T10:58:02.668 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-07T10:58:02.669 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now
2021-12-07T10:58:02.671 INFO:teuthology.misc:Compressing logs...
2021-12-07T10:58:03.064 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-07T10:58:03.269 INFO:teuthology.misc:Compressing logs...
2021-12-07T10:58:09.315 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/75045a54-56e8-11ec-8c2e-001a4aab830c/ceph-mon.smithi081.log: file size changed while zipping
2021-12-07T10:58:17.137 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/75045a54-56e8-11ec-8c2e-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-07T10:58:21.496 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/75045a54-56e8-11ec-8c2e-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-07T10:58:30.134 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/75045a54-56e8-11ec-8c2e-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-07T10:58:32.010 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/75045a54-56e8-11ec-8c2e-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-07T10:58:39.722 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/75045a54-56e8-11ec-8c2e-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-07T10:58:44.189 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/75045a54-56e8-11ec-8c2e-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-07T10:58:53.353 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/75045a54-56e8-11ec-8c2e-001a4aab830c/ceph-mon.smithi041.log: file size changed while zipping
2021-12-07T10:58:54.155 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/75045a54-56e8-11ec-8c2e-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-07T10:58:58.812 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/75045a54-56e8-11ec-8c2e-001a4aab830c/ceph-mgr.smithi081.tpeeyy.log: file size changed while zipping
2021-12-07T10:59:07.377 INFO:teuthology.orchestra.run.smithi041.stderr:gzip: /var/log/ceph/75045a54-56e8-11ec-8c2e-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-07T10:59:57.086 INFO:teuthology.kill:No teuthology processes running
2021-12-07T10:59:58.233 INFO:teuthology.kill:Nuking machines: ['smithi041', 'smithi081']
2021-12-07T10:59:59.218 INFO:teuthology.kill:2021-12-07 10:59:59,218.218 INFO:teuthology.nuke:targets:
2021-12-07T10:59:59.219 INFO:teuthology.kill:  smithi041.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFarQP/WEBTYQyiTbE8mk96tBYdv80JMw+96xOOGuYO46pQ5tGLh7u01jbKIxJmI1h8jMXQ6djaAVOVkUxsmQx/vyM2RMWoGXBDzPTZa6oS1kD92YhqMzFOdcRRpOUMItK4dmPshs05CK7twYri5dQVrHgf5CpI1uFyd/osf8Rae6ww2RCFiUe+Us+778RB3auBLcq5G29vjvWjoqW8ZnBguP/G7LaNLcRNtDs9HcrudJ+pCa2JIwiZhXw9RLje//4ugsQUGi4AVa6TQVdKLeUVCHQRTv8bpMsK/4GuwqBWI68jFQNnTk8QoUmUPX3Rj0c3aoHi1j/pca4Kvga2xzceWGx+bTCer0KsVDPZmXAH7zvEhPHypZzNM2GJjYz77SLqfJ/mmgIOpvEdWJXCIQ9h8Xsl/dGpU1vT1voavD9ECZYFgondDMqZQGegRTcXokxzboB1Giy9eypfGWr+NPYkJmq5B1YdAX1egJz5kIas6G2Gr8/mFr/6mMZCuioF2k=
2021-12-07T10:59:59.219 INFO:teuthology.kill:  smithi081.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWauocugPTtccywAS46c5wHbU2Qp1GSyYHnNdIbeKq7wyWPNcTO0WVYgFSHAYvUUR30w2XLkzMf4BBKLkZJkLMjDIloN22gjboHI9yqIhuynC2hss/g7353iPK1Fr1K3CYZL/UFb8GzVAHymVJHIgr1ENqvmZwbTRxZGzV8vZWNERsIjkN+mbt0hBDBtTZ73pdCBsuswNYFA7YcPjiYLplAkl3v5SiKrV38PaZbTjLl+4kdkY22G4kxm5asfdVBPMeFY7U07YxxEJD0O6yfoFDSgfSICYrRnZC9TMFuEuHx5Yynbq3MGfMQIGoruBPDG5R85DZoiwRJntD8b/sNRI6XLX8/+Mos7aTAKrSe78uitp8PI4FDvpARvwmqCmCh0RNq+Kz8E7GQMznnwrP7ZQMdnN36Cow+JURB4+Rqif8qHuzR/r2DbABsPx7gfmkcjlWIu36lc800o1OEcr6ddg0eNU3S4Dno9w5JxF7BrSVhgMBR2mR4PMiTgv36CboiTc=
2021-12-07T10:59:59.245 INFO:teuthology.kill:2021-12-07 10:59:59,245.245 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-07T10:59:59.248 INFO:teuthology.kill:2021-12-07 10:59:59,248.248 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-07T10:59:59.328 INFO:teuthology.kill:2021-12-07 10:59:59,328.328 INFO:teuthology.orchestra.console:Power off smithi081
2021-12-07T10:59:59.341 INFO:teuthology.kill:2021-12-07 10:59:59,341.341 INFO:teuthology.orchestra.console:Power off smithi041
2021-12-07T11:00:07.696 INFO:teuthology.kill:2021-12-07 11:00:07,696.696 INFO:teuthology.orchestra.console:Power off for smithi081 completed
2021-12-07T11:00:07.703 INFO:teuthology.kill:2021-12-07 11:00:07,702.702 INFO:teuthology.orchestra.console:Power off for smithi041 completed
2021-12-07T11:00:07.841 INFO:teuthology.kill:2021-12-07 11:00:07,840.840 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com
2021-12-07T11:00:07.855 INFO:teuthology.kill:2021-12-07 11:00:07,855.855 INFO:teuthology.lock.ops:unlocked: smithi041.front.sepia.ceph.com
2021-12-07T11:02:08.183 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-07T11:02:08.280 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi041 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-07_00:28:11-rados-wip-master_12.6.21-distro-default-smithi/6549005
2021-12-07T11:02:08.281 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi081 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-07_00:28:11-rados-wip-master_12.6.21-distro-default-smithi/6549005