2021-12-12T08:41:50.949 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-12T08:41:51.135 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi176.front.sepia.ceph.com' reimaging
2021-12-12T08:41:51.136 INFO:teuthology.lock.ops:Updating [ubuntu@smithi176.front.sepia.ceph.com]: reset os type and version on server
2021-12-12T08:41:51.136 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2021-12-12T08:41:51.155 INFO:teuthology.lock.ops:Node 'ubuntu@smithi176.front.sepia.ceph.com' reimaging is complete
2021-12-12T08:41:51.156 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging
2021-12-12T08:41:51.158 INFO:teuthology.lock.ops:Updating [ubuntu@smithi183.front.sepia.ceph.com]: reset os type and version on server
2021-12-12T08:41:51.159 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2021-12-12T08:41:51.181 INFO:teuthology.lock.ops:Node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging is complete
2021-12-12T08:41:51.368 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of centos 8.stream
2021-12-12T08:41:51.395 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 8.stream
2021-12-12T08:41:51.758 INFO:teuthology.orchestra.console:Power off smithi183
2021-12-12T08:41:51.828 INFO:teuthology.orchestra.console:Power off smithi176
2021-12-12T08:42:00.193 INFO:teuthology.orchestra.console:Power off for smithi176 completed
2021-12-12T08:42:00.294 INFO:teuthology.orchestra.console:Power on smithi176
2021-12-12T08:42:04.245 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2021-12-12T08:42:04.347 INFO:teuthology.orchestra.console:Power on smithi183
2021-12-12T08:42:08.603 INFO:teuthology.orchestra.console:Power on for smithi183 completed
2021-12-12T08:42:08.655 INFO:teuthology.orchestra.console:Power on for smithi176 completed
2021-12-12T08:42:08.705 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2021-12-12T08:42:08.756 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish
2021-12-12T08:46:58.931 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-12T08:46:59.198 INFO:teuthology.provision.fog.smithi176:Node is ready
2021-12-12T08:46:59.214 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com
2021-12-12T08:46:59.270 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176
2021-12-12T08:46:59.593 INFO:teuthology.provision.fog.smithi176:Deploy complete!
2021-12-12T08:47:14.092 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-12T08:47:14.401 INFO:teuthology.provision.fog.smithi183:Node is ready
2021-12-12T08:47:14.418 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com
2021-12-12T08:47:14.474 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2021-12-12T08:47:14.800 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2021-12-12T08:47:14.948 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com
2021-12-12T08:47:14.949 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-12T08:47:14.967 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2021-12-12T08:47:14.968 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-12T08:47:14.987 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server
2021-12-12T08:47:14.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2021-12-12T08:47:15.229 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64
2021-12-12T08:47:15.286 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream"
2021-12-12T08:47:15.287 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8"
2021-12-12T08:47:15.287 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos"
2021-12-12T08:47:15.288 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora"
2021-12-12T08:47:15.288 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8"
2021-12-12T08:47:15.288 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8"
2021-12-12T08:47:15.289 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-12T08:47:15.289 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31"
2021-12-12T08:47:15.289 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-12T08:47:15.290 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/"
2021-12-12T08:47:15.290 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-12T08:47:15.290 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-12T08:47:15.291 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-12T08:47:15.292 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2021-12-12T08:47:15.313 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2021-12-12T08:47:15.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2021-12-12T08:47:15.498 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2021-12-12T08:47:15.554 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream"
2021-12-12T08:47:15.554 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8"
2021-12-12T08:47:15.554 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos"
2021-12-12T08:47:15.554 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora"
2021-12-12T08:47:15.555 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8"
2021-12-12T08:47:15.555 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8"
2021-12-12T08:47:15.555 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-12T08:47:15.555 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2021-12-12T08:47:15.556 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-12T08:47:15.556 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/"
2021-12-12T08:47:15.556 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-12T08:47:15.556 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-12T08:47:15.556 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-12T08:47:15.557 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2021-12-12T08:47:15.668 INFO:teuthology.dispatcher.supervisor:Running job 6559161
2021-12-12T08:47:15.669 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559161 --name teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559161/orig.config.yaml
2021-12-12T08:47:15.673 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-12-12_07:01:03-rados-master-distro-default-smithi/6559161
2021-12-12T08:47:15.674 INFO:teuthology.dispatcher.supervisor:Job PID: 29478
2021-12-12T08:47:15.674 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-12T20:47:36.741 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-12T20:47:36.928 INFO:teuthology.kill:Killing Pids: {29478}
2021-12-12T20:47:38.209 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-12-12T20:47:38.211 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-12T20:47:38.211 INFO:teuthology.misc:Compressing logs...
2021-12-12T20:47:38.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2021-12-12T20:47:38.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2021-12-12T20:47:38.449 INFO:teuthology.orchestra.run.smithi176.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-12T20:47:38.642 INFO:teuthology.orchestra.run.smithi183.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-12T20:47:38.682 INFO:teuthology.orchestra.run.smithi176.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-12T20:47:38.682 INFO:teuthology.orchestra.run.smithi176.stderr:tar: Error is not recoverable: exiting now
2021-12-12T20:47:38.723 INFO:teuthology.orchestra.run.smithi183.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-12T20:47:38.723 INFO:teuthology.orchestra.run.smithi183.stderr:tar: Error is not recoverable: exiting now
2021-12-12T20:47:38.725 INFO:teuthology.misc:Compressing logs...
2021-12-12T20:47:39.078 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-12T20:47:39.271 INFO:teuthology.misc:Compressing logs...
2021-12-12T20:47:49.484 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/aab91ca4-5b28-11ec-8c31-001a4aab830c/ceph-mon.smithi183.log: file size changed while zipping
2021-12-12T20:48:05.479 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/aab91ca4-5b28-11ec-8c31-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-12T20:48:18.560 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/aab91ca4-5b28-11ec-8c31-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-12T20:48:29.797 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/aab91ca4-5b28-11ec-8c31-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-12T20:48:43.145 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/aab91ca4-5b28-11ec-8c31-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-12T20:48:46.657 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/aab91ca4-5b28-11ec-8c31-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-12T20:49:08.176 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/aab91ca4-5b28-11ec-8c31-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-12T20:49:12.200 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/aab91ca4-5b28-11ec-8c31-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-12T20:49:12.412 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/aab91ca4-5b28-11ec-8c31-001a4aab830c/ceph-mgr.smithi183.nuhcwe.log: file size changed while zipping
2021-12-12T20:49:31.585 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/aab91ca4-5b28-11ec-8c31-001a4aab830c/ceph-mon.smithi176.log: file size changed while zipping
2021-12-12T20:49:34.168 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/aab91ca4-5b28-11ec-8c31-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-12T20:50:21.950 INFO:teuthology.kill:No teuthology processes running
2021-12-12T20:50:23.167 INFO:teuthology.kill:Nuking machines: ['smithi176', 'smithi183']
2021-12-12T20:50:24.199 INFO:teuthology.kill:2021-12-12 20:50:24,198.198 INFO:teuthology.nuke:targets:
2021-12-12T20:50:24.199 INFO:teuthology.kill:  smithi176.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDrWDK7Rc4yYf1vWbFtYLlgVyTiRIo0/sNbXnf2ilPehXdOlqcbgzCBJzDP1i4/G4+Gro67NAL0bRXkK90aDOPDctLnoG1PG8QBxDnDhxf+etxnKEjXGniOZrUh0aYK63tZCzQF0gHajGMo4795GhPuLrPL0bbqbd4q74T6U4WyV9a3m4/Yg5z4Y+mBpKy6Hk2o73VAMt4fjgcAbl7Wg7nPMqEPeKCYAoibXjBUflHBEmDISCB7kx3cJRa600/A1P8/dDUhqv3syymBFiRoVknpJtwgWdig+COl5qICPyWBXhZKeDn5T/7EH4blnOoSyyrwKiR2nVmqBCgMC54seBoT7s8Nv363YtrY/xGzb+fKX1GGLekaG4b/i1NGxcyQhwb6aPC6ALhXWYzkg86N1uPGgy+IS/ev9Rjjw6TW9jtzJrAKcAAxJcz+XHOMUhi+yIMf2mwsl87I5z7R7x+qBI1Yo7o63SU2UxxIQkBZ2OYmNfL+ivrEHSW/kcilPEK/3BU=
2021-12-12T20:50:24.200 INFO:teuthology.kill:  smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqaHd3s874NM3GUu7liaqL55PHa9gajExDWgifECptaQZv3pRh6ogxwwAXsk9oawmnmegh0ghfu3xe2F37EDEqGSJpoNiLdSN2sZDCcxSUo4gWGX+ldMcN5woT4MP8SP8pNe+Eyeu+IY8VBwNOpsPvIKKdAjlZAEhr/GFboApyBoq0KKtbCGA0dokNPGnhVk0OGeoaoJA4IAeC+UuePbdKarWmLc6xa3TVVHvgCImtDRxjIPA0eiOrYg3IiCFvqMTgsKNdYAQzCsib6L2AJuMFjbGLxVqF60lOf09Db+8+ZS4WCvA5iRVcNIcHlnjkmTEhK/iFEPlOgo11bqlKfrJKPvCJ+zNmAvbuM/Ij3JEA4p4dhXG/EGlUJpoJyXaSAQQWiggx8p8Lveu85bCjPSL2qMRxAvkjtT8zSVjTdz0MKcC0C98zxeXBiiCvHnbT7Moqn10fktSOEmZMpnI4GKcQB3wPGddC924Pe3mnEp7JHTI6yfIrIL0ERZpdQxjso2s=
2021-12-12T20:50:24.227 INFO:teuthology.kill:2021-12-12 20:50:24,227.227 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-12T20:50:24.231 INFO:teuthology.kill:2021-12-12 20:50:24,231.231 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-12T20:50:24.306 INFO:teuthology.kill:2021-12-12 20:50:24,306.306 INFO:teuthology.orchestra.console:Power off smithi183
2021-12-12T20:50:24.319 INFO:teuthology.kill:2021-12-12 20:50:24,318.318 INFO:teuthology.orchestra.console:Power off smithi176
2021-12-12T20:50:32.680 INFO:teuthology.kill:2021-12-12 20:50:32,680.680 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2021-12-12T20:50:32.687 INFO:teuthology.kill:2021-12-12 20:50:32,686.686 INFO:teuthology.orchestra.console:Power off for smithi176 completed
2021-12-12T20:50:32.830 INFO:teuthology.kill:2021-12-12 20:50:32,830.830 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com
2021-12-12T20:50:32.833 INFO:teuthology.kill:2021-12-12 20:50:32,833.833 INFO:teuthology.lock.ops:unlocked: smithi176.front.sepia.ceph.com
2021-12-12T20:52:33.183 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-12T20:52:33.278 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi176 but it was locked by another job: /home/teuthworker/archive/vshankar-2021-12-12_16:30:32-fs-wip-vshankar-testing-20211212-193118-testing-default-smithi/6559844
2021-12-12T20:52:33.279 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi183 but it was locked by another job: /home/teuthworker/archive/vshankar-2021-12-12_16:30:32-fs-wip-vshankar-testing-20211212-193118-testing-default-smithi/6559844