2021-12-19T15:28:19.595 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-19T15:28:19.726 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi061.front.sepia.ceph.com' reimaging
2021-12-19T15:28:19.728 INFO:teuthology.lock.ops:Updating [ubuntu@smithi061.front.sepia.ceph.com]: reset os type and version on server
2021-12-19T15:28:19.728 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server
2021-12-19T15:28:19.748 INFO:teuthology.lock.ops:Node 'ubuntu@smithi061.front.sepia.ceph.com' reimaging is complete
2021-12-19T15:28:19.749 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging
2021-12-19T15:28:19.749 INFO:teuthology.lock.ops:Updating [ubuntu@smithi170.front.sepia.ceph.com]: reset os type and version on server
2021-12-19T15:28:19.749 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2021-12-19T15:28:19.772 INFO:teuthology.lock.ops:Node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging is complete
2021-12-19T15:28:19.962 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of centos 8.stream
2021-12-19T15:28:19.983 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 8.stream
2021-12-19T15:28:20.375 INFO:teuthology.orchestra.console:Power off smithi170
2021-12-19T15:28:20.390 INFO:teuthology.orchestra.console:Power off smithi061
2021-12-19T15:28:28.746 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2021-12-19T15:28:28.755 INFO:teuthology.orchestra.console:Power off for smithi061 completed
2021-12-19T15:28:28.847 INFO:teuthology.orchestra.console:Power on smithi170
2021-12-19T15:28:28.856 INFO:teuthology.orchestra.console:Power on smithi061
2021-12-19T15:28:37.214 INFO:teuthology.orchestra.console:Power on for smithi170 completed
2021-12-19T15:28:37.221 INFO:teuthology.orchestra.console:Power on for smithi061 completed
2021-12-19T15:28:37.316 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish
2021-12-19T15:28:37.322 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish
2021-12-19T15:33:27.270 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-19T15:33:27.533 INFO:teuthology.provision.fog.smithi170:Node is ready
2021-12-19T15:33:27.549 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com
2021-12-19T15:33:27.604 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170
2021-12-19T15:33:27.921 INFO:teuthology.provision.fog.smithi170:Deploy complete!
2021-12-19T15:33:42.450 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-19T15:33:42.719 INFO:teuthology.provision.fog.smithi061:Node is ready
2021-12-19T15:33:42.777 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com
2021-12-19T15:33:42.836 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061
2021-12-19T15:33:43.178 INFO:teuthology.provision.fog.smithi061:Deploy complete!
2021-12-19T15:33:43.373 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com
2021-12-19T15:33:43.374 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-19T15:33:43.395 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com
2021-12-19T15:33:43.396 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-19T15:33:43.413 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server
2021-12-19T15:33:43.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com'
2021-12-19T15:33:43.598 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64
2021-12-19T15:33:43.654 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="CentOS Stream"
2021-12-19T15:33:43.654 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8"
2021-12-19T15:33:43.655 INFO:teuthology.orchestra.run.smithi061.stdout:ID="centos"
2021-12-19T15:33:43.655 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="rhel fedora"
2021-12-19T15:33:43.655 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8"
2021-12-19T15:33:43.655 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8"
2021-12-19T15:33:43.656 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-19T15:33:43.656 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31"
2021-12-19T15:33:43.656 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-19T15:33:43.656 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://centos.org/"
2021-12-19T15:33:43.657 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-19T15:33:43.657 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-19T15:33:43.657 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-19T15:33:43.658 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server
2021-12-19T15:33:43.678 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server
2021-12-19T15:33:43.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2021-12-19T15:33:43.920 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64
2021-12-19T15:33:43.977 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream"
2021-12-19T15:33:43.978 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8"
2021-12-19T15:33:43.978 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos"
2021-12-19T15:33:43.978 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora"
2021-12-19T15:33:43.979 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8"
2021-12-19T15:33:43.979 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8"
2021-12-19T15:33:43.979 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-19T15:33:43.980 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2021-12-19T15:33:43.980 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-19T15:33:43.980 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/"
2021-12-19T15:33:43.980 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-19T15:33:43.980 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-19T15:33:43.981 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-19T15:33:43.981 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2021-12-19T15:33:44.072 INFO:teuthology.dispatcher.supervisor:Running job 6571038
2021-12-19T15:33:44.073 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-12-19_03:31:03-rados-pacific-distro-default-smithi/6571038 --name teuthology-2021-12-19_03:31:03-rados-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/teuthology-2021-12-19_03:31:03-rados-pacific-distro-default-smithi/6571038/orig.config.yaml
2021-12-19T15:33:44.077 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-12-19_03:31:03-rados-pacific-distro-default-smithi/6571038
2021-12-19T15:33:44.077 INFO:teuthology.dispatcher.supervisor:Job PID: 26322
2021-12-19T15:33:44.078 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-20T03:34:04.049 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-20T03:34:04.241 INFO:teuthology.kill:Killing Pids: {26322}
2021-12-20T03:34:05.426 INFO:teuthology.task.internal:roles: ubuntu@smithi061.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-12-20T03:34:05.427 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-20T03:34:05.427 INFO:teuthology.misc:Compressing logs...
2021-12-20T03:34:05.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com'
2021-12-20T03:34:05.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2021-12-20T03:34:05.674 INFO:teuthology.orchestra.run.smithi061.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-20T03:34:05.849 INFO:teuthology.orchestra.run.smithi170.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-20T03:34:05.891 INFO:teuthology.orchestra.run.smithi061.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-20T03:34:05.892 INFO:teuthology.orchestra.run.smithi061.stderr:tar: Error is not recoverable: exiting now
2021-12-20T03:34:05.931 INFO:teuthology.orchestra.run.smithi170.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-20T03:34:05.931 INFO:teuthology.orchestra.run.smithi170.stderr:tar: Error is not recoverable: exiting now
2021-12-20T03:34:05.932 INFO:teuthology.misc:Compressing logs...
2021-12-20T03:34:06.234 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-20T03:34:06.572 INFO:teuthology.misc:Compressing logs...
2021-12-20T03:34:06.960 INFO:teuthology.orchestra.run.smithi061.stderr:gzip: /var/log/ceph/c93d94a2-60e1-11ec-8c31-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-20T03:34:07.155 INFO:teuthology.orchestra.run.smithi061.stderr:gzip: /var/log/ceph/c93d94a2-60e1-11ec-8c31-001a4aab830c/ceph-mon.smithi061.log: file size changed while zipping
2021-12-20T03:34:07.566 INFO:teuthology.orchestra.run.smithi061.stderr:gzip: /var/log/ceph/c93d94a2-60e1-11ec-8c31-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-20T03:34:44.791 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/c93d94a2-60e1-11ec-8c31-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-20T03:35:16.955 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/c93d94a2-60e1-11ec-8c31-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-20T03:35:46.535 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/c93d94a2-60e1-11ec-8c31-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-20T03:36:14.108 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/c93d94a2-60e1-11ec-8c31-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-20T03:36:20.335 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/c93d94a2-60e1-11ec-8c31-001a4aab830c/ceph-mon.smithi170.log: file size changed while zipping
2021-12-20T03:37:21.823 INFO:teuthology.orchestra.run.smithi170.stderr:tar: .: file changed as we read it
2021-12-20T03:37:21.888 INFO:teuthology.kill:No teuthology processes running
2021-12-20T03:37:23.038 INFO:teuthology.kill:Nuking machines: ['smithi061', 'smithi170']
2021-12-20T03:37:23.979 INFO:teuthology.kill:2021-12-20 03:37:23,979.979 INFO:teuthology.nuke:targets:
2021-12-20T03:37:23.980 INFO:teuthology.kill:  smithi061.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLzu1f/SBV8UF4KQGnwVwL6HnoWKe9EQq164iP+2ImbtCKtpHq25o5tTqHqNMPZDkNC9IAOVwnxR/IpPDtkH4ZM3AAMnNZmEsevv9LIFMAl/4QUaEa4+6Amnu9ZoYFKUkQVl1RzN3bBbE+MEH6BhTnkW72/lO17hhPTKb9qjB39tHeM3oR5rFq4POODGRXMg4jKET+RQEl6oNI73/wPq9wMkurRClGPKwZWJbxA0PVqrAefPQv4CFJ5gKrum8GDneMZGi5y//pgm1FdvSmkB5wF9TlI1UdIpw9U+ZlxCeTxGrnNJmw4EHInmOJhqKTv6a5BeVhZR2VDdKZN4KmRBq+E6mVtz8yuOP19GQfy1/qKFvc3fGoJuvQEGjYPEjw6OKZ7NyC5HwIi0XHfSe2NNZ5TxSZ/tQlb9JJ9nHx38J3vX+RlL7woecVyk8Rc8aSkDCka9CirXplQrszAhPqumQkO2dx/QHYhO8/G7FCs8hh8IoGs1QNUOGaPluLqK+2Jjc=
2021-12-20T03:37:23.981 INFO:teuthology.kill:  smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhhyuqLoLYmVbMoOS2pFRT77jdJ6N5FQRAbviBRlltNOd3aq65qUUzoQBcSqhpIAf1UsfaP7hi9a/iFuqutMFnRwBAvtHryV5zkYLki3cAhn5THZ9+f1K/2s2/adYKEosXz16F7LFi4+DvD/AUuTIM2KYmkg0tAy6WscnuTqE1j3hpa8AQZ05VZoWG99zkvSg+Hxu752HaGWNSxQ4OtBtAJVCcPkkF03qAbNBqwVDXVOyuBF+zJgWRa1m1NVyNTKw4mELqmJn2FG+qoNSBY/3Bx+GCuxZ0mZthlk8B9gMwfiBH8tOt/ACJ5Za0WI/uvF9zklFkT8DtoDwpPU3uEYTxUySaX4lHBIKK0hEf1USjgqXu2HCh9Naf9do8i6v+ew1UikPpUvy6oIlWoAo1mci4OrRZetlwuEL5oTh0TYk1enfjtM3I+dICzK8MnFNSBqlZFbgNdAy3kkxd+fvcThAJabnqCztZEoK3WqPzstnKut2FlML4PZFXbTTa7lU9tB0=
2021-12-20T03:37:24.008 INFO:teuthology.kill:2021-12-20 03:37:24,007.007 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-20T03:37:24.011 INFO:teuthology.kill:2021-12-20 03:37:24,010.010 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-20T03:37:24.086 INFO:teuthology.kill:2021-12-20 03:37:24,086.086 INFO:teuthology.orchestra.console:Power off smithi061
2021-12-20T03:37:24.100 INFO:teuthology.kill:2021-12-20 03:37:24,100.100 INFO:teuthology.orchestra.console:Power off smithi170
2021-12-20T03:37:36.575 INFO:teuthology.kill:2021-12-20 03:37:36,575.575 INFO:teuthology.orchestra.console:Power off for smithi061 completed
2021-12-20T03:37:36.581 INFO:teuthology.kill:2021-12-20 03:37:36,581.581 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2021-12-20T03:37:36.721 INFO:teuthology.kill:2021-12-20 03:37:36,720.720 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com
2021-12-20T03:37:36.725 INFO:teuthology.kill:2021-12-20 03:37:36,725.725 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com
2021-12-20T03:39:37.045 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-20T03:39:37.145 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi061 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-20_02:01:03-rbd-master-distro-default-smithi/6572827
2021-12-20T03:39:37.146 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi170 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-20_02:01:03-rbd-master-distro-default-smithi/6572827