2022-01-19T07:45:58.911 INFO:root:teuthology version: 1.1.0-3ff86a5d
2022-01-19T07:45:59.030 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging
2022-01-19T07:45:59.032 INFO:teuthology.lock.ops:Updating [ubuntu@smithi134.front.sepia.ceph.com]: reset os type and version on server
2022-01-19T07:45:59.032 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2022-01-19T07:45:59.051 INFO:teuthology.lock.ops:Node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging is complete
2022-01-19T07:45:59.051 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging
2022-01-19T07:45:59.052 INFO:teuthology.lock.ops:Updating [ubuntu@smithi170.front.sepia.ceph.com]: reset os type and version on server
2022-01-19T07:45:59.052 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2022-01-19T07:45:59.073 INFO:teuthology.lock.ops:Node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging is complete
2022-01-19T07:45:59.261 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 8.3
2022-01-19T07:45:59.281 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 8.3
2022-01-19T07:45:59.621 INFO:teuthology.orchestra.console:Power off smithi134
2022-01-19T07:45:59.708 INFO:teuthology.orchestra.console:Power off smithi170
2022-01-19T07:46:08.070 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2022-01-19T07:46:08.171 INFO:teuthology.orchestra.console:Power on smithi170
2022-01-19T07:46:12.104 INFO:teuthology.orchestra.console:Power off for smithi134 completed
2022-01-19T07:46:12.206 INFO:teuthology.orchestra.console:Power on smithi134
2022-01-19T07:46:16.532 INFO:teuthology.orchestra.console:Power on for smithi170 completed
2022-01-19T07:46:16.633 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish
2022-01-19T07:46:20.578 INFO:teuthology.orchestra.console:Power on for smithi134 completed
2022-01-19T07:46:20.680 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish
2022-01-19T07:50:48.760 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-19T07:50:49.041 INFO:teuthology.provision.fog.smithi170:Node is ready
2022-01-19T07:50:49.055 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com
2022-01-19T07:50:49.110 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170
2022-01-19T07:50:49.427 INFO:teuthology.provision.fog.smithi170:Deploy complete!
2022-01-19T07:50:53.434 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-19T07:50:53.749 INFO:teuthology.provision.fog.smithi134:Node is ready
2022-01-19T07:50:53.764 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com
2022-01-19T07:50:53.819 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134
2022-01-19T07:50:54.137 INFO:teuthology.provision.fog.smithi134:Deploy complete!
2022-01-19T07:50:54.313 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com
2022-01-19T07:50:54.314 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-19T07:50:54.334 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com
2022-01-19T07:50:54.334 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-19T07:50:54.353 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server
2022-01-19T07:50:54.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2022-01-19T07:50:54.611 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64
2022-01-19T07:50:54.665 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Linux"
2022-01-19T07:50:54.665 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8"
2022-01-19T07:50:54.665 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos"
2022-01-19T07:50:54.666 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora"
2022-01-19T07:50:54.666 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8"
2022-01-19T07:50:54.666 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8"
2022-01-19T07:50:54.666 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Linux 8"
2022-01-19T07:50:54.667 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2022-01-19T07:50:54.667 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-19T07:50:54.667 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/"
2022-01-19T07:50:54.667 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2022-01-19T07:50:54.668 INFO:teuthology.orchestra.run.smithi134.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2022-01-19T07:50:54.668 INFO:teuthology.orchestra.run.smithi134.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2022-01-19T07:50:54.669 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2022-01-19T07:50:54.687 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server
2022-01-19T07:50:54.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2022-01-19T07:50:54.951 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64
2022-01-19T07:50:55.005 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Linux"
2022-01-19T07:50:55.005 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8"
2022-01-19T07:50:55.005 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos"
2022-01-19T07:50:55.006 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora"
2022-01-19T07:50:55.006 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8"
2022-01-19T07:50:55.006 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8"
2022-01-19T07:50:55.006 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Linux 8"
2022-01-19T07:50:55.007 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2022-01-19T07:50:55.007 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-19T07:50:55.007 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/"
2022-01-19T07:50:55.007 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2022-01-19T07:50:55.008 INFO:teuthology.orchestra.run.smithi170.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2022-01-19T07:50:55.008 INFO:teuthology.orchestra.run.smithi170.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2022-01-19T07:50:55.008 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2022-01-19T07:50:55.098 INFO:teuthology.dispatcher.supervisor:Running job 6626450
2022-01-19T07:50:55.098 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-01-19_07:41:11-rados:cephadm-wip-guits-testing-2022-01-18-1557-pacific-distro-default-smithi/6626450 --name gabrioux-2022-01-19_07:41:11-rados:cephadm-wip-guits-testing-2022-01-18-1557-pacific-distro-default-smithi --description rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/gabrioux-2022-01-19_07:41:11-rados:cephadm-wip-guits-testing-2022-01-18-1557-pacific-distro-default-smithi/6626450/orig.config.yaml
2022-01-19T07:50:55.102 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-01-19_07:41:11-rados:cephadm-wip-guits-testing-2022-01-18-1557-pacific-distro-default-smithi/6626450
2022-01-19T07:50:55.103 INFO:teuthology.dispatcher.supervisor:Job PID: 11447
2022-01-19T07:50:55.103 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-19T14:21:24.600 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-19T14:21:24.753 INFO:teuthology.kill:Killing Pids: {11447}
2022-01-19T14:21:25.981 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-19T14:21:25.982 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-19T14:21:25.983 INFO:teuthology.misc:Compressing logs...
2022-01-19T14:21:25.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2022-01-19T14:21:26.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2022-01-19T14:21:26.236 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-19T14:21:26.491 INFO:teuthology.orchestra.run.smithi170.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-19T14:21:26.533 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-19T14:21:26.534 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now
2022-01-19T14:21:26.567 INFO:teuthology.orchestra.run.smithi170.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-19T14:21:26.567 INFO:teuthology.orchestra.run.smithi170.stderr:tar: Error is not recoverable: exiting now
2022-01-19T14:21:26.568 INFO:teuthology.misc:Compressing logs...
2022-01-19T14:21:26.815 INFO:teuthology.misc:Compressing logs...
2022-01-19T14:21:38.075 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/d582fdae-78fd-11ec-8c34-001a4aab830c/ceph-mon.smithi134.log: file size changed while zipping
2022-01-19T14:21:55.134 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/d582fdae-78fd-11ec-8c34-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-19T14:22:03.202 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/d582fdae-78fd-11ec-8c34-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-19T14:22:20.726 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/d582fdae-78fd-11ec-8c34-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-19T14:22:27.501 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/d582fdae-78fd-11ec-8c34-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-19T14:22:31.813 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/d582fdae-78fd-11ec-8c34-001a4aab830c/ceph-mgr.smithi134.sjolgz.log: file size changed while zipping
2022-01-19T14:22:40.896 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/d582fdae-78fd-11ec-8c34-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-19T14:22:44.288 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/d582fdae-78fd-11ec-8c34-001a4aab830c/ceph-mon.smithi170.log: file size changed while zipping
2022-01-19T14:22:50.131 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/d582fdae-78fd-11ec-8c34-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-19T14:23:06.080 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/d582fdae-78fd-11ec-8c34-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-19T14:23:15.620 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/d582fdae-78fd-11ec-8c34-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-19T14:23:57.920 INFO:teuthology.kill:No teuthology processes running
2022-01-19T14:23:59.107 INFO:teuthology.kill:Nuking machines: ['smithi134', 'smithi170']
2022-01-19T14:24:00.113 INFO:teuthology.kill:2022-01-19 14:24:00,108.108 INFO:teuthology.nuke:targets:
2022-01-19T14:24:00.114 INFO:teuthology.kill:  smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVJ1L+B4NOkI41GKQnedIY6X+/I16K5WbMqGq/nMhrPg2WpPkSTWU8yOsvQQkm48xocyHgmmaI4ayEBR2nQoZAciOuoyXULizFr8TwgCjTVsHOZ0RmLt0TanDWIWnGVeKzHVUvC+Eb4r6UH8DFydEmNPObNTdCEdeds/hMrGv9bsAVO1kDDmnHLRUOovAyohwZgmJAhOkA7zFIjKGuYH6dyTb54GMTQbSN9uYyyzuYwqeO9WaUq7TYmDOhpvwEL5+120whYEWcOVF3XNsSZyI4CxCQV14m3aIRcFkueD8T/oYBrAbJT45Jf8DUyt8bsToJJoUhozLMXntmiYh3/CZKRcc/MzAzsd00ghgLFE0A92xf+6bNg5qZcDxZRStLh2YexTb1h2qemcXdJjkxKH1HFPv03Vz/l/BFeUqXKHG4E1/6Kp6bQgSIt/1BAP6Qy/A1jPG9fR7ZChbeqsLW9NdYdbQchURPpDLZF3Kwvvu0F4zkyVJs/F96x+wgwBbzqKM=
2022-01-19T14:24:00.114 INFO:teuthology.kill:  smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsg+6fl6HLTFjt6eekDs7zETZQQSrOIO/CWkzo7owjI/1TkRIWgQmPKraAfv1nGPrSIBJ5mVH4ddbUCt5Qaze8Um/o+okZUCP23Xq4EQ8jtyXwBmuKxhkVxcNE6SEAulaM0I5wfqB2HmJbMao8X3CDJfqBz1/tnR0QJSh6M+DgSqIJ+7VW38z2eZaafq9L2XzyNIvcJlm5Er27NTFlj/mtVvU32YpSJ2TGU+T8qIch8M5WZxVOadIf3SC1GKmdH39H4w+iNlJ7NlvY2uhkHRYpDzh4t2zqjuV6mofG5zrlv0l0AUWVPJ4uyWy4YYrq8X8fRATsKcwxm/1BV8qPpiTHUtZNvD9tNjshXAyrYbfKAGKC7I5XmFzsNvFXP6ddTKxfaSMbb053d/TXLXdsiT8RrATKANEjSPvAAFK/ni8teBhYM0JnmMw7fVK1AVTBR7KvSa7+iZuWZNCIO3L9KfDfX83QLyjiPp2L6lOt4kFESKQV4zIXVolWW9ks9EbM99k=
2022-01-19T14:24:00.142 INFO:teuthology.kill:2022-01-19 14:24:00,142.142 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-19T14:24:00.146 INFO:teuthology.kill:2022-01-19 14:24:00,145.145 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-19T14:24:00.229 INFO:teuthology.kill:2022-01-19 14:24:00,229.229 INFO:teuthology.orchestra.console:Power off smithi170
2022-01-19T14:24:00.243 INFO:teuthology.kill:2022-01-19 14:24:00,242.242 INFO:teuthology.orchestra.console:Power off smithi134
2022-01-19T14:24:08.599 INFO:teuthology.kill:2022-01-19 14:24:08,599.599 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2022-01-19T14:24:08.753 INFO:teuthology.kill:2022-01-19 14:24:08,753.753 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com
2022-01-19T14:24:12.716 INFO:teuthology.kill:2022-01-19 14:24:12,716.716 INFO:teuthology.orchestra.console:Power off for smithi134 completed
2022-01-19T14:24:12.866 INFO:teuthology.kill:2022-01-19 14:24:12,866.866 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com
2022-01-19T14:26:13.176 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-19T14:26:13.276 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi134 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-18_22:38:16-rados-wip-yuri2-testing-2022-01-18-1151-pacific-distro-default-smithi/6625954
2022-01-19T14:26:13.277 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi170 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-18_22:38:16-rados-wip-yuri2-testing-2022-01-18-1151-pacific-distro-default-smithi/6625954