2022-01-17T11:12:02.559 INFO:root:teuthology version: 1.1.0-3ff86a5d
2022-01-17T11:12:02.672 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi067.front.sepia.ceph.com' reimaging
2022-01-17T11:12:02.673 INFO:teuthology.lock.ops:Updating [ubuntu@smithi067.front.sepia.ceph.com]: reset os type and version on server
2022-01-17T11:12:02.673 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2022-01-17T11:12:02.691 INFO:teuthology.lock.ops:Node 'ubuntu@smithi067.front.sepia.ceph.com' reimaging is complete
2022-01-17T11:12:02.692 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi188.front.sepia.ceph.com' reimaging
2022-01-17T11:12:02.692 INFO:teuthology.lock.ops:Updating [ubuntu@smithi188.front.sepia.ceph.com]: reset os type and version on server
2022-01-17T11:12:02.692 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2022-01-17T11:12:02.710 INFO:teuthology.lock.ops:Node 'ubuntu@smithi188.front.sepia.ceph.com' reimaging is complete
2022-01-17T11:12:02.920 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of centos 8.stream
2022-01-17T11:12:02.975 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 8.stream
2022-01-17T11:12:03.460 INFO:teuthology.orchestra.console:Power off smithi188
2022-01-17T11:12:03.499 INFO:teuthology.orchestra.console:Power off smithi067
2022-01-17T11:12:11.834 INFO:teuthology.orchestra.console:Power off for smithi188 completed
2022-01-17T11:12:11.935 INFO:teuthology.orchestra.console:Power on smithi188
2022-01-17T11:12:15.967 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2022-01-17T11:12:16.068 INFO:teuthology.orchestra.console:Power on smithi067
2022-01-17T11:12:20.297 INFO:teuthology.orchestra.console:Power on for smithi188 completed
2022-01-17T11:12:20.398 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish
2022-01-17T11:12:24.429 INFO:teuthology.orchestra.console:Power on for smithi067 completed
2022-01-17T11:12:24.530 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish
2022-01-17T11:17:10.763 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-17T11:17:11.044 INFO:teuthology.provision.fog.smithi188:Node is ready
2022-01-17T11:17:11.061 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com
2022-01-17T11:17:11.118 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188
2022-01-17T11:17:11.456 INFO:teuthology.provision.fog.smithi188:Deploy complete!
2022-01-17T11:17:29.896 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-17T11:17:30.153 INFO:teuthology.provision.fog.smithi067:Node is ready
2022-01-17T11:17:30.170 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067
2022-01-17T11:17:30.228 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067
2022-01-17T11:17:30.567 INFO:teuthology.provision.fog.smithi067:Deploy complete!
2022-01-17T11:17:30.714 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com
2022-01-17T11:17:30.715 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-17T11:17:30.737 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com
2022-01-17T11:17:30.738 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-17T11:17:30.756 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server
2022-01-17T11:17:30.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com'
2022-01-17T11:17:30.945 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64
2022-01-17T11:17:31.003 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream"
2022-01-17T11:17:31.004 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8"
2022-01-17T11:17:31.004 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos"
2022-01-17T11:17:31.004 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora"
2022-01-17T11:17:31.005 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8"
2022-01-17T11:17:31.005 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8"
2022-01-17T11:17:31.005 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-17T11:17:31.006 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31"
2022-01-17T11:17:31.006 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-17T11:17:31.006 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/"
2022-01-17T11:17:31.007 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-17T11:17:31.007 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-17T11:17:31.007 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-17T11:17:31.008 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2022-01-17T11:17:31.027 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server
2022-01-17T11:17:31.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com'
2022-01-17T11:17:31.267 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64
2022-01-17T11:17:31.323 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream"
2022-01-17T11:17:31.324 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8"
2022-01-17T11:17:31.324 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos"
2022-01-17T11:17:31.324 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora"
2022-01-17T11:17:31.324 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8"
2022-01-17T11:17:31.325 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8"
2022-01-17T11:17:31.325 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-17T11:17:31.325 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2022-01-17T11:17:31.325 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-17T11:17:31.326 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/"
2022-01-17T11:17:31.326 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-17T11:17:31.326 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-17T11:17:31.326 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-17T11:17:31.327 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2022-01-17T11:17:31.432 INFO:teuthology.dispatcher.supervisor:Running job 6621959
2022-01-17T11:17:31.432 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-01-17_10:41:45-rados:cephadm-wip-guits-testing-qa-cv-err-pacific-distro-default-smithi/6621959 --name gabrioux-2022-01-17_10:41:45-rados:cephadm-wip-guits-testing-qa-cv-err-pacific-distro-default-smithi --description rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/gabrioux-2022-01-17_10:41:45-rados:cephadm-wip-guits-testing-qa-cv-err-pacific-distro-default-smithi/6621959/orig.config.yaml
2022-01-17T11:17:31.436 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-01-17_10:41:45-rados:cephadm-wip-guits-testing-qa-cv-err-pacific-distro-default-smithi/6621959
2022-01-17T11:17:31.436 INFO:teuthology.dispatcher.supervisor:Job PID: 5454
2022-01-17T11:17:31.437 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-17T17:48:00.556 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-17T17:48:00.748 INFO:teuthology.kill:Killing Pids: {5454}
2022-01-17T17:48:01.957 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-17T17:48:01.958 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-17T17:48:01.959 INFO:teuthology.misc:Compressing logs...
2022-01-17T17:48:01.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com'
2022-01-17T17:48:02.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com'
2022-01-17T17:48:02.211 INFO:teuthology.orchestra.run.smithi067.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-17T17:48:02.403 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-17T17:48:02.447 INFO:teuthology.orchestra.run.smithi067.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-17T17:48:02.447 INFO:teuthology.orchestra.run.smithi067.stderr:tar: Error is not recoverable: exiting now
2022-01-17T17:48:02.486 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-17T17:48:02.487 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now
2022-01-17T17:48:02.488 INFO:teuthology.misc:Compressing logs...
2022-01-17T17:48:02.898 INFO:teuthology.misc:Compressing logs...
2022-01-17T17:48:15.401 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/48faa272-7788-11ec-8c34-001a4aab830c/ceph-mon.smithi067.log: file size changed while zipping
2022-01-17T17:48:23.100 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/48faa272-7788-11ec-8c34-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-17T17:48:35.039 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/48faa272-7788-11ec-8c34-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-17T17:48:39.789 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/48faa272-7788-11ec-8c34-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-17T17:48:51.544 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/48faa272-7788-11ec-8c34-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-17T17:48:55.783 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/48faa272-7788-11ec-8c34-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-17T17:49:02.913 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/48faa272-7788-11ec-8c34-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-17T17:49:08.094 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/48faa272-7788-11ec-8c34-001a4aab830c/ceph-mgr.smithi067.niqrtx.log: file size changed while zipping
2022-01-17T17:49:10.000 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/48faa272-7788-11ec-8c34-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-17T17:49:13.503 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/48faa272-7788-11ec-8c34-001a4aab830c/ceph-mon.smithi188.log: file size changed while zipping
2022-01-17T17:49:26.706 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/48faa272-7788-11ec-8c34-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-17T17:49:44.332 INFO:teuthology.orchestra.run.smithi067.stderr:tar: .: file changed as we read it
2022-01-17T17:49:58.674 INFO:teuthology.kill:No teuthology processes running
2022-01-17T17:49:59.791 INFO:teuthology.kill:Nuking machines: ['smithi067', 'smithi188']
2022-01-17T17:50:00.705 INFO:teuthology.kill:2022-01-17 17:50:00,704.704 INFO:teuthology.nuke:targets:
2022-01-17T17:50:00.705 INFO:teuthology.kill:  smithi067.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqo0n6WAnIlIhO1ceV7+dAyg6Sw5y/boVVDgvn5zYQkQipifGNwJUOuB+vT88RFJz088DEwty21q+KD4qQC7HiJPApPyAWQFkAzeHNYX2uFI7uYwoY5D3dmi4Br8iL+yOefkxgPki/AS3KAFiKccdg5ocJJVkjX1CrMzXMHzlQ/N8ZdvFb6DLHn8vCw6owc+0xqLqfI5jummGXIhq3FAnux1PRhagthURsRDOBYq4t7FYscvM1o+sFk+Q4svUaczWYj3vXOUhou8JUoc0rHj1opQ/OdbPDdChNvrfUrNdaFtT/qkrHC39l34VmfGrteiNbqnVQqckTOUlKYsvzRVPkld7yiq/bHEfroNFzxl27zePd+fuLUi5N4NTP4wUBjghoddOnBiMczYnDzjuZ4n9WiQ+sCt7sOyHjYMU8K3t6AJy5jBjnnFtRvrtuw8OaIQzan89lEqCf2CS2tT4vDq5Cf809uzp98oNIUTnkpCxNgcSk1rVyAS1q2LY2y2E+hP0=
2022-01-17T17:50:00.706 INFO:teuthology.kill:  smithi188.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs0U4ZJJBXJnp/14GC6sng6CrUMr63C+YxWpzklAAuKcYIVMtfLTYvCaoEH5sVGXg2LYQPjRySn2Oocawagg+O+28pZYNWT3D3SndnGazMU0wyqLjz7BZfyHdakAHOfRYRBkWIOJTOlMjcnf0bLX9jxCKYlOHPjQPIaM2ChtlOrICwSdqnwoMkwbAQaBZxHt/l3vEfFX18aTf3VjvFE0ogbIkHYbbOvWfJgCc2PMDQoES0bGuQlDKqiEPVTuw+NpffR5+fEOPv2vIdFIUhRSvC4/2JQUCr9b0IcfAvbnHN40tSAhAzlH2UPJMWHtDoPjHvhFKnUNkc6uIARg/47O8wuWBXt+5m9lltqr6pXOMr3iAMqXo233gz1qYROgkzk6fweSgbw3xmwhIwooGVZtCSse46LZ3dN+Zonc6e6ZE9cxwjj5JU27KHaWM6GPewKd/YqsTWu+pf0Xe2EHsToMSBApU6vzZjWesfietmQyiLQY0XuGiH5uv0QDp6faD/WRs=
2022-01-17T17:50:00.738 INFO:teuthology.kill:2022-01-17 17:50:00,737.737 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-17T17:50:00.747 INFO:teuthology.kill:2022-01-17 17:50:00,747.747 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-17T17:50:00.809 INFO:teuthology.kill:2022-01-17 17:50:00,809.809 INFO:teuthology.orchestra.console:Power off smithi067
2022-01-17T17:50:00.823 INFO:teuthology.kill:2022-01-17 17:50:00,823.823 INFO:teuthology.orchestra.console:Power off smithi188
2022-01-17T17:50:09.177 INFO:teuthology.kill:2022-01-17 17:50:09,176.176 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2022-01-17T17:50:09.323 INFO:teuthology.kill:2022-01-17 17:50:09,322.322 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com
2022-01-17T17:50:13.300 INFO:teuthology.kill:2022-01-17 17:50:13,300.300 INFO:teuthology.orchestra.console:Power off for smithi188 completed
2022-01-17T17:50:13.446 INFO:teuthology.kill:2022-01-17 17:50:13,446.446 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com
2022-01-17T17:52:13.760 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-17T17:52:13.859 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi067 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-17_17:05:17-rados-wip-yuri6-testing-2022-01-14-1207-distro-default-smithi/6622548
2022-01-17T17:52:13.860 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi188 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-17_17:05:17-rados-wip-yuri6-testing-2022-01-14-1207-distro-default-smithi/6622548