2022-01-24T22:47:32.240 INFO:root:teuthology version: 1.1.0-7c0cb867
2022-01-24T22:47:32.367 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi057.front.sepia.ceph.com' reimaging
2022-01-24T22:47:32.368 INFO:teuthology.lock.ops:Updating [ubuntu@smithi057.front.sepia.ceph.com]: reset os type and version on server
2022-01-24T22:47:32.369 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2022-01-24T22:47:32.386 INFO:teuthology.lock.ops:Node 'ubuntu@smithi057.front.sepia.ceph.com' reimaging is complete
2022-01-24T22:47:32.387 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi132.front.sepia.ceph.com' reimaging
2022-01-24T22:47:32.387 INFO:teuthology.lock.ops:Updating [ubuntu@smithi132.front.sepia.ceph.com]: reset os type and version on server
2022-01-24T22:47:32.387 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2022-01-24T22:47:32.406 INFO:teuthology.lock.ops:Node 'ubuntu@smithi132.front.sepia.ceph.com' reimaging is complete
2022-01-24T22:47:32.600 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of centos 8.stream
2022-01-24T22:47:32.622 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 8.stream
2022-01-24T22:47:33.035 INFO:teuthology.orchestra.console:Power off smithi057
2022-01-24T22:47:33.117 INFO:teuthology.orchestra.console:Power off smithi132
2022-01-24T22:47:41.478 INFO:teuthology.orchestra.console:Power off for smithi132 completed
2022-01-24T22:47:41.579 INFO:teuthology.orchestra.console:Power on smithi132
2022-01-24T22:47:45.515 INFO:teuthology.orchestra.console:Power off for smithi057 completed
2022-01-24T22:47:45.616 INFO:teuthology.orchestra.console:Power on smithi057
2022-01-24T22:47:49.872 INFO:teuthology.orchestra.console:Power on for smithi057 completed
2022-01-24T22:47:49.942 INFO:teuthology.orchestra.console:Power on for smithi132 completed
2022-01-24T22:47:49.974 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish
2022-01-24T22:47:50.042 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish
2022-01-24T22:52:22.206 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-24T22:52:22.284 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-24T22:52:22.485 INFO:teuthology.provision.fog.smithi057:Node is ready
2022-01-24T22:52:22.502 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com
2022-01-24T22:52:22.557 INFO:teuthology.provision.fog.smithi132:Node is ready
2022-01-24T22:52:22.559 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057
2022-01-24T22:52:22.573 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com
2022-01-24T22:52:22.629 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132
2022-01-24T22:52:22.893 INFO:teuthology.provision.fog.smithi057:Deploy complete!
2022-01-24T22:52:22.957 INFO:teuthology.provision.fog.smithi132:Deploy complete!
2022-01-24T22:52:23.115 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com
2022-01-24T22:52:23.116 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-24T22:52:23.134 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com
2022-01-24T22:52:23.134 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-24T22:52:23.152 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server
2022-01-24T22:52:23.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com'
2022-01-24T22:52:23.344 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64
2022-01-24T22:52:23.401 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream"
2022-01-24T22:52:23.401 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8"
2022-01-24T22:52:23.402 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos"
2022-01-24T22:52:23.402 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora"
2022-01-24T22:52:23.402 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8"
2022-01-24T22:52:23.403 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8"
2022-01-24T22:52:23.403 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-24T22:52:23.403 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31"
2022-01-24T22:52:23.404 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-24T22:52:23.404 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/"
2022-01-24T22:52:23.404 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-24T22:52:23.404 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-24T22:52:23.404 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-24T22:52:23.406 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2022-01-24T22:52:23.423 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server
2022-01-24T22:52:23.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com'
2022-01-24T22:52:23.605 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64
2022-01-24T22:52:23.660 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream"
2022-01-24T22:52:23.661 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8"
2022-01-24T22:52:23.661 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos"
2022-01-24T22:52:23.661 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora"
2022-01-24T22:52:23.662 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8"
2022-01-24T22:52:23.662 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2022-01-24T22:52:23.662 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8"
2022-01-24T22:52:23.662 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2022-01-24T22:52:23.662 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-01-24T22:52:23.663 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/"
2022-01-24T22:52:23.663 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-24T22:52:23.663 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-24T22:52:23.663 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-01-24T22:52:23.664 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2022-01-24T22:52:23.757 INFO:teuthology.dispatcher.supervisor:Running job 6638252
2022-01-24T22:52:23.758 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-24_17:43:02-rados-wip-yuri2-testing-2022-01-21-0949-pacific-distro-default-smithi/6638252 --name yuriw-2022-01-24_17:43:02-rados-wip-yuri2-testing-2022-01-21-0949-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2022-01-24_17:43:02-rados-wip-yuri2-testing-2022-01-21-0949-pacific-distro-default-smithi/6638252/orig.config.yaml
2022-01-24T22:52:23.761 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-24_17:43:02-rados-wip-yuri2-testing-2022-01-21-0949-pacific-distro-default-smithi/6638252
2022-01-24T22:52:23.762 INFO:teuthology.dispatcher.supervisor:Job PID: 18038
2022-01-24T22:52:23.762 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-25T05:22:53.609 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-25T05:22:53.813 INFO:teuthology.kill:Killing Pids: {18038}
2022-01-25T05:22:55.065 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-01-25T05:22:55.065 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-01-25T05:22:55.066 INFO:teuthology.misc:Compressing logs...
2022-01-25T05:22:55.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com'
2022-01-25T05:22:55.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com'
2022-01-25T05:22:55.292 INFO:teuthology.orchestra.run.smithi057.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-25T05:22:55.493 INFO:teuthology.orchestra.run.smithi132.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-25T05:22:55.544 INFO:teuthology.orchestra.run.smithi057.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-25T05:22:55.544 INFO:teuthology.orchestra.run.smithi057.stderr:tar: Error is not recoverable: exiting now
2022-01-25T05:22:55.604 INFO:teuthology.orchestra.run.smithi132.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-25T05:22:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:tar: Error is not recoverable: exiting now
2022-01-25T05:22:55.606 INFO:teuthology.misc:Compressing logs...
2022-01-25T05:22:55.872 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-01-25T05:22:56.029 INFO:teuthology.misc:Compressing logs...
2022-01-25T05:22:57.699 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/730336a6-7d69-11ec-8c35-001a4aab830c/ceph-mgr.smithi057.nwjafa.log: file size changed while zipping
2022-01-25T05:22:59.453 INFO:teuthology.orchestra.run.smithi132.stderr:gzip: /var/log/ceph/730336a6-7d69-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-25T05:23:01.670 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/730336a6-7d69-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-25T05:23:02.391 INFO:teuthology.orchestra.run.smithi132.stderr:gzip: /var/log/ceph/730336a6-7d69-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-25T05:23:04.774 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/730336a6-7d69-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-25T05:23:05.711 INFO:teuthology.orchestra.run.smithi132.stderr:gzip: /var/log/ceph/730336a6-7d69-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-25T05:23:07.232 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/730336a6-7d69-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-25T05:23:08.421 INFO:teuthology.orchestra.run.smithi132.stderr:gzip: /var/log/ceph/730336a6-7d69-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-25T05:23:09.457 INFO:teuthology.orchestra.run.smithi132.stderr:gzip: /var/log/ceph/730336a6-7d69-11ec-8c35-001a4aab830c/ceph-mon.smithi132.log: file size changed while zipping
2022-01-25T05:23:11.084 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/730336a6-7d69-11ec-8c35-001a4aab830c/ceph-mon.smithi057.log: file size changed while zipping
2022-01-25T05:23:15.046 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/730336a6-7d69-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-25T05:23:54.982 INFO:teuthology.kill:No teuthology processes running
2022-01-25T05:23:56.162 INFO:teuthology.kill:Nuking machines: ['smithi057', 'smithi132']
2022-01-25T05:23:57.188 INFO:teuthology.kill:2022-01-25 05:23:57,187.187 INFO:teuthology.nuke:targets:
2022-01-25T05:23:57.188 INFO:teuthology.kill:  smithi057.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmRB0YviA6JTMiPwohFl0/R5emgyzCxSKltaK6WSjJs/0F1uxoq297p4BFNNSIOR1EdDEmjRPg3v5CPHd4snFlSvnRHb7K0dLWWspsbPqEOxZKGwzGLDPtp5jqez8ixWtNiNf+1ZIvB+9XWbPHXINzOSqRN/7UEG9QRW/4hOjVzzRlzdIEui+TsAU4jdcZnQVOrTnazqCvjadDNMxTT4Rd4ZusQjGO3fE538rXZ91PKmB9cfmOvFdF6BcvS0+5V+FulqHJpzn/yW+LXlF+EIn880aX+6l5AzJV5Pi1UkLkHu95vrtP75LxOgnE8G1NFIgJsqLUuYnJj3RHkY+AxeglGaUzYZ6lOKRnOxZf8qn8jBW0ymkJOOY0bPjFg9Sh3OtiBLYm+fLncGRvqDW24jkw3Mi5ctjZRyHDEUKJilf2XxiuQi6mmT6Fju/aWI+MI9tlbcjRydjZkjX/g0ZbwCcPLsG+LtLz/t+g8ribweLT/vppKavk/t+Q7Yq5Qc4yNGc=
2022-01-25T05:23:57.189 INFO:teuthology.kill:  smithi132.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBmYPfDHTB0DQgdQMkngrb2IlxHMzMf+xgGg84GFAyf8kAL762Qq3VKQgcA6MZ5MBjY5U7xRhQSoaRC5swyB9FCBgN88WURlKfmvkXvF2HJ5CWIUjJ+UegyXrfnapKuHS8/znxdTqg64BRwVLd1XSofj6m0JP7S14Ux4D/7TnAwIWWuavdDchDQbJStlsFTQsbRD0LgVoCNENUykUdDinDqZdvPH3NgLYbyfY6IqTg+RCmE3w+kTheBTjbr7bIwjl+0DWGaVap6iFmP7MUgru9XDv614XoT6uIYtMBnl/suji3SL+RzOjXTc348y4zy7omKuA9Vp0gK8Dys5Yd1SpYyucMsYb91RdcfwuTrayG33Ves5XbSOEWMwJCoIelAFWVvgOgRnUPMWyfxzjnn3E4vSM75sOhy/kG8BJaGFRxH7VjUUTiwQXmmgIr2e+8UONaJVV2bkj8Ui61NIVdjaqzinL++Ds2eyT+wQyEeQ8mldy395W9OgPSTCC5BPlfHjs=
2022-01-25T05:23:57.214 INFO:teuthology.kill:2022-01-25 05:23:57,214.214 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-25T05:23:57.222 INFO:teuthology.kill:2022-01-25 05:23:57,221.221 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-25T05:23:57.296 INFO:teuthology.kill:2022-01-25 05:23:57,296.296 INFO:teuthology.orchestra.console:Power off smithi132
2022-01-25T05:23:57.310 INFO:teuthology.kill:2022-01-25 05:23:57,310.310 INFO:teuthology.orchestra.console:Power off smithi057
2022-01-25T05:24:05.674 INFO:teuthology.kill:2022-01-25 05:24:05,673.673 INFO:teuthology.orchestra.console:Power off for smithi132 completed
2022-01-25T05:24:05.682 INFO:teuthology.kill:2022-01-25 05:24:05,682.682 INFO:teuthology.orchestra.console:Power off for smithi057 completed
2022-01-25T05:24:05.824 INFO:teuthology.kill:2022-01-25 05:24:05,824.824 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com
2022-01-25T05:24:05.834 INFO:teuthology.kill:2022-01-25 05:24:05,834.834 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com
2022-01-25T05:26:06.161 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-25T05:26:06.257 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi057 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-25_03:40:28-rados-wip-yuri4-testing-2022-01-24-1706-pacific-distro-default-smithi/6639190
2022-01-25T05:26:06.257 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi132 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-25_03:40:28-rados-wip-yuri4-testing-2022-01-24-1706-pacific-distro-default-smithi/6639192