2022-02-06T16:13:25.210 INFO:root:teuthology version: 1.1.0-3094160c
2022-02-06T16:13:25.346 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging
2022-02-06T16:13:25.347 INFO:teuthology.lock.ops:Updating [ubuntu@smithi029.front.sepia.ceph.com]: reset os type and version on server
2022-02-06T16:13:25.347 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2022-02-06T16:13:25.372 INFO:teuthology.lock.ops:Node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging is complete
2022-02-06T16:13:25.373 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi109.front.sepia.ceph.com' reimaging
2022-02-06T16:13:25.373 INFO:teuthology.lock.ops:Updating [ubuntu@smithi109.front.sepia.ceph.com]: reset os type and version on server
2022-02-06T16:13:25.374 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server
2022-02-06T16:13:25.398 INFO:teuthology.lock.ops:Node 'ubuntu@smithi109.front.sepia.ceph.com' reimaging is complete
2022-02-06T16:13:25.622 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 8.stream
2022-02-06T16:13:25.660 INFO:teuthology.provision.fog.smithi109:Scheduling deploy of centos 8.stream
2022-02-06T16:13:26.123 INFO:teuthology.orchestra.console:Power off smithi029
2022-02-06T16:13:26.142 INFO:teuthology.orchestra.console:Power off smithi109
2022-02-06T16:13:34.502 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2022-02-06T16:13:34.509 INFO:teuthology.orchestra.console:Power off for smithi109 completed
2022-02-06T16:13:34.603 INFO:teuthology.orchestra.console:Power on smithi029
2022-02-06T16:13:34.612 INFO:teuthology.orchestra.console:Power on smithi109
2022-02-06T16:13:42.976 INFO:teuthology.orchestra.console:Power on for smithi029 completed
2022-02-06T16:13:43.033 INFO:teuthology.orchestra.console:Power on for smithi109 completed
2022-02-06T16:13:43.077 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2022-02-06T16:13:43.134 INFO:teuthology.provision.fog.smithi109:Waiting for deploy to finish
2022-02-06T16:18:24.143 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-06T16:18:24.435 INFO:teuthology.provision.fog.smithi109:Node is ready
2022-02-06T16:18:24.455 INFO:teuthology.orchestra.run.smithi109.stdout:smithi109.front.sepia.ceph.com
2022-02-06T16:18:24.521 INFO:teuthology.orchestra.run.smithi109.stdout:172.21.15.109 smithi109.front.sepia.ceph.com smithi109
2022-02-06T16:18:24.911 INFO:teuthology.provision.fog.smithi109:Deploy complete!
2022-02-06T16:18:30.299 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-06T16:18:30.597 INFO:teuthology.provision.fog.smithi029:Node is ready
2022-02-06T16:18:30.616 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2022-02-06T16:18:30.675 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2022-02-06T16:18:31.049 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2022-02-06T16:18:31.263 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2022-02-06T16:18:31.264 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-06T16:18:31.284 INFO:teuthology.lock.ops:Checking smithi109.front.sepia.ceph.com
2022-02-06T16:18:31.284 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-06T16:18:31.303 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2022-02-06T16:18:31.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2022-02-06T16:18:31.495 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2022-02-06T16:18:31.554 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream"
2022-02-06T16:18:31.555 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8"
2022-02-06T16:18:31.556 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos"
2022-02-06T16:18:31.556 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora"
2022-02-06T16:18:31.556 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8"
2022-02-06T16:18:31.556 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8"
2022-02-06T16:18:31.557 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-06T16:18:31.557 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2022-02-06T16:18:31.557 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-06T16:18:31.557 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/"
2022-02-06T16:18:31.558 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-06T16:18:31.558 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-06T16:18:31.558 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-06T16:18:31.559 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2022-02-06T16:18:31.585 INFO:teuthology.lock.ops:Updating [smithi109.front.sepia.ceph.com]: set os type and version on server
2022-02-06T16:18:31.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com'
2022-02-06T16:18:31.786 INFO:teuthology.orchestra.run.smithi109.stdout:x86_64
2022-02-06T16:18:31.846 INFO:teuthology.orchestra.run.smithi109.stdout:NAME="CentOS Stream"
2022-02-06T16:18:31.846 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION="8"
2022-02-06T16:18:31.846 INFO:teuthology.orchestra.run.smithi109.stdout:ID="centos"
2022-02-06T16:18:31.847 INFO:teuthology.orchestra.run.smithi109.stdout:ID_LIKE="rhel fedora"
2022-02-06T16:18:31.848 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION_ID="8"
2022-02-06T16:18:31.848 INFO:teuthology.orchestra.run.smithi109.stdout:PLATFORM_ID="platform:el8"
2022-02-06T16:18:31.848 INFO:teuthology.orchestra.run.smithi109.stdout:PRETTY_NAME="CentOS Stream 8"
2022-02-06T16:18:31.848 INFO:teuthology.orchestra.run.smithi109.stdout:ANSI_COLOR="0;31"
2022-02-06T16:18:31.849 INFO:teuthology.orchestra.run.smithi109.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-02-06T16:18:31.849 INFO:teuthology.orchestra.run.smithi109.stdout:HOME_URL="https://centos.org/"
2022-02-06T16:18:31.849 INFO:teuthology.orchestra.run.smithi109.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-06T16:18:31.849 INFO:teuthology.orchestra.run.smithi109.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-06T16:18:31.850 INFO:teuthology.orchestra.run.smithi109.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-02-06T16:18:31.850 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server
2022-02-06T16:18:31.943 INFO:teuthology.dispatcher.supervisor:Running job 6665070
2022-02-06T16:18:31.943 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3094160cc590b786a43d55faaf7c99d5de71ce56/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-02-06_16:04:09-rados-wip-yuri2-testing-2022-02-04-1646-pacific-distro-default-smithi/6665070 --name yuriw-2022-02-06_16:04:09-rados-wip-yuri2-testing-2022-02-04-1646-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/yuriw-2022-02-06_16:04:09-rados-wip-yuri2-testing-2022-02-04-1646-pacific-distro-default-smithi/6665070/orig.config.yaml
2022-02-06T16:18:31.947 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-02-06_16:04:09-rados-wip-yuri2-testing-2022-02-04-1646-pacific-distro-default-smithi/6665070
2022-02-06T16:18:31.948 INFO:teuthology.dispatcher.supervisor:Job PID: 2632
2022-02-06T16:18:31.948 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-06T22:49:00.767 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-06T22:49:00.933 INFO:teuthology.kill:Killing Pids: {2632}
2022-02-06T22:49:02.135 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-02-06T22:49:02.136 INFO:teuthology.task.internal:roles: ubuntu@smithi109.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-02-06T22:49:02.136 INFO:teuthology.misc:Compressing logs...
2022-02-06T22:49:02.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2022-02-06T22:49:02.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com'
2022-02-06T22:49:02.384 INFO:teuthology.orchestra.run.smithi029.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-02-06T22:49:02.568 INFO:teuthology.orchestra.run.smithi109.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-02-06T22:49:02.645 INFO:teuthology.orchestra.run.smithi029.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-02-06T22:49:02.645 INFO:teuthology.orchestra.run.smithi029.stderr:tar: Error is not recoverable: exiting now
2022-02-06T22:49:02.692 INFO:teuthology.orchestra.run.smithi109.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-02-06T22:49:02.693 INFO:teuthology.orchestra.run.smithi109.stderr:tar: Error is not recoverable: exiting now
2022-02-06T22:49:02.694 INFO:teuthology.misc:Compressing logs...
2022-02-06T22:49:03.011 INFO:teuthology.misc:Compressing logs...
2022-02-06T22:49:26.779 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/dd13a7de-8768-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-02-06T22:49:27.198 INFO:teuthology.orchestra.run.smithi109.stderr:gzip: /var/log/ceph/dd13a7de-8768-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-02-06T22:49:29.466 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/dd13a7de-8768-11ec-8c35-001a4aab830c/ceph-mgr.smithi029.yuspkm.log: file size changed while zipping
2022-02-06T22:49:30.582 INFO:teuthology.orchestra.run.smithi109.stderr:gzip: /var/log/ceph/dd13a7de-8768-11ec-8c35-001a4aab830c/ceph-mon.smithi109.log: file size changed while zipping
2022-02-06T22:49:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/dd13a7de-8768-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-02-06T22:49:58.567 INFO:teuthology.orchestra.run.smithi109.stderr:gzip: /var/log/ceph/dd13a7de-8768-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-02-06T22:49:59.131 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/dd13a7de-8768-11ec-8c35-001a4aab830c/ceph-mon.smithi029.log: file size changed while zipping
2022-02-06T22:50:18.692 INFO:teuthology.orchestra.run.smithi109.stderr:gzip: /var/log/ceph/dd13a7de-8768-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-02-06T22:50:26.644 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/dd13a7de-8768-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-02-06T22:50:40.460 INFO:teuthology.orchestra.run.smithi109.stderr:gzip: /var/log/ceph/dd13a7de-8768-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-02-06T22:50:54.038 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/dd13a7de-8768-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-02-06T22:51:15.668 INFO:teuthology.orchestra.run.smithi029.stderr:tar: .: file changed as we read it
2022-02-06T22:51:35.198 INFO:teuthology.kill:No teuthology processes running
2022-02-06T22:51:36.348 INFO:teuthology.kill:Nuking machines: ['smithi029', 'smithi109']
2022-02-06T22:51:37.313 INFO:teuthology.kill:2022-02-06 22:51:37,312.312 INFO:teuthology.nuke:targets:
2022-02-06T22:51:37.313 INFO:teuthology.kill:  smithi029.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcZi/NWhCG3kIPAd3t/kx3YUIAKqNTHIMTdgg2yJnk/b1ISVAqJ2F8Myd5xLo5gq6aleqiJfi9MQHv97fmqTRp8m/riLcJadiE3J19XbqA61btjJCS8/MqA37pwh1Z4JXGp50bav4tVuXN7sjmeW1fqdKAq2wO5Bf0J1NGF9wTR4F1+JEHeMfTGpr+WlCrVMjhfMJY8BW3hWwY5aJdXn3Z3H9ehMrzsdxzda7SoIaCOjE8nsplTUrHOPzLP77SQy4fx/x0208D7U3KCvbiLhj2c6gMw+MMmZdoEgIC3zf/6gSys39CkWjFSe2BMwyKmjjaNJvah62ITbLjYDor45SNLnkDDTk7IHneNUIF/7qcHIafAOA2CJZzttdSO2kWnc2/7KG5Ri1mtMsbkcNVI0Q0aibsWlWguwUx67ujf4xR00HTUEoxZPyBECxn4qquJPxAByGs9xCj7Uv/q/UrRA/p13dSbxqNFx/+KjEYmCb+/sxXxq4frmeu/PueBux5Q2s=
2022-02-06T22:51:37.314 INFO:teuthology.kill:  smithi109.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1A8oCOnJqRSftKdH02pWilbu+A03VH5h5Jb/3xW66w3LTrNhwySs/uDjhDiE5sL+sqWDmg8Dy6vW66Nh7Cqtg+PUx0Qhy1pmQlaoSIznZUsg4/voA6W06Qm9ZbFoPG+atEvmAL2m2F3v0ADSpysEH95VBYpL7lf1ExASv0FR1a5euo16JYNnTcA9eNCJKpMRdiL57h4AlddSc+isSeckMYuJy+geXyo9hGjRZAHZp1WKXeEG36VsnpfIsKOffLZ7C/Yl8JIFn+79eqVwI5CZaQYjK7MvFluLyOJCr9koFEpLDNIS44Rr7PNNlJhkCrOYB+Hw1ZSvo2LIP0AAk5E3QHfVO0VPJKF6PYkZmiiJpz/M9veKHVnNe0+MSpqfvutqDtG2MSG+qgCV/YER3oKf0d5L1vTmtjda0nvFLOxu8RC463y9BEuTkeoJfmEE+KE0oqxnucnIXL5GxvJYZKBvFpiN+gmZ4M673q/44nRxHK4W63kwKqpRks8P2iJLFTfc=
2022-02-06T22:51:37.340 INFO:teuthology.kill:2022-02-06 22:51:37,340.340 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-06T22:51:37.343 INFO:teuthology.kill:2022-02-06 22:51:37,343.343 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-06T22:51:37.422 INFO:teuthology.kill:2022-02-06 22:51:37,421.421 INFO:teuthology.orchestra.console:Power off smithi109
2022-02-06T22:51:37.435 INFO:teuthology.kill:2022-02-06 22:51:37,435.435 INFO:teuthology.orchestra.console:Power off smithi029
2022-02-06T22:51:49.904 INFO:teuthology.kill:2022-02-06 22:51:49,903.903 INFO:teuthology.orchestra.console:Power off for smithi109 completed
2022-02-06T22:51:49.910 INFO:teuthology.kill:2022-02-06 22:51:49,910.910 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2022-02-06T22:51:50.054 INFO:teuthology.kill:2022-02-06 22:51:50,053.053 INFO:teuthology.lock.ops:unlocked: smithi109.front.sepia.ceph.com
2022-02-06T22:51:50.057 INFO:teuthology.kill:2022-02-06 22:51:50,057.057 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com
2022-02-06T22:53:50.371 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15