2022-03-02T05:26:17.936 INFO:root:teuthology version: 1.1.0-cb5b1a75
2022-03-02T05:26:18.055 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging
2022-03-02T05:26:18.057 INFO:teuthology.lock.ops:Updating [ubuntu@smithi082.front.sepia.ceph.com]: reset os type and version on server
2022-03-02T05:26:18.057 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server
2022-03-02T05:26:18.076 INFO:teuthology.lock.ops:Node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging is complete
2022-03-02T05:26:18.077 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi090.front.sepia.ceph.com' reimaging
2022-03-02T05:26:18.077 INFO:teuthology.lock.ops:Updating [ubuntu@smithi090.front.sepia.ceph.com]: reset os type and version on server
2022-03-02T05:26:18.077 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2022-03-02T05:26:18.095 INFO:teuthology.lock.ops:Node 'ubuntu@smithi090.front.sepia.ceph.com' reimaging is complete
2022-03-02T05:26:18.285 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of ubuntu 18.04
2022-03-02T05:26:18.298 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of ubuntu 18.04
2022-03-02T05:26:18.612 INFO:teuthology.orchestra.console:Power off smithi090
2022-03-02T05:26:18.628 INFO:teuthology.orchestra.console:Power off smithi082
2022-03-02T05:26:31.106 INFO:teuthology.orchestra.console:Power off for smithi090 completed
2022-03-02T05:26:31.111 INFO:teuthology.orchestra.console:Power off for smithi082 completed
2022-03-02T05:26:31.209 INFO:teuthology.orchestra.console:Power on smithi090
2022-03-02T05:26:31.221 INFO:teuthology.orchestra.console:Power on smithi082
2022-03-02T05:26:35.468 INFO:teuthology.orchestra.console:Power on for smithi090 completed
2022-03-02T05:26:35.474 INFO:teuthology.orchestra.console:Power on for smithi082 completed
2022-03-02T05:26:35.570 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish
2022-03-02T05:26:35.575 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish
2022-03-02T05:31:17.669 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-03-02T05:31:23.685 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-03-02T05:31:29.698 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-03-02T05:31:35.714 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-03-02T05:31:41.800 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-02T05:31:42.047 INFO:teuthology.provision.fog.smithi082:Node is ready
2022-03-02T05:31:42.094 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com
2022-03-02T05:31:42.142 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082
2022-03-02T05:31:42.423 INFO:teuthology.provision.fog.smithi082:Deploy complete!
2022-03-02T05:32:25.344 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-03-02T05:32:31.429 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-02T05:32:31.700 INFO:teuthology.provision.fog.smithi090:Node is ready
2022-03-02T05:32:31.749 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com
2022-03-02T05:32:31.798 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090
2022-03-02T05:32:32.113 INFO:teuthology.provision.fog.smithi090:Deploy complete!
2022-03-02T05:32:32.274 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com
2022-03-02T05:32:32.275 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-02T05:32:32.293 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com
2022-03-02T05:32:32.293 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-02T05:32:32.312 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server
2022-03-02T05:32:32.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com'
2022-03-02T05:32:32.625 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64
2022-03-02T05:32:32.674 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Ubuntu"
2022-03-02T05:32:32.674 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-03-02T05:32:32.674 INFO:teuthology.orchestra.run.smithi082.stdout:ID=ubuntu
2022-03-02T05:32:32.675 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE=debian
2022-03-02T05:32:32.675 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-03-02T05:32:32.675 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="18.04"
2022-03-02T05:32:32.675 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.ubuntu.com/"
2022-03-02T05:32:32.676 INFO:teuthology.orchestra.run.smithi082.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-03-02T05:32:32.676 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-03-02T05:32:32.676 INFO:teuthology.orchestra.run.smithi082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-03-02T05:32:32.676 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_CODENAME=bionic
2022-03-02T05:32:32.677 INFO:teuthology.orchestra.run.smithi082.stdout:UBUNTU_CODENAME=bionic
2022-03-02T05:32:32.678 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server
2022-03-02T05:32:32.696 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server
2022-03-02T05:32:32.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2022-03-02T05:32:32.969 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64
2022-03-02T05:32:33.017 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Ubuntu"
2022-03-02T05:32:33.017 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-03-02T05:32:33.017 INFO:teuthology.orchestra.run.smithi090.stdout:ID=ubuntu
2022-03-02T05:32:33.018 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE=debian
2022-03-02T05:32:33.018 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-03-02T05:32:33.018 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="18.04"
2022-03-02T05:32:33.018 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.ubuntu.com/"
2022-03-02T05:32:33.019 INFO:teuthology.orchestra.run.smithi090.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-03-02T05:32:33.019 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-03-02T05:32:33.019 INFO:teuthology.orchestra.run.smithi090.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-03-02T05:32:33.019 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_CODENAME=bionic
2022-03-02T05:32:33.020 INFO:teuthology.orchestra.run.smithi090.stdout:UBUNTU_CODENAME=bionic
2022-03-02T05:32:33.021 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2022-03-02T05:32:33.111 INFO:teuthology.dispatcher.supervisor:Running job 6715036
2022-03-02T05:32:33.112 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-03-01_17:45:51-rados-wip-yuri3-testing-2022-02-28-0757-pacific-distro-default-smithi/6715036 --name yuriw-2022-03-01_17:45:51-rados-wip-yuri3-testing-2022-02-28-0757-pacific-distro-default-smithi --description rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} -- /home/teuthworker/archive/yuriw-2022-03-01_17:45:51-rados-wip-yuri3-testing-2022-02-28-0757-pacific-distro-default-smithi/6715036/orig.config.yaml
2022-03-02T05:32:33.115 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-03-01_17:45:51-rados-wip-yuri3-testing-2022-02-28-0757-pacific-distro-default-smithi/6715036
2022-03-02T05:32:33.116 INFO:teuthology.dispatcher.supervisor:Job PID: 18310
2022-03-02T05:32:33.116 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-02T12:03:02.084 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-02T12:03:02.245 INFO:teuthology.kill:Killing Pids: {18310}
2022-03-02T12:03:03.485 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['host.a', 'client.0']
2022-03-02T12:03:03.486 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['host.b', 'client.1']
2022-03-02T12:03:03.486 INFO:teuthology.misc:Compressing logs...
2022-03-02T12:03:03.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com'
2022-03-02T12:03:03.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2022-03-02T12:03:03.787 INFO:teuthology.orchestra.run.smithi082.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-03-02T12:03:04.080 INFO:teuthology.orchestra.run.smithi090.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-03-02T12:03:04.101 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-02T12:03:04.102 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now
2022-03-02T12:03:04.139 INFO:teuthology.orchestra.run.smithi090.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-02T12:03:04.139 INFO:teuthology.orchestra.run.smithi090.stderr:tar: Error is not recoverable: exiting now
2022-03-02T12:03:04.141 INFO:teuthology.misc:Compressing logs...
2022-03-02T12:03:04.284 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-03-02T12:03:04.383 INFO:teuthology.misc:Compressing logs...
2022-03-02T12:03:06.428 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/20af3ba4-99eb-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-03-02T12:03:06.479 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/20af3ba4-99eb-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-03-02T12:03:08.108 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/20af3ba4-99eb-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-03-02T12:03:08.180 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/20af3ba4-99eb-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-03-02T12:03:11.499 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/20af3ba4-99eb-11ec-8c35-001a4aab830c/ceph-mon.smithi090.log: file size changed while zipping
2022-03-02T12:03:13.200 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/20af3ba4-99eb-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-03-02T12:03:14.959 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/20af3ba4-99eb-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-03-02T12:03:17.110 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/20af3ba4-99eb-11ec-8c35-001a4aab830c/ceph-mon.smithi082.log: file size changed while zipping
2022-03-02T12:03:18.945 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/20af3ba4-99eb-11ec-8c35-001a4aab830c/ceph-mgr.smithi082.bowioi.log: file size changed while zipping
2022-03-02T12:03:20.880 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/20af3ba4-99eb-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-03-02T12:03:26.744 INFO:teuthology.kill:No teuthology processes running
2022-03-02T12:03:27.942 INFO:teuthology.kill:Nuking machines: ['smithi082', 'smithi090']
2022-03-02T12:03:28.917 INFO:teuthology.kill:2022-03-02 12:03:28,916.916 INFO:teuthology.nuke:targets:
2022-03-02T12:03:28.918 INFO:teuthology.kill:  smithi082.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtu4oOf48kKqqKSlbCNAuxf69A7aY7RADWHndI0CbJONLigpkohefPsK1a0mVoDvgu1E5GQVo8P7xWUG3pyN9E27wqwhbfQ7waOQb0EkoUpszn0mxTWhKrbgmPoC+jkOWZiJVBGASgZOwJdjrOWrE7554ejUh8HuEB2QXNU2cO/hOdjFtUvoLkdeRVw/ITGgOrLRtvOlRh2ZjGYlfDrw8PpWIwmwt4E5YnDWVrwoVQLC09pB1qvxecjxmamKiOOqlCx4zGJeWIKii58kw5KvDK3fJswTrSA1ZANgvdSH2qelI1FQ6adVTX1ssaSrbDqj+QBG1lncanlNoQ/ZrItwVB
2022-03-02T12:03:28.918 INFO:teuthology.kill:  smithi090.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzZuRXgIqLtU6MZO25iHqUJ6sSggfPMywYY5ejilDDcoicng+cDsZmUl7UjiqzprYRmxZAPPp/P0ZAwk59I5A4TfV0edpr2ahLXJUjHAIBMCDr3GWAWSNAuMpIVGFCmIIt3mnNuoITWXQoii4PEkRFtpewfEGPJq8O51rOZsDLzPvSBPf1+YB2M8qPkwX5n+XoAJIw1W/vavYToul5HOQ3vD/wCS9XymcJ90p/5nTxdgLRYIbBqnyCHNb0sd4oxOxDW2G62pflx/bmrk+HEot6cWo05vpzHmN2id5FVeJUtO1YeG6/Ed6lA6VIdwDDa1RCsrFZAj2BLYnrRxKTUIf1
2022-03-02T12:03:28.945 INFO:teuthology.kill:2022-03-02 12:03:28,945.945 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-02T12:03:28.946 INFO:teuthology.kill:2022-03-02 12:03:28,946.946 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-02T12:03:29.026 INFO:teuthology.kill:2022-03-02 12:03:29,026.026 INFO:teuthology.orchestra.console:Power off smithi082
2022-03-02T12:03:29.044 INFO:teuthology.kill:2022-03-02 12:03:29,044.044 INFO:teuthology.orchestra.console:Power off smithi090
2022-03-02T12:03:37.412 INFO:teuthology.kill:2022-03-02 12:03:37,410.410 INFO:teuthology.orchestra.console:Power off for smithi090 completed
2022-03-02T12:03:37.558 INFO:teuthology.kill:2022-03-02 12:03:37,557.557 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com
2022-03-02T12:03:41.517 INFO:teuthology.kill:2022-03-02 12:03:41,516.516 INFO:teuthology.orchestra.console:Power off for smithi082 completed
2022-03-02T12:03:41.660 INFO:teuthology.kill:2022-03-02 12:03:41,660.660 INFO:teuthology.lock.ops:unlocked: smithi082.front.sepia.ceph.com
2022-03-02T12:05:41.948 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-02T12:05:42.031 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi082 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-03-01_04:17:02-fs-pacific-distro-default-smithi/6713523
2022-03-02T12:05:42.032 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi090 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-03-01_04:17:02-fs-pacific-distro-default-smithi/6713522