2022-03-26T07:18:19.402 INFO:root:teuthology version: 1.1.0-70390753
2022-03-26T07:18:19.518 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi149.front.sepia.ceph.com' reimaging
2022-03-26T07:18:19.519 INFO:teuthology.lock.ops:Updating [ubuntu@smithi149.front.sepia.ceph.com]: reset os type and version on server
2022-03-26T07:18:19.520 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2022-03-26T07:18:19.537 INFO:teuthology.lock.ops:Node 'ubuntu@smithi149.front.sepia.ceph.com' reimaging is complete
2022-03-26T07:18:19.538 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi174.front.sepia.ceph.com' reimaging
2022-03-26T07:18:19.538 INFO:teuthology.lock.ops:Updating [ubuntu@smithi174.front.sepia.ceph.com]: reset os type and version on server
2022-03-26T07:18:19.538 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server
2022-03-26T07:18:19.558 INFO:teuthology.lock.ops:Node 'ubuntu@smithi174.front.sepia.ceph.com' reimaging is complete
2022-03-26T07:18:19.769 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of ubuntu 18.04
2022-03-26T07:18:19.773 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of ubuntu 18.04
2022-03-26T07:18:20.096 INFO:teuthology.orchestra.console:Power off smithi149
2022-03-26T07:18:20.111 INFO:teuthology.orchestra.console:Power off smithi174
2022-03-26T07:18:28.473 INFO:teuthology.orchestra.console:Power off for smithi174 completed
2022-03-26T07:18:28.574 INFO:teuthology.orchestra.console:Power on smithi174
2022-03-26T07:18:32.576 INFO:teuthology.orchestra.console:Power off for smithi149 completed
2022-03-26T07:18:32.678 INFO:teuthology.orchestra.console:Power on smithi149
2022-03-26T07:18:32.831 INFO:teuthology.orchestra.console:Power on for smithi174 completed
2022-03-26T07:18:32.932 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish
2022-03-26T07:18:41.087 INFO:teuthology.orchestra.console:Power on for smithi149 completed
2022-03-26T07:18:41.189 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish
2022-03-26T07:23:08.888 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-03-26T07:23:14.906 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-03-26T07:23:20.924 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-03-26T07:23:29.973 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-03-26T07:23:36.140 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-26T07:23:36.420 INFO:teuthology.provision.fog.smithi174:Node is ready
2022-03-26T07:23:36.468 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com
2022-03-26T07:23:36.516 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174
2022-03-26T07:23:36.814 INFO:teuthology.provision.fog.smithi174:Deploy complete!
2022-03-26T07:23:42.869 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-26T07:23:43.104 INFO:teuthology.provision.fog.smithi149:Node is ready
2022-03-26T07:23:43.155 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com
2022-03-26T07:23:43.204 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149
2022-03-26T07:23:43.518 INFO:teuthology.provision.fog.smithi149:Deploy complete!
2022-03-26T07:23:43.715 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com
2022-03-26T07:23:43.716 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-26T07:23:43.740 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com
2022-03-26T07:23:43.741 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-26T07:23:43.768 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server
2022-03-26T07:23:43.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com'
2022-03-26T07:23:43.983 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64
2022-03-26T07:23:44.031 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu"
2022-03-26T07:23:44.031 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-03-26T07:23:44.032 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu
2022-03-26T07:23:44.032 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian
2022-03-26T07:23:44.032 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-03-26T07:23:44.032 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="18.04"
2022-03-26T07:23:44.032 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/"
2022-03-26T07:23:44.033 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-03-26T07:23:44.033 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-03-26T07:23:44.033 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-03-26T07:23:44.033 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=bionic
2022-03-26T07:23:44.034 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=bionic
2022-03-26T07:23:44.036 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2022-03-26T07:23:44.057 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server
2022-03-26T07:23:44.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com'
2022-03-26T07:23:44.340 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64
2022-03-26T07:23:44.388 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Ubuntu"
2022-03-26T07:23:44.389 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-03-26T07:23:44.389 INFO:teuthology.orchestra.run.smithi174.stdout:ID=ubuntu
2022-03-26T07:23:44.389 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE=debian
2022-03-26T07:23:44.390 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-03-26T07:23:44.390 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="18.04"
2022-03-26T07:23:44.390 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.ubuntu.com/"
2022-03-26T07:23:44.390 INFO:teuthology.orchestra.run.smithi174.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-03-26T07:23:44.391 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-03-26T07:23:44.391 INFO:teuthology.orchestra.run.smithi174.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-03-26T07:23:44.391 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_CODENAME=bionic
2022-03-26T07:23:44.391 INFO:teuthology.orchestra.run.smithi174.stdout:UBUNTU_CODENAME=bionic
2022-03-26T07:23:44.392 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server
2022-03-26T07:23:44.489 INFO:teuthology.dispatcher.supervisor:Running job 6761819
2022-03-26T07:23:44.490 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-03-25_18:42:52-rados-wip-yuri7-testing-2022-03-24-1341-pacific-distro-default-smithi/6761819 --name yuriw-2022-03-25_18:42:52-rados-wip-yuri7-testing-2022-03-24-1341-pacific-distro-default-smithi --description rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} -- /home/teuthworker/archive/yuriw-2022-03-25_18:42:52-rados-wip-yuri7-testing-2022-03-24-1341-pacific-distro-default-smithi/6761819/orig.config.yaml
2022-03-26T07:23:44.493 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-03-25_18:42:52-rados-wip-yuri7-testing-2022-03-24-1341-pacific-distro-default-smithi/6761819
2022-03-26T07:23:44.494 INFO:teuthology.dispatcher.supervisor:Job PID: 30822
2022-03-26T07:23:44.494 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-26T13:54:13.659 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-26T13:54:13.795 INFO:teuthology.kill:Killing Pids: {30822}
2022-03-26T13:54:15.025 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['host.a', 'client.0']
2022-03-26T13:54:15.026 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['host.b', 'client.1']
2022-03-26T13:54:15.026 INFO:teuthology.misc:Compressing logs...
2022-03-26T13:54:15.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com'
2022-03-26T13:54:15.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com'
2022-03-26T13:54:15.349 INFO:teuthology.orchestra.run.smithi149.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-03-26T13:54:15.640 INFO:teuthology.orchestra.run.smithi174.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-03-26T13:54:15.659 INFO:teuthology.orchestra.run.smithi149.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-26T13:54:15.659 INFO:teuthology.orchestra.run.smithi149.stderr:tar: Error is not recoverable: exiting now
2022-03-26T13:54:15.699 INFO:teuthology.orchestra.run.smithi174.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-26T13:54:15.699 INFO:teuthology.orchestra.run.smithi174.stderr:tar: Error is not recoverable: exiting now
2022-03-26T13:54:15.702 INFO:teuthology.misc:Compressing logs...
2022-03-26T13:54:15.840 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-03-26T13:54:15.847 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-03-26T13:54:15.949 INFO:teuthology.misc:Compressing logs...
2022-03-26T13:54:17.943 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /var/log/ceph/8c2637e0-acd6-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-03-26T13:54:18.058 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/8c2637e0-acd6-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-03-26T13:54:19.799 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/8c2637e0-acd6-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-03-26T13:54:21.349 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /var/log/ceph/8c2637e0-acd6-11ec-8c35-001a4aab830c/ceph-mon.smithi174.log: file size changed while zipping
2022-03-26T13:54:23.036 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /var/log/ceph/8c2637e0-acd6-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-03-26T13:54:24.792 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /var/log/ceph/8c2637e0-acd6-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-03-26T13:54:26.532 INFO:teuthology.orchestra.run.smithi174.stderr:gzip: /var/log/ceph/8c2637e0-acd6-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-03-26T13:54:28.991 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/8c2637e0-acd6-11ec-8c35-001a4aab830c/ceph-mon.smithi149.log: file size changed while zipping
2022-03-26T13:54:30.855 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/8c2637e0-acd6-11ec-8c35-001a4aab830c/ceph-mgr.smithi149.zwhthl.log: file size changed while zipping
2022-03-26T13:54:32.797 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/8c2637e0-acd6-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-03-26T13:54:38.872 INFO:teuthology.kill:No teuthology processes running
2022-03-26T13:54:40.096 INFO:teuthology.kill:Nuking machines: ['smithi149', 'smithi174']
2022-03-26T13:54:41.129 INFO:teuthology.kill:2022-03-26 13:54:41,129.129 INFO:teuthology.nuke:targets:
2022-03-26T13:54:41.130 INFO:teuthology.kill:  smithi149.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAuJgF+cQjVFlFcWr1T3Op9V1DPB0ngKVUOZmVg3lShknDLUoknMvLLxdBlvbetvW/T/kdqxFpbX+rAqxz6JuL0Kx2MPbXFdMKYy930DC7uza9QO6wJKnqpu1UvTL16tMqVxuLT+Ojd0S5iULqmOJ97aEqPv+QrQ9FLUHj3jlQX5b0gGmTZwcyDdDIeAaVVZ70TIjcHXgXXrEwJmTxYtJhf9gpJF5COgcDEldyaMOAfQlbMxwri/FZiwgNZIK3BaIa1gaYXNnuvscKMzRVMKDuFctlu9zTtYlxhhy24lGXfEBpR5m96rvuAqjRqyksRtHW00IOpbpxgKontMtmWAdb
2022-03-26T13:54:41.130 INFO:teuthology.kill:  smithi174.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrxBI9sSmM1kjbh7mwFWEUaLWQwkHfE+JN4Ajx6i4jKbUsSYWqqfQCplDthN2qvRLOwptNBvUjizlbM8sdbSHAOaPE+ENgZFmihMQ663qa3bhxUYYjoREaulrgLyltxCu2RxqvmUh6g0VV1NeSc2/yIOlir6mx5+eBQfqvPNgH6CK1eq7q9154uL8eqOB7EIAyEL9NBSJ4r1bP4CluIS6gtvpPJWc858cDqut+Ae1CwuYZxuTwqAynYJ0LC7Yg6CIPE+YxiMuZOQ+sYSCAQU2+8G9l3JmvDDcNe9NyydvyPtUUGj+YHrZrOejenD+1Ee9+TOVk5n1oBiUwleJOUyJZ
2022-03-26T13:54:41.157 INFO:teuthology.kill:2022-03-26 13:54:41,157.157 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-26T13:54:41.160 INFO:teuthology.kill:2022-03-26 13:54:41,160.160 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-26T13:54:41.236 INFO:teuthology.kill:2022-03-26 13:54:41,236.236 INFO:teuthology.orchestra.console:Power off smithi174
2022-03-26T13:54:41.250 INFO:teuthology.kill:2022-03-26 13:54:41,249.249 INFO:teuthology.orchestra.console:Power off smithi149
2022-03-26T13:54:49.614 INFO:teuthology.kill:2022-03-26 13:54:49,613.613 INFO:teuthology.orchestra.console:Power off for smithi149 completed
2022-03-26T13:54:49.763 INFO:teuthology.kill:2022-03-26 13:54:49,762.762 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com
2022-03-26T13:54:53.721 INFO:teuthology.kill:2022-03-26 13:54:53,721.721 INFO:teuthology.orchestra.console:Power off for smithi174 completed
2022-03-26T13:54:53.876 INFO:teuthology.kill:2022-03-26 13:54:53,876.876 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com
2022-03-26T13:56:54.184 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-26T13:56:54.261 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi149 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-25_20:52:40-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/6762285
2022-03-26T13:56:54.261 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi174 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-25_20:52:40-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/6762284