2022-03-06T10:22:18.765 INFO:root:teuthology version: 1.1.0-eeaeee38
2022-03-06T10:22:18.896 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi026.front.sepia.ceph.com' reimaging
2022-03-06T10:22:18.897 INFO:teuthology.lock.ops:Updating [ubuntu@smithi026.front.sepia.ceph.com]: reset os type and version on server
2022-03-06T10:22:18.897 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2022-03-06T10:22:18.916 INFO:teuthology.lock.ops:Node 'ubuntu@smithi026.front.sepia.ceph.com' reimaging is complete
2022-03-06T10:22:18.916 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi169.front.sepia.ceph.com' reimaging
2022-03-06T10:22:18.917 INFO:teuthology.lock.ops:Updating [ubuntu@smithi169.front.sepia.ceph.com]: reset os type and version on server
2022-03-06T10:22:18.917 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2022-03-06T10:22:18.937 INFO:teuthology.lock.ops:Node 'ubuntu@smithi169.front.sepia.ceph.com' reimaging is complete
2022-03-06T10:22:19.133 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of ubuntu 18.04
2022-03-06T10:22:19.144 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of ubuntu 18.04
2022-03-06T10:22:19.449 INFO:teuthology.orchestra.console:Power off smithi026
2022-03-06T10:22:19.471 INFO:teuthology.orchestra.console:Power off smithi169
2022-03-06T10:22:27.832 INFO:teuthology.orchestra.console:Power off for smithi026 completed
2022-03-06T10:22:27.933 INFO:teuthology.orchestra.console:Power on smithi026
2022-03-06T10:22:31.953 INFO:teuthology.orchestra.console:Power off for smithi169 completed
2022-03-06T10:22:32.055 INFO:teuthology.orchestra.console:Power on smithi169
2022-03-06T10:22:36.301 INFO:teuthology.orchestra.console:Power on for smithi026 completed
2022-03-06T10:22:36.312 INFO:teuthology.orchestra.console:Power on for smithi169 completed
2022-03-06T10:22:36.403 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish
2022-03-06T10:22:36.413 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2022-03-06T10:26:59.208 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-06T10:26:59.460 INFO:teuthology.provision.fog.smithi026:Node is ready
2022-03-06T10:26:59.508 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com
2022-03-06T10:26:59.556 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026
2022-03-06T10:26:59.832 INFO:teuthology.provision.fog.smithi026:Deploy complete!
2022-03-06T10:27:21.942 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-03-06T10:27:27.956 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-03-06T10:27:33.975 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-03-06T10:27:39.996 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-03-06T10:27:46.119 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-06T10:27:46.400 INFO:teuthology.provision.fog.smithi169:Node is ready
2022-03-06T10:27:46.446 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com
2022-03-06T10:27:46.493 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169
2022-03-06T10:27:46.786 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2022-03-06T10:27:46.957 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com
2022-03-06T10:27:46.958 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-06T10:27:46.978 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com
2022-03-06T10:27:46.978 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-06T10:27:47.002 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server
2022-03-06T10:27:47.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com'
2022-03-06T10:27:47.294 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64
2022-03-06T10:27:47.343 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu"
2022-03-06T10:27:47.343 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-03-06T10:27:47.344 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu
2022-03-06T10:27:47.344 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian
2022-03-06T10:27:47.344 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-03-06T10:27:47.344 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="18.04"
2022-03-06T10:27:47.345 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/"
2022-03-06T10:27:47.345 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-03-06T10:27:47.345 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-03-06T10:27:47.345 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-03-06T10:27:47.346 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=bionic
2022-03-06T10:27:47.346 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=bionic
2022-03-06T10:27:47.347 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2022-03-06T10:27:47.366 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server
2022-03-06T10:27:47.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2022-03-06T10:27:47.650 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64
2022-03-06T10:27:47.698 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu"
2022-03-06T10:27:47.698 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-03-06T10:27:47.698 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu
2022-03-06T10:27:47.699 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian
2022-03-06T10:27:47.699 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-03-06T10:27:47.699 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="18.04"
2022-03-06T10:27:47.699 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/"
2022-03-06T10:27:47.700 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-03-06T10:27:47.700 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-03-06T10:27:47.700 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-03-06T10:27:47.700 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=bionic
2022-03-06T10:27:47.701 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=bionic
2022-03-06T10:27:47.701 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2022-03-06T10:27:47.790 INFO:teuthology.dispatcher.supervisor:Running job 6723335
2022-03-06T10:27:47.790 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-03-06_03:31:03-rados-pacific-distro-default-smithi/6723335 --name teuthology-2022-03-06_03:31:03-rados-pacific-distro-default-smithi --description rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} -- /home/teuthworker/archive/teuthology-2022-03-06_03:31:03-rados-pacific-distro-default-smithi/6723335/orig.config.yaml
2022-03-06T10:27:47.794 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-03-06_03:31:03-rados-pacific-distro-default-smithi/6723335
2022-03-06T10:27:47.796 INFO:teuthology.dispatcher.supervisor:Job PID: 9537
2022-03-06T10:27:47.797 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-06T16:58:17.217 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-06T16:58:17.348 INFO:teuthology.kill:Killing Pids: {9537}
2022-03-06T16:58:18.503 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['host.a', 'client.0']
2022-03-06T16:58:18.504 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['host.b', 'client.1']
2022-03-06T16:58:18.504 INFO:teuthology.misc:Compressing logs...
2022-03-06T16:58:18.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com'
2022-03-06T16:58:18.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2022-03-06T16:58:18.763 INFO:teuthology.orchestra.run.smithi026.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-03-06T16:58:19.048 INFO:teuthology.orchestra.run.smithi169.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-03-06T16:58:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-06T16:58:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:tar: Error is not recoverable: exiting now
2022-03-06T16:58:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-03-06T16:58:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:tar: Error is not recoverable: exiting now
2022-03-06T16:58:19.111 INFO:teuthology.misc:Compressing logs...
2022-03-06T16:58:19.262 INFO:teuthology.orchestra.run.smithi026.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-03-06T16:58:19.358 INFO:teuthology.misc:Compressing logs...
2022-03-06T16:58:21.314 INFO:teuthology.orchestra.run.smithi026.stderr:gzip: /var/log/ceph/fed608cc-9d38-11ec-8c35-001a4aab830c/ceph-mgr.smithi026.mraaxn.log: file size changed while zipping
2022-03-06T16:58:22.816 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/fed608cc-9d38-11ec-8c35-001a4aab830c/ceph-mon.smithi169.log: file size changed while zipping
2022-03-06T16:58:23.524 INFO:teuthology.orchestra.run.smithi026.stderr:gzip: /var/log/ceph/fed608cc-9d38-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-03-06T16:58:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/fed608cc-9d38-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-03-06T16:58:26.423 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/fed608cc-9d38-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-03-06T16:58:28.228 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/fed608cc-9d38-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-03-06T16:58:29.936 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/fed608cc-9d38-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-03-06T16:58:33.135 INFO:teuthology.orchestra.run.smithi026.stderr:gzip: /var/log/ceph/fed608cc-9d38-11ec-8c35-001a4aab830c/ceph-mon.smithi026.log: file size changed while zipping
2022-03-06T16:58:34.946 INFO:teuthology.orchestra.run.smithi026.stderr:gzip: /var/log/ceph/fed608cc-9d38-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-03-06T16:58:37.047 INFO:teuthology.orchestra.run.smithi026.stderr:gzip: /var/log/ceph/fed608cc-9d38-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-03-06T16:58:40.814 INFO:teuthology.orchestra.run.smithi026.stderr:tar: .: file changed as we read it
2022-03-06T16:58:43.073 INFO:teuthology.kill:No teuthology processes running
2022-03-06T16:58:44.227 INFO:teuthology.kill:Nuking machines: ['smithi026', 'smithi169']
2022-03-06T16:58:45.138 INFO:teuthology.kill:2022-03-06 16:58:45,137.137 INFO:teuthology.nuke:targets:
2022-03-06T16:58:45.138 INFO:teuthology.kill:  smithi026.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDX2U5jqCkkindNPBz2nADoqKOb4fvWAdsIT0LHfyDvOe163whVBgNWPEj5OY2HL6GAVaKWNk6mqW5EaIGUOe1HAmC+q862H7v1O9TMeKMrwk8wiYndCQib+/RO6mLaY+WcKX8N+MNk43taGIy6G6ZPY6Oux7La9QfbXyyPdewnMeFtt1XC/L2YUePnaOb2S6MaYY/iJApGI/ehOI9zM1XFAEDKyqlrO+z07VOO3bI61GAI8qGkTL4JBvA0Tb8+Tec4r6J3v+febhakDCn8Zb4x5pcpZclXnrUc84KpWOIN8KoHobQd78pI2Mf80DxD935HmCWVg5Sys0BSp/2P+Lz7
2022-03-06T16:58:45.139 INFO:teuthology.kill:  smithi169.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRnuK6qZe6vgSogmaYjudTFcVooLcZEjvUKFe9UEKLEIPIIt3aqmkfbUfx5FtAGKGk7zlj5sk7OC/wNp3P1bqTecritDPJip5x54CIyWvwHsEuMPfV+DX0GtpHIqmnclBAxG0A80LGgSR2OgFk6Af0pEiNdh+flVZd5h6de5XlUCSAPqxP6PC37zXb/6DwHX+YVYUy+pQUKqN8pjXXkcfAQ+ruRBZ2mnfAqQoRIS6SMyKNN0DeugoLeqwRHWFvv6HrAGwEAhMoMDSPEEZ6ZmhzfHeq+m4GH3XNcu0oIk9LZMhkG8B69gLRSIsaTvWBTLxm5wyTK8ExXDUb3Qld52aJ
2022-03-06T16:58:45.164 INFO:teuthology.kill:2022-03-06 16:58:45,164.164 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-06T16:58:45.167 INFO:teuthology.kill:2022-03-06 16:58:45,167.167 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-06T16:58:45.239 INFO:teuthology.kill:2022-03-06 16:58:45,239.239 INFO:teuthology.orchestra.console:Power off smithi169
2022-03-06T16:58:45.253 INFO:teuthology.kill:2022-03-06 16:58:45,253.253 INFO:teuthology.orchestra.console:Power off smithi026
2022-03-06T16:58:53.608 INFO:teuthology.kill:2022-03-06 16:58:53,607.607 INFO:teuthology.orchestra.console:Power off for smithi169 completed
2022-03-06T16:58:53.613 INFO:teuthology.kill:2022-03-06 16:58:53,613.613 INFO:teuthology.orchestra.console:Power off for smithi026 completed
2022-03-06T16:58:53.759 INFO:teuthology.kill:2022-03-06 16:58:53,758.758 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com
2022-03-06T16:58:53.763 INFO:teuthology.kill:2022-03-06 16:58:53,763.763 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com
2022-03-06T17:00:54.002 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-06T17:00:54.085 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi026 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-02-28_02:01:03-rbd-master-distro-default-smithi/6710049
2022-03-06T17:00:54.085 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi169 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-02-28_02:01:03-rbd-master-distro-default-smithi/6710048