2022-05-19T16:59:02.515 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-19T16:59:02.676 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2022-05-19T16:59:02.677 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2022-05-19T16:59:02.677 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2022-05-19T16:59:02.703 INFO:teuthology.lock.ops:Node 'smithi059.front.sepia.ceph.com' reimaging is complete 2022-05-19T16:59:02.704 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2022-05-19T16:59:02.704 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2022-05-19T16:59:02.704 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2022-05-19T16:59:02.742 INFO:teuthology.lock.ops:Node 'smithi078.front.sepia.ceph.com' reimaging is complete 2022-05-19T16:59:02.948 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of ubuntu 18.04 2022-05-19T16:59:02.991 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of ubuntu 18.04 2022-05-19T16:59:03.317 INFO:teuthology.orchestra.console:Power off smithi059 2022-05-19T16:59:03.391 INFO:teuthology.orchestra.console:Power off smithi078 2022-05-19T16:59:11.699 INFO:teuthology.orchestra.console:Power off for smithi059 completed 2022-05-19T16:59:11.768 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2022-05-19T16:59:11.801 INFO:teuthology.orchestra.console:Power on smithi059 2022-05-19T16:59:11.869 INFO:teuthology.orchestra.console:Power on smithi078 2022-05-19T16:59:20.177 INFO:teuthology.orchestra.console:Power on for smithi059 completed 2022-05-19T16:59:20.244 INFO:teuthology.orchestra.console:Power on for smithi078 completed 2022-05-19T16:59:20.279 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2022-05-19T16:59:20.345 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2022-05-19T17:03:51.974 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-19T17:03:52.212 INFO:teuthology.provision.fog.smithi059:Node is ready 2022-05-19T17:03:52.258 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2022-05-19T17:03:52.308 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2022-05-19T17:03:52.602 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2022-05-19T17:04:22.136 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-19T17:04:22.483 INFO:teuthology.provision.fog.smithi078:Node is ready 2022-05-19T17:04:22.531 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com 2022-05-19T17:04:22.583 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2022-05-19T17:04:22.890 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2022-05-19T17:04:23.088 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2022-05-19T17:04:23.089 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-19T17:04:23.109 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2022-05-19T17:04:23.111 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-19T17:04:23.132 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2022-05-19T17:04:23.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2022-05-19T17:04:23.438 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2022-05-19T17:04:23.486 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Ubuntu" 2022-05-19T17:04:23.486 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2022-05-19T17:04:23.486 INFO:teuthology.orchestra.run.smithi059.stdout:ID=ubuntu 2022-05-19T17:04:23.487 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE=debian 2022-05-19T17:04:23.487 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2022-05-19T17:04:23.487 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="18.04" 2022-05-19T17:04:23.487 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-19T17:04:23.488 INFO:teuthology.orchestra.run.smithi059.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-19T17:04:23.488 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-19T17:04:23.488 INFO:teuthology.orchestra.run.smithi059.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-19T17:04:23.488 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_CODENAME=bionic 2022-05-19T17:04:23.488 INFO:teuthology.orchestra.run.smithi059.stdout:UBUNTU_CODENAME=bionic 2022-05-19T17:04:23.490 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2022-05-19T17:04:23.510 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2022-05-19T17:04:23.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2022-05-19T17:04:23.775 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2022-05-19T17:04:23.823 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2022-05-19T17:04:23.823 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2022-05-19T17:04:23.823 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2022-05-19T17:04:23.824 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2022-05-19T17:04:23.824 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2022-05-19T17:04:23.824 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="18.04" 2022-05-19T17:04:23.824 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-19T17:04:23.824 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-19T17:04:23.825 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-19T17:04:23.825 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-19T17:04:23.825 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=bionic 2022-05-19T17:04:23.825 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=bionic 2022-05-19T17:04:23.826 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2022-05-19T17:04:23.945 INFO:teuthology.dispatcher.supervisor:Running job 6841417 2022-05-19T17:04:23.946 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-05-19_16:47:41-rados:cephadm:osds-wip-lrc-fix-pacific-distro-default-smithi/6841417 --name lflores-2022-05-19_16:47:41-rados:cephadm:osds-wip-lrc-fix-pacific-distro-default-smithi --description rados:cephadm:osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} -- /home/teuthworker/archive/lflores-2022-05-19_16:47:41-rados:cephadm:osds-wip-lrc-fix-pacific-distro-default-smithi/6841417/orig.config.yaml 2022-05-19T17:04:23.951 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-05-19_16:47:41-rados:cephadm:osds-wip-lrc-fix-pacific-distro-default-smithi/6841417 2022-05-19T17:04:23.952 INFO:teuthology.dispatcher.supervisor:Job PID: 9721 2022-05-19T17:04:23.952 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-19T23:34:55.811 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-19T23:34:55.973 INFO:teuthology.kill:Killing Pids: {9721} 2022-05-19T23:34:57.545 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-05-19T23:34:57.545 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-05-19T23:34:57.546 INFO:teuthology.misc:Compressing logs... 2022-05-19T23:34:57.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2022-05-19T23:34:57.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2022-05-19T23:34:57.862 INFO:teuthology.orchestra.run.smithi059.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-05-19T23:34:58.249 INFO:teuthology.orchestra.run.smithi078.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-05-19T23:34:58.271 INFO:teuthology.orchestra.run.smithi059.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-05-19T23:34:58.272 INFO:teuthology.orchestra.run.smithi059.stderr:tar: Error is not recoverable: exiting now 2022-05-19T23:34:58.307 INFO:teuthology.orchestra.run.smithi078.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-05-19T23:34:58.307 INFO:teuthology.orchestra.run.smithi078.stderr:tar: Error is not recoverable: exiting now 2022-05-19T23:34:58.310 INFO:teuthology.misc:Compressing logs... 2022-05-19T23:34:58.556 INFO:teuthology.misc:Compressing logs... 2022-05-19T23:35:00.380 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/5e297a6a-d796-11ec-be40-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-05-19T23:35:00.704 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/5e297a6a-d796-11ec-be40-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-05-19T23:35:02.100 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/5e297a6a-d796-11ec-be40-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-05-19T23:35:02.924 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/5e297a6a-d796-11ec-be40-001a4aab830c/ceph-mgr.smithi059.amghea.log: file size changed while zipping 2022-05-19T23:35:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/5e297a6a-d796-11ec-be40-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-05-19T23:35:05.161 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/5e297a6a-d796-11ec-be40-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-05-19T23:35:07.014 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/5e297a6a-d796-11ec-be40-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-05-19T23:35:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/5e297a6a-d796-11ec-be40-001a4aab830c/ceph-mon.smithi078.log: file size changed while zipping 2022-05-19T23:35:09.213 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/5e297a6a-d796-11ec-be40-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-05-19T23:35:16.735 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/5e297a6a-d796-11ec-be40-001a4aab830c/ceph-mon.smithi059.log: file size changed while zipping 2022-05-19T23:35:22.930 INFO:teuthology.kill:No teuthology processes running 2022-05-19T23:35:24.486 INFO:teuthology.kill:Nuking machines: ['smithi059', 'smithi078'] 2022-05-19T23:35:25.782 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-19T23:35:25.783 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-19T23:35:25.783 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-19T23:35:25.784 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-19T23:35:25.784 INFO:teuthology.kill:2022-05-19 23:35:25,782.782 INFO:teuthology.nuke:targets: 2022-05-19T23:35:25.784 INFO:teuthology.kill: smithi059.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfuQUFYGtuLsqyr4sllB5Dk8dQyzkyPT6Y5oUaEJk73ZlZK+Zg3fEtGN88U6JgRlGiGA4zn8jqyn+T5Q1bAIf/DQiPAb57/wfGCIfCzGCcL47GkeAHtgzxrJWbGsBnmHQ0jwr+DPT5BvRk/u47b6KDd9EIDTXk6/FZz7ICtd9MLCZhKF0BYTox0c5yO+1gQqdpOq4JxaWcoDpchHBpRYK/Fd2BArlTY7eCw6k1au4900CmW8swBpLd6qkfXLZwR4ftar/u3D99cKflbvcnwQKtjZFEOhyAxnb6Tz9+MmChl96ggTpKz6HSZ3t7Ueq/U2vW3heKJk0hI0D3bhackRrj 2022-05-19T23:35:25.784 INFO:teuthology.kill: smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2i6PmW8i2WNSkhGP+okfg5PMrl7GUaG6+woAD8B45AUT6OIM6MO/q2mqWNKMgConbBKHHK6375vjki7nfKQn1OdzkOI/Cw/sPE3+L9otN3XirgfyBo5wTnKRR+E/ObVqzOwBJsuKX52DUAexZHf+W9Wp2L7XBjYjIVpa8lHjt6r2UixrUUkE/XVFZeMnPb072BmGBiDUQT58aN/NsO4ZOlyzWqOPL6e9bZtUe40Q/ZNVgQfGPktvgjXJguePJi1PmmG9uHI3S95DZRO3byh4wslXTPnoGYWt3sW3w+PdMMdEXYqZHdsWh3n/eHOPVdn0lBit/mujLO7upLyTUSqD7 2022-05-19T23:35:25.813 INFO:teuthology.kill:2022-05-19 23:35:25,813.813 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-19T23:35:25.816 INFO:teuthology.kill:2022-05-19 23:35:25,816.816 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-19T23:35:25.914 INFO:teuthology.kill:2022-05-19 23:35:25,913.913 INFO:teuthology.orchestra.console:Power off smithi078 2022-05-19T23:35:25.930 INFO:teuthology.kill:2022-05-19 23:35:25,929.929 INFO:teuthology.orchestra.console:Power off smithi059 2022-05-19T23:35:38.421 INFO:teuthology.kill:2022-05-19 23:35:38,419.419 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2022-05-19T23:35:38.433 INFO:teuthology.kill:2022-05-19 23:35:38,432.432 INFO:teuthology.orchestra.console:Power off for smithi059 completed 2022-05-19T23:35:38.597 INFO:teuthology.kill:2022-05-19 23:35:38,596.596 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com 2022-05-19T23:35:38.598 INFO:teuthology.kill:2022-05-19 23:35:38,598.598 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com 2022-05-19T23:37:39.052 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-19T23:37:39.163 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi059 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-05-18_12:17:03-powercycle-pacific-distro-default-smithi/6839613 2022-05-19T23:37:39.164 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi078 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-05-18_12:17:03-powercycle-pacific-distro-default-smithi/6839613