2021-05-27T20:28:16.939 INFO:root:teuthology version: 1.1.0-630d5963 2021-05-27T20:28:17.057 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba018.front.sepia.ceph.com' reimaging 2021-05-27T20:28:17.058 INFO:teuthology.lock.ops:Updating [ubuntu@gibba018.front.sepia.ceph.com]: reset os type and version on server 2021-05-27T20:28:17.059 INFO:teuthology.lock.ops:Updating gibba018.front.sepia.ceph.com on lock server 2021-05-27T20:28:17.076 INFO:teuthology.lock.ops:Node 'ubuntu@gibba018.front.sepia.ceph.com' reimaging is complete 2021-05-27T20:28:17.077 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba026.front.sepia.ceph.com' reimaging 2021-05-27T20:28:17.077 INFO:teuthology.lock.ops:Updating [ubuntu@gibba026.front.sepia.ceph.com]: reset os type and version on server 2021-05-27T20:28:17.078 INFO:teuthology.lock.ops:Updating gibba026.front.sepia.ceph.com on lock server 2021-05-27T20:28:17.099 INFO:teuthology.lock.ops:Node 'ubuntu@gibba026.front.sepia.ceph.com' reimaging is complete 2021-05-27T20:28:17.270 INFO:teuthology.provision.fog.gibba018:Scheduling deploy of ubuntu 20.04 2021-05-27T20:28:17.316 INFO:teuthology.provision.fog.gibba026:Scheduling deploy of ubuntu 20.04 2021-05-27T20:28:17.649 INFO:teuthology.orchestra.console:Power off gibba026 2021-05-27T20:28:17.673 INFO:teuthology.orchestra.console:Power off gibba018 2021-05-27T20:28:26.049 INFO:teuthology.orchestra.console:Power off for gibba026 completed 2021-05-27T20:28:26.054 INFO:teuthology.orchestra.console:Power off for gibba018 completed 2021-05-27T20:28:26.152 INFO:teuthology.orchestra.console:Power on gibba026 2021-05-27T20:28:26.159 INFO:teuthology.orchestra.console:Power on gibba018 2021-05-27T20:28:34.525 INFO:teuthology.orchestra.console:Power on for gibba026 completed 2021-05-27T20:28:34.530 INFO:teuthology.orchestra.console:Power on for gibba018 completed 2021-05-27T20:28:34.627 INFO:teuthology.provision.fog.gibba026:Waiting for deploy to finish 2021-05-27T20:28:34.631 INFO:teuthology.provision.fog.gibba018:Waiting for deploy to finish 2021-05-27T20:33:15.344 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-27T20:33:15.392 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-27T20:33:15.767 INFO:teuthology.provision.fog.gibba026:Node is ready 2021-05-27T20:33:15.771 INFO:teuthology.orchestra.run.gibba026.stdout:gibba026.front.sepia.ceph.com 2021-05-27T20:33:15.827 INFO:teuthology.orchestra.run.gibba026.stdout:172.21.2.126 gibba026.front.sepia.ceph.com gibba026 2021-05-27T20:33:15.966 INFO:teuthology.provision.fog.gibba026:Deploy complete! 2021-05-27T20:33:16.036 INFO:teuthology.provision.fog.gibba018:Node is ready 2021-05-27T20:33:16.045 INFO:teuthology.orchestra.run.gibba018.stdout:gibba018.front.sepia.ceph.com 2021-05-27T20:33:16.056 INFO:teuthology.orchestra.run.gibba018.stdout:172.21.2.118 gibba018.front.sepia.ceph.com gibba018 2021-05-27T20:33:16.433 INFO:teuthology.provision.fog.gibba018:Deploy complete! 2021-05-27T20:33:16.553 INFO:teuthology.lock.ops:Checking gibba018.front.sepia.ceph.com 2021-05-27T20:33:16.554 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-27T20:33:16.574 INFO:teuthology.lock.ops:Checking gibba026.front.sepia.ceph.com 2021-05-27T20:33:16.575 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-27T20:33:16.591 INFO:teuthology.lock.ops:Updating [gibba018.front.sepia.ceph.com]: set os type and version on server 2021-05-27T20:33:16.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-27T20:33:16.760 INFO:teuthology.orchestra.run.gibba018.stdout:x86_64 2021-05-27T20:33:16.768 INFO:teuthology.orchestra.run.gibba018.stdout:NAME="Ubuntu" 2021-05-27T20:33:16.768 INFO:teuthology.orchestra.run.gibba018.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-05-27T20:33:16.769 INFO:teuthology.orchestra.run.gibba018.stdout:ID=ubuntu 2021-05-27T20:33:16.769 INFO:teuthology.orchestra.run.gibba018.stdout:ID_LIKE=debian 2021-05-27T20:33:16.770 INFO:teuthology.orchestra.run.gibba018.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-05-27T20:33:16.770 INFO:teuthology.orchestra.run.gibba018.stdout:VERSION_ID="20.04" 2021-05-27T20:33:16.771 INFO:teuthology.orchestra.run.gibba018.stdout:HOME_URL="https://www.ubuntu.com/" 2021-05-27T20:33:16.771 INFO:teuthology.orchestra.run.gibba018.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-05-27T20:33:16.772 INFO:teuthology.orchestra.run.gibba018.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-05-27T20:33:16.772 INFO:teuthology.orchestra.run.gibba018.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-05-27T20:33:16.773 INFO:teuthology.orchestra.run.gibba018.stdout:VERSION_CODENAME=focal 2021-05-27T20:33:16.773 INFO:teuthology.orchestra.run.gibba018.stdout:UBUNTU_CODENAME=focal 2021-05-27T20:33:16.775 INFO:teuthology.lock.ops:Updating gibba018.front.sepia.ceph.com on lock server 2021-05-27T20:33:16.795 INFO:teuthology.lock.ops:Updating [gibba026.front.sepia.ceph.com]: set os type and version on server 2021-05-27T20:33:16.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-27T20:33:16.981 INFO:teuthology.orchestra.run.gibba026.stdout:x86_64 2021-05-27T20:33:16.990 INFO:teuthology.orchestra.run.gibba026.stdout:NAME="Ubuntu" 2021-05-27T20:33:16.990 INFO:teuthology.orchestra.run.gibba026.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-05-27T20:33:16.991 INFO:teuthology.orchestra.run.gibba026.stdout:ID=ubuntu 2021-05-27T20:33:16.991 INFO:teuthology.orchestra.run.gibba026.stdout:ID_LIKE=debian 2021-05-27T20:33:16.991 INFO:teuthology.orchestra.run.gibba026.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-05-27T20:33:16.991 INFO:teuthology.orchestra.run.gibba026.stdout:VERSION_ID="20.04" 2021-05-27T20:33:16.991 INFO:teuthology.orchestra.run.gibba026.stdout:HOME_URL="https://www.ubuntu.com/" 2021-05-27T20:33:16.992 INFO:teuthology.orchestra.run.gibba026.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-05-27T20:33:16.992 INFO:teuthology.orchestra.run.gibba026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-05-27T20:33:16.992 INFO:teuthology.orchestra.run.gibba026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-05-27T20:33:16.992 INFO:teuthology.orchestra.run.gibba026.stdout:VERSION_CODENAME=focal 2021-05-27T20:33:16.993 INFO:teuthology.orchestra.run.gibba026.stdout:UBUNTU_CODENAME=focal 2021-05-27T20:33:16.993 INFO:teuthology.lock.ops:Updating gibba026.front.sepia.ceph.com on lock server 2021-05-27T20:33:17.084 INFO:teuthology.dispatcher.supervisor:Running job 6119045 2021-05-27T20:33:17.084 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-05-18_03:15:03-fs-master-distro-basic-gibba/6119045 --name teuthology-2021-05-18_03:15:03-fs-master-distro-basic-gibba --description fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}} -- /home/teuthworker/archive/teuthology-2021-05-18_03:15:03-fs-master-distro-basic-gibba/6119045/orig.config.yaml 2021-05-27T20:33:17.088 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-05-18_03:15:03-fs-master-distro-basic-gibba/6119045 2021-05-27T20:33:17.089 INFO:teuthology.dispatcher.supervisor:Job PID: 31196 2021-05-27T20:33:17.089 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-05-28T08:34:09.647 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-05-28T08:34:09.879 INFO:teuthology.kill:Killing Pids: {31196} 2021-05-28T08:34:11.766 INFO:teuthology.kill:Nuking machines: ['gibba018', 'gibba026'] 2021-05-28T08:34:12.765 INFO:teuthology.kill:2021-05-28 08:34:12,765.765 INFO:teuthology.nuke:targets: 2021-05-28T08:34:12.766 INFO:teuthology.kill: gibba018.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDyi4U+lsDmLt3cSTn3wHNcQ9pbir2fDQV4r5ykJWYwXYHWm1GjS4sPPt1SMbUcAQ/aMA5trANBr/b5JXo4wwgZjqrdIO/Sj6vXBVnMaOlohgLZpL8nVFIZv4Ca1D+ltL5LT8MFvQX9xeIcNnuD4PmCVcGxSsvXCkh+od7m0mvWnxxy2e5IK4GJezZJEQEWaLuiir/YzgEpkyVqky8wMkKEViAyFEIQfw3Ir8BU9gP9PM+io2mf5IiiZJKpV5GBiIKrI6ST2h0bJQEMeqfhNXnSMgDWBr/DMvZyjZpgMVGmlbSRh27L6V35JOs1KTZJdlujk4m4AE927araa1wLrhtv3g3ZVXYuhWnThqTC+Yd9cgp0uCk5zZ0pXtvVpheIL7hqLTy33Sl+0ZLe7mNghFmpZS45sRYkJfEYQtlHqCAwLWe5rp4WLlMSprtTJbh+OBZMy5mRvWHSvdU3rx/l8vfeDh62gYKszSH3qrAHlcenxnvn15D8TLODIqOjuA47088= 2021-05-28T08:34:12.767 INFO:teuthology.kill: gibba026.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuYab1S++/T39do7CAAPUhZ8NAWNCnrc1VDh6BjICNTBsOpP/ZJzppAt5rWZQf05Wy07gu8mGI5cXRj3C1Rg6BtDehqZtsg0GIq+eo1HGLzWH77Ln3Umtza77c5lYrWwzOT5ePDhgWhwjSZqz75gyMM++Khu8O3IuE0U8cxpXNl2jRaRkLPhNrIHPERIP5XtmG++8OvaG2TlY1AWC4wO97RRkYn0BzkJOBvECdWDRLWj5sUd21BKlPqDPHXTAYyPKWdost4JANP11mYZSfPjnmWWvS5DtIX8wEw6VECVfOxjBJsJigMfQCdgY6y1xf1ngByL9ON6nKzqNICPA6lmOwMPz99gK/N7L9OyAH0RAVgoIEvUoieWVrOOXa3jb3a5/ttDBDrLB9b3u4vruDunR1DONgsFkerM4uspT8fkY0ZtQhgTw0QHPE+blYT/ti7dxQD8OUAEIX+VjzUzwI6t+rmpmVsg8Qqdc1CaKndX9FeWGQzQTjDLHQKptH2mJHg+c= 2021-05-28T08:34:12.767 INFO:teuthology.kill:2021-05-28 08:34:12,765.765 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-28T08:34:12.768 INFO:teuthology.kill:2021-05-28 08:34:12,768.768 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-28T08:34:12.826 INFO:teuthology.kill:2021-05-28 08:34:12,825.825 INFO:teuthology.orchestra.console:Power off gibba026 2021-05-28T08:34:12.842 INFO:teuthology.kill:2021-05-28 08:34:12,841.841 INFO:teuthology.orchestra.console:Power off gibba018 2021-05-28T08:34:21.207 INFO:teuthology.kill:2021-05-28 08:34:21,207.207 INFO:teuthology.orchestra.console:Power off for gibba026 completed 2021-05-28T08:34:21.236 INFO:teuthology.kill:2021-05-28 08:34:21,236.236 INFO:teuthology.orchestra.console:Power off for gibba018 completed 2021-05-28T08:34:21.468 INFO:teuthology.task.internal:roles: ubuntu@gibba018.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2021-05-28T08:34:21.469 INFO:teuthology.task.internal:roles: ubuntu@gibba026.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2021-05-28T08:34:21.470 INFO:teuthology.misc:Compressing logs... 2021-05-28T08:34:21.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-28T08:35:21.531 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-05-28T08:35:21.598 INFO:teuthology.kill:No teuthology processes running 2021-05-28T08:35:22.728 INFO:teuthology.kill:Nuking machines: ['gibba018', 'gibba026'] 2021-05-28T08:35:23.856 INFO:teuthology.kill:2021-05-28 08:35:23,856.856 INFO:teuthology.nuke:targets: 2021-05-28T08:35:23.858 INFO:teuthology.kill: gibba018.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDyi4U+lsDmLt3cSTn3wHNcQ9pbir2fDQV4r5ykJWYwXYHWm1GjS4sPPt1SMbUcAQ/aMA5trANBr/b5JXo4wwgZjqrdIO/Sj6vXBVnMaOlohgLZpL8nVFIZv4Ca1D+ltL5LT8MFvQX9xeIcNnuD4PmCVcGxSsvXCkh+od7m0mvWnxxy2e5IK4GJezZJEQEWaLuiir/YzgEpkyVqky8wMkKEViAyFEIQfw3Ir8BU9gP9PM+io2mf5IiiZJKpV5GBiIKrI6ST2h0bJQEMeqfhNXnSMgDWBr/DMvZyjZpgMVGmlbSRh27L6V35JOs1KTZJdlujk4m4AE927araa1wLrhtv3g3ZVXYuhWnThqTC+Yd9cgp0uCk5zZ0pXtvVpheIL7hqLTy33Sl+0ZLe7mNghFmpZS45sRYkJfEYQtlHqCAwLWe5rp4WLlMSprtTJbh+OBZMy5mRvWHSvdU3rx/l8vfeDh62gYKszSH3qrAHlcenxnvn15D8TLODIqOjuA47088= 2021-05-28T08:35:23.858 INFO:teuthology.kill: gibba026.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuYab1S++/T39do7CAAPUhZ8NAWNCnrc1VDh6BjICNTBsOpP/ZJzppAt5rWZQf05Wy07gu8mGI5cXRj3C1Rg6BtDehqZtsg0GIq+eo1HGLzWH77Ln3Umtza77c5lYrWwzOT5ePDhgWhwjSZqz75gyMM++Khu8O3IuE0U8cxpXNl2jRaRkLPhNrIHPERIP5XtmG++8OvaG2TlY1AWC4wO97RRkYn0BzkJOBvECdWDRLWj5sUd21BKlPqDPHXTAYyPKWdost4JANP11mYZSfPjnmWWvS5DtIX8wEw6VECVfOxjBJsJigMfQCdgY6y1xf1ngByL9ON6nKzqNICPA6lmOwMPz99gK/N7L9OyAH0RAVgoIEvUoieWVrOOXa3jb3a5/ttDBDrLB9b3u4vruDunR1DONgsFkerM4uspT8fkY0ZtQhgTw0QHPE+blYT/ti7dxQD8OUAEIX+VjzUzwI6t+rmpmVsg8Qqdc1CaKndX9FeWGQzQTjDLHQKptH2mJHg+c= 2021-05-28T08:35:23.897 INFO:teuthology.kill:2021-05-28 08:35:23,896.896 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-28T08:35:23.906 INFO:teuthology.kill:2021-05-28 08:35:23,906.906 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-28T08:35:23.990 INFO:teuthology.kill:2021-05-28 08:35:23,990.990 INFO:teuthology.orchestra.console:Power off gibba018 2021-05-28T08:35:24.009 INFO:teuthology.kill:2021-05-28 08:35:24,009.009 INFO:teuthology.orchestra.console:Power off gibba026 2021-05-28T08:35:24.162 INFO:teuthology.kill:2021-05-28 08:35:24,161.161 INFO:teuthology.orchestra.console:Power off for gibba018 completed 2021-05-28T08:35:24.171 INFO:teuthology.kill:2021-05-28 08:35:24,171.171 INFO:teuthology.orchestra.console:Power off for gibba026 completed 2021-05-28T08:35:24.302 INFO:teuthology.kill:2021-05-28 08:35:24,301.301 INFO:teuthology.lock.ops:unlocked gibba018.front.sepia.ceph.com 2021-05-28T08:35:24.317 INFO:teuthology.kill:2021-05-28 08:35:24,317.317 INFO:teuthology.lock.ops:unlocked gibba026.front.sepia.ceph.com 2021-05-28T08:37:24.640 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15