2021-05-27T20:04:12.531 INFO:root:teuthology version: 1.1.0-630d5963 2021-05-27T20:04:12.633 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba010.front.sepia.ceph.com' reimaging 2021-05-27T20:04:12.635 INFO:teuthology.lock.ops:Updating [ubuntu@gibba010.front.sepia.ceph.com]: reset os type and version on server 2021-05-27T20:04:12.635 INFO:teuthology.lock.ops:Updating gibba010.front.sepia.ceph.com on lock server 2021-05-27T20:04:12.659 INFO:teuthology.lock.ops:Node 'ubuntu@gibba010.front.sepia.ceph.com' reimaging is complete 2021-05-27T20:04:12.659 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba029.front.sepia.ceph.com' reimaging 2021-05-27T20:04:12.659 INFO:teuthology.lock.ops:Updating [ubuntu@gibba029.front.sepia.ceph.com]: reset os type and version on server 2021-05-27T20:04:12.660 INFO:teuthology.lock.ops:Updating gibba029.front.sepia.ceph.com on lock server 2021-05-27T20:04:12.676 INFO:teuthology.lock.ops:Node 'ubuntu@gibba029.front.sepia.ceph.com' reimaging is complete 2021-05-27T20:04:12.978 INFO:teuthology.provision.fog.gibba010:Scheduling deploy of ubuntu 20.04 2021-05-27T20:04:12.986 INFO:teuthology.provision.fog.gibba029:Scheduling deploy of ubuntu 20.04 2021-05-27T20:04:13.523 INFO:teuthology.orchestra.console:Power off gibba010 2021-05-27T20:04:13.538 INFO:teuthology.orchestra.console:Power off gibba029 2021-05-27T20:04:13.689 INFO:teuthology.orchestra.console:Power off for gibba010 completed 2021-05-27T20:04:13.699 INFO:teuthology.orchestra.console:Power off for gibba029 completed 2021-05-27T20:04:13.792 INFO:teuthology.orchestra.console:Power on gibba010 2021-05-27T20:04:13.801 INFO:teuthology.orchestra.console:Power on gibba029 2021-05-27T20:04:22.169 INFO:teuthology.orchestra.console:Power on for gibba010 completed 2021-05-27T20:04:22.177 INFO:teuthology.orchestra.console:Power on for gibba029 completed 2021-05-27T20:04:22.272 INFO:teuthology.provision.fog.gibba010:Waiting for deploy to finish 2021-05-27T20:04:22.278 INFO:teuthology.provision.fog.gibba029:Waiting for deploy to finish 2021-05-27T20:09:07.759 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-27T20:09:08.231 INFO:teuthology.provision.fog.gibba010:Node is ready 2021-05-27T20:09:08.240 INFO:teuthology.orchestra.run.gibba010.stdout:gibba010.front.sepia.ceph.com 2021-05-27T20:09:08.245 INFO:teuthology.orchestra.run.gibba010.stdout:172.21.2.110 gibba010.front.sepia.ceph.com gibba010 2021-05-27T20:09:08.516 INFO:teuthology.provision.fog.gibba010:Deploy complete! 2021-05-27T20:09:12.142 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-27T20:09:12.441 INFO:teuthology.provision.fog.gibba029:Node is ready 2021-05-27T20:09:12.449 INFO:teuthology.orchestra.run.gibba029.stdout:gibba029.front.sepia.ceph.com 2021-05-27T20:09:12.459 INFO:teuthology.orchestra.run.gibba029.stdout:172.21.2.129 gibba029.front.sepia.ceph.com gibba029 2021-05-27T20:09:12.667 INFO:teuthology.provision.fog.gibba029:Deploy complete! 2021-05-27T20:09:12.824 INFO:teuthology.lock.ops:Checking gibba010.front.sepia.ceph.com 2021-05-27T20:09:12.825 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-27T20:09:12.841 INFO:teuthology.lock.ops:Checking gibba029.front.sepia.ceph.com 2021-05-27T20:09:12.842 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-27T20:09:12.858 INFO:teuthology.lock.ops:Updating [gibba010.front.sepia.ceph.com]: set os type and version on server 2021-05-27T20:09:12.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-27T20:09:13.092 INFO:teuthology.orchestra.run.gibba010.stdout:x86_64 2021-05-27T20:09:13.108 INFO:teuthology.orchestra.run.gibba010.stdout:NAME="Ubuntu" 2021-05-27T20:09:13.108 INFO:teuthology.orchestra.run.gibba010.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-05-27T20:09:13.108 INFO:teuthology.orchestra.run.gibba010.stdout:ID=ubuntu 2021-05-27T20:09:13.109 INFO:teuthology.orchestra.run.gibba010.stdout:ID_LIKE=debian 2021-05-27T20:09:13.109 INFO:teuthology.orchestra.run.gibba010.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-05-27T20:09:13.109 INFO:teuthology.orchestra.run.gibba010.stdout:VERSION_ID="20.04" 2021-05-27T20:09:13.109 INFO:teuthology.orchestra.run.gibba010.stdout:HOME_URL="https://www.ubuntu.com/" 2021-05-27T20:09:13.109 INFO:teuthology.orchestra.run.gibba010.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-05-27T20:09:13.110 INFO:teuthology.orchestra.run.gibba010.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-05-27T20:09:13.110 INFO:teuthology.orchestra.run.gibba010.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-05-27T20:09:13.110 INFO:teuthology.orchestra.run.gibba010.stdout:VERSION_CODENAME=focal 2021-05-27T20:09:13.110 INFO:teuthology.orchestra.run.gibba010.stdout:UBUNTU_CODENAME=focal 2021-05-27T20:09:13.111 INFO:teuthology.lock.ops:Updating gibba010.front.sepia.ceph.com on lock server 2021-05-27T20:09:13.127 INFO:teuthology.lock.ops:Updating [gibba029.front.sepia.ceph.com]: set os type and version on server 2021-05-27T20:09:13.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-27T20:09:13.251 INFO:teuthology.orchestra.run.gibba029.stdout:x86_64 2021-05-27T20:09:13.305 INFO:teuthology.orchestra.run.gibba029.stdout:NAME="Ubuntu" 2021-05-27T20:09:13.305 INFO:teuthology.orchestra.run.gibba029.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-05-27T20:09:13.305 INFO:teuthology.orchestra.run.gibba029.stdout:ID=ubuntu 2021-05-27T20:09:13.306 INFO:teuthology.orchestra.run.gibba029.stdout:ID_LIKE=debian 2021-05-27T20:09:13.306 INFO:teuthology.orchestra.run.gibba029.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-05-27T20:09:13.306 INFO:teuthology.orchestra.run.gibba029.stdout:VERSION_ID="20.04" 2021-05-27T20:09:13.306 INFO:teuthology.orchestra.run.gibba029.stdout:HOME_URL="https://www.ubuntu.com/" 2021-05-27T20:09:13.306 INFO:teuthology.orchestra.run.gibba029.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-05-27T20:09:13.307 INFO:teuthology.orchestra.run.gibba029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-05-27T20:09:13.307 INFO:teuthology.orchestra.run.gibba029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-05-27T20:09:13.307 INFO:teuthology.orchestra.run.gibba029.stdout:VERSION_CODENAME=focal 2021-05-27T20:09:13.307 INFO:teuthology.orchestra.run.gibba029.stdout:UBUNTU_CODENAME=focal 2021-05-27T20:09:13.308 INFO:teuthology.lock.ops:Updating gibba029.front.sepia.ceph.com on lock server 2021-05-27T20:09:13.396 INFO:teuthology.dispatcher.supervisor:Running job 6119039 2021-05-27T20:09:13.396 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-05-18_03:15:03-fs-master-distro-basic-gibba/6119039 --name teuthology-2021-05-18_03:15:03-fs-master-distro-basic-gibba --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin} -- /home/teuthworker/archive/teuthology-2021-05-18_03:15:03-fs-master-distro-basic-gibba/6119039/orig.config.yaml 2021-05-27T20:09:13.401 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-05-18_03:15:03-fs-master-distro-basic-gibba/6119039 2021-05-27T20:09:13.402 INFO:teuthology.dispatcher.supervisor:Job PID: 6291 2021-05-27T20:09:13.402 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-05-28T08:10:05.093 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-05-28T08:10:05.308 INFO:teuthology.kill:Killing Pids: {6291} 2021-05-28T08:10:06.419 INFO:teuthology.kill:Nuking machines: ['gibba010', 'gibba029'] 2021-05-28T08:10:07.430 INFO:teuthology.kill:2021-05-28 08:10:07,430.430 INFO:teuthology.nuke:targets: 2021-05-28T08:10:07.431 INFO:teuthology.kill: gibba010.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLSChjX7KDGLCMV0RrDPenTFrtqO9seNshg3jVhnDXtr+BIDAn1MYJb3XI3jxYj2MtPYev9VsNQ5X8KijLIqmVQ3kpMpPEaSF+FfaPo0vcFpCpFyXR/xc4MzCRBkP+9vs6SzR72UOWa2byOnLAnr03nzAE+0Dl82Rlv/g2hXReqv7++3yGihjL6jLdGXm/0NAN6vkbWwj1c+hhZLy0LEXWRxcKNseFLapR4k/TRo2lWGQ71lbAcePXboxskeaGBUiXGkc6DYbOOAwKySIoqFMF4EafB0Ui3u7fDvmv54bhfknqlwUhyebtlXWWYD1AxUUBniAY4tYLncbmL7P2KlT001cl9mKzmgjfK3iSixr4nQBJl54bYlX2VA2AJ6HBSiD85Fq5xPG9ilLZvSNma3L40R+YRulbDTxfeeHb4mOxI+0jnSht2p5Hm2L4k8yPIlDmkrHMCXxQCclsIY4uip6L1il6QCgUPiPX5BEMxrSCzL9ITcsJTi/rgd/71WkDWVE= 2021-05-28T08:10:07.431 INFO:teuthology.kill: gibba029.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdJbU4paFRbSzjoCJVCVlkwlsjO3T9rTFv6sC9kQOfMurhX0GmaWp/bgmh1FAjLy8dNfakimYxt7eYSvmA423cOZGqO/08JQRTNQ0oxEVd3zKhq0LYGdG6VQT02B+MfgvL8zzPrs+Wn8E+5/SPctowlPx7L1VAkECKY4fc5r0ffhfxzxQAv8zSB30f+J0I1WrSQoxMhNf3pE2sQFl1WhJuRAThdtCmUcQrl+gC0FLGr91q5KEZ4WYzMzbQ8z9n2YMuIZh8ImulIPOtKeuJWTu4RiBY5qf7od9aRqSOPrkQbCDdh9bMIoyqIcnyCU9u2RwJZbByhkcwLx31iOuajsmfDstHkXqnOWjtfFAwkpgreec0ex5NXx2+xscpsiB5ry1HX2fMR6iJdCWMIGkHOyZzzVoIIXzFMszJeZtEh2MwTYDwKib2n5UHYWJxZVxz9NuigzEWWIOOuJgHhhIkuZz2E8CI+Ze2kBgFiwx60b02fyHrxipeke86CnnwxoEcgZU= 2021-05-28T08:10:07.432 INFO:teuthology.kill:2021-05-28 08:10:07,430.430 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-28T08:10:07.433 INFO:teuthology.kill:2021-05-28 08:10:07,433.433 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-28T08:10:07.497 INFO:teuthology.kill:2021-05-28 08:10:07,497.497 INFO:teuthology.orchestra.console:Power off gibba029 2021-05-28T08:10:07.511 INFO:teuthology.kill:2021-05-28 08:10:07,511.511 INFO:teuthology.orchestra.console:Power off gibba010 2021-05-28T08:10:15.871 INFO:teuthology.kill:2021-05-28 08:10:15,871.871 INFO:teuthology.orchestra.console:Power off for gibba029 completed 2021-05-28T08:10:15.887 INFO:teuthology.kill:2021-05-28 08:10:15,887.887 INFO:teuthology.orchestra.console:Power off for gibba010 completed 2021-05-28T08:10:16.125 INFO:teuthology.task.internal:roles: ubuntu@gibba010.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2021-05-28T08:10:16.125 INFO:teuthology.task.internal:roles: ubuntu@gibba029.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2021-05-28T08:10:16.126 INFO:teuthology.misc:Compressing logs... 2021-05-28T08:10:16.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-28T08:11:16.188 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_630d5963a6194f6b5a287f9a69bf6cea3ae44211/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-05-28T08:11:16.257 INFO:teuthology.kill:No teuthology processes running 2021-05-28T08:11:17.457 INFO:teuthology.kill:Nuking machines: ['gibba010', 'gibba029'] 2021-05-28T08:11:18.446 INFO:teuthology.kill:2021-05-28 08:11:18,446.446 INFO:teuthology.nuke:targets: 2021-05-28T08:11:18.447 INFO:teuthology.kill: gibba010.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLSChjX7KDGLCMV0RrDPenTFrtqO9seNshg3jVhnDXtr+BIDAn1MYJb3XI3jxYj2MtPYev9VsNQ5X8KijLIqmVQ3kpMpPEaSF+FfaPo0vcFpCpFyXR/xc4MzCRBkP+9vs6SzR72UOWa2byOnLAnr03nzAE+0Dl82Rlv/g2hXReqv7++3yGihjL6jLdGXm/0NAN6vkbWwj1c+hhZLy0LEXWRxcKNseFLapR4k/TRo2lWGQ71lbAcePXboxskeaGBUiXGkc6DYbOOAwKySIoqFMF4EafB0Ui3u7fDvmv54bhfknqlwUhyebtlXWWYD1AxUUBniAY4tYLncbmL7P2KlT001cl9mKzmgjfK3iSixr4nQBJl54bYlX2VA2AJ6HBSiD85Fq5xPG9ilLZvSNma3L40R+YRulbDTxfeeHb4mOxI+0jnSht2p5Hm2L4k8yPIlDmkrHMCXxQCclsIY4uip6L1il6QCgUPiPX5BEMxrSCzL9ITcsJTi/rgd/71WkDWVE= 2021-05-28T08:11:18.447 INFO:teuthology.kill: gibba029.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdJbU4paFRbSzjoCJVCVlkwlsjO3T9rTFv6sC9kQOfMurhX0GmaWp/bgmh1FAjLy8dNfakimYxt7eYSvmA423cOZGqO/08JQRTNQ0oxEVd3zKhq0LYGdG6VQT02B+MfgvL8zzPrs+Wn8E+5/SPctowlPx7L1VAkECKY4fc5r0ffhfxzxQAv8zSB30f+J0I1WrSQoxMhNf3pE2sQFl1WhJuRAThdtCmUcQrl+gC0FLGr91q5KEZ4WYzMzbQ8z9n2YMuIZh8ImulIPOtKeuJWTu4RiBY5qf7od9aRqSOPrkQbCDdh9bMIoyqIcnyCU9u2RwJZbByhkcwLx31iOuajsmfDstHkXqnOWjtfFAwkpgreec0ex5NXx2+xscpsiB5ry1HX2fMR6iJdCWMIGkHOyZzzVoIIXzFMszJeZtEh2MwTYDwKib2n5UHYWJxZVxz9NuigzEWWIOOuJgHhhIkuZz2E8CI+Ze2kBgFiwx60b02fyHrxipeke86CnnwxoEcgZU= 2021-05-28T08:11:18.470 INFO:teuthology.kill:2021-05-28 08:11:18,470.470 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-28T08:11:18.475 INFO:teuthology.kill:2021-05-28 08:11:18,475.475 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-28T08:11:18.537 INFO:teuthology.kill:2021-05-28 08:11:18,536.536 INFO:teuthology.orchestra.console:Power off gibba029 2021-05-28T08:11:18.553 INFO:teuthology.kill:2021-05-28 08:11:18,553.553 INFO:teuthology.orchestra.console:Power off gibba010 2021-05-28T08:11:18.688 INFO:teuthology.kill:2021-05-28 08:11:18,688.688 INFO:teuthology.orchestra.console:Power off for gibba029 completed 2021-05-28T08:11:18.704 INFO:teuthology.kill:2021-05-28 08:11:18,703.703 INFO:teuthology.orchestra.console:Power off for gibba010 completed 2021-05-28T08:11:18.832 INFO:teuthology.kill:2021-05-28 08:11:18,831.831 INFO:teuthology.lock.ops:unlocked gibba029.front.sepia.ceph.com 2021-05-28T08:11:18.849 INFO:teuthology.kill:2021-05-28 08:11:18,849.849 INFO:teuthology.lock.ops:unlocked gibba010.front.sepia.ceph.com 2021-05-28T08:13:19.128 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-05-28T08:13:19.261 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-05-28T08:13:19.262 INFO:teuthology.nuke:Checking targets against current locks 2021-05-28T08:13:19.355 INFO:teuthology.nuke:Not nuking gibba029.front.sepia.ceph.com because description doesn't match 2021-05-28T08:13:19.355 INFO:teuthology.nuke:Not nuking gibba010.front.sepia.ceph.com because description doesn't match