2021-08-30T21:28:59.756 INFO:root:teuthology version: 1.1.0-d0ccb5e7 2021-08-30T21:28:59.924 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba008.front.sepia.ceph.com' reimaging 2021-08-30T21:28:59.925 INFO:teuthology.lock.ops:Updating [ubuntu@gibba008.front.sepia.ceph.com]: reset os type and version on server 2021-08-30T21:28:59.926 INFO:teuthology.lock.ops:Updating gibba008.front.sepia.ceph.com on lock server 2021-08-30T21:28:59.961 INFO:teuthology.lock.ops:Node 'ubuntu@gibba008.front.sepia.ceph.com' reimaging is complete 2021-08-30T21:28:59.961 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba027.front.sepia.ceph.com' reimaging 2021-08-30T21:28:59.962 INFO:teuthology.lock.ops:Updating [ubuntu@gibba027.front.sepia.ceph.com]: reset os type and version on server 2021-08-30T21:28:59.962 INFO:teuthology.lock.ops:Updating gibba027.front.sepia.ceph.com on lock server 2021-08-30T21:28:59.979 INFO:teuthology.lock.ops:Node 'ubuntu@gibba027.front.sepia.ceph.com' reimaging is complete 2021-08-30T21:28:59.979 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba031.front.sepia.ceph.com' reimaging 2021-08-30T21:28:59.979 INFO:teuthology.lock.ops:Updating [ubuntu@gibba031.front.sepia.ceph.com]: reset os type and version on server 2021-08-30T21:28:59.980 INFO:teuthology.lock.ops:Updating gibba031.front.sepia.ceph.com on lock server 2021-08-30T21:28:59.993 INFO:teuthology.lock.ops:Node 'ubuntu@gibba031.front.sepia.ceph.com' reimaging is complete 2021-08-30T21:28:59.993 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba032.front.sepia.ceph.com' reimaging 2021-08-30T21:28:59.994 INFO:teuthology.lock.ops:Updating [ubuntu@gibba032.front.sepia.ceph.com]: reset os type and version on server 2021-08-30T21:28:59.994 INFO:teuthology.lock.ops:Updating gibba032.front.sepia.ceph.com on lock server 2021-08-30T21:29:00.009 INFO:teuthology.lock.ops:Node 'ubuntu@gibba032.front.sepia.ceph.com' reimaging is complete 2021-08-30T21:29:00.009 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba041.front.sepia.ceph.com' reimaging 2021-08-30T21:29:00.009 INFO:teuthology.lock.ops:Updating [ubuntu@gibba041.front.sepia.ceph.com]: reset os type and version on server 2021-08-30T21:29:00.009 INFO:teuthology.lock.ops:Updating gibba041.front.sepia.ceph.com on lock server 2021-08-30T21:29:00.023 INFO:teuthology.lock.ops:Node 'ubuntu@gibba041.front.sepia.ceph.com' reimaging is complete 2021-08-30T21:29:00.180 INFO:teuthology.provision.fog.gibba008:Scheduling deploy of ubuntu 20.04 2021-08-30T21:29:00.190 INFO:teuthology.provision.fog.gibba027:Scheduling deploy of ubuntu 20.04 2021-08-30T21:29:00.201 INFO:teuthology.provision.fog.gibba031:Scheduling deploy of ubuntu 20.04 2021-08-30T21:29:00.228 INFO:teuthology.provision.fog.gibba041:Scheduling deploy of ubuntu 20.04 2021-08-30T21:29:00.233 INFO:teuthology.provision.fog.gibba032:Scheduling deploy of ubuntu 20.04 2021-08-30T21:29:00.506 INFO:teuthology.orchestra.console:Power off gibba008 2021-08-30T21:29:00.543 INFO:teuthology.orchestra.console:Power off gibba041 2021-08-30T21:29:00.554 INFO:teuthology.orchestra.console:Power off gibba027 2021-08-30T21:29:00.590 INFO:teuthology.orchestra.console:Power off gibba032 2021-08-30T21:29:00.599 INFO:teuthology.orchestra.console:Power off gibba031 2021-08-30T21:29:00.668 INFO:teuthology.orchestra.console:Power off for gibba008 completed 2021-08-30T21:29:00.769 INFO:teuthology.orchestra.console:Power on gibba008 2021-08-30T21:29:05.025 INFO:teuthology.orchestra.console:Power on for gibba008 completed 2021-08-30T21:29:05.127 INFO:teuthology.provision.fog.gibba008:Waiting for deploy to finish 2021-08-30T21:29:08.932 INFO:teuthology.orchestra.console:Power off for gibba041 completed 2021-08-30T21:29:08.937 INFO:teuthology.orchestra.console:Power off for gibba027 completed 2021-08-30T21:29:08.965 INFO:teuthology.orchestra.console:Power off for gibba032 completed 2021-08-30T21:29:08.971 INFO:teuthology.orchestra.console:Power off for gibba031 completed 2021-08-30T21:29:09.034 INFO:teuthology.orchestra.console:Power on gibba041 2021-08-30T21:29:09.042 INFO:teuthology.orchestra.console:Power on gibba027 2021-08-30T21:29:09.066 INFO:teuthology.orchestra.console:Power on gibba032 2021-08-30T21:29:09.073 INFO:teuthology.orchestra.console:Power on gibba031 2021-08-30T21:29:17.417 INFO:teuthology.orchestra.console:Power on for gibba041 completed 2021-08-30T21:29:17.422 INFO:teuthology.orchestra.console:Power on for gibba027 completed 2021-08-30T21:29:17.428 INFO:teuthology.orchestra.console:Power on for gibba032 completed 2021-08-30T21:29:17.436 INFO:teuthology.orchestra.console:Power on for gibba031 completed 2021-08-30T21:29:17.519 INFO:teuthology.provision.fog.gibba041:Waiting for deploy to finish 2021-08-30T21:29:17.523 INFO:teuthology.provision.fog.gibba027:Waiting for deploy to finish 2021-08-30T21:29:17.530 INFO:teuthology.provision.fog.gibba032:Waiting for deploy to finish 2021-08-30T21:29:17.537 INFO:teuthology.provision.fog.gibba031:Waiting for deploy to finish 2021-08-30T21:33:50.486 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-08-30T21:33:50.898 INFO:teuthology.provision.fog.gibba008:Node is ready 2021-08-30T21:33:50.901 INFO:teuthology.orchestra.run.gibba008.stdout:gibba008.front.sepia.ceph.com 2021-08-30T21:33:50.905 INFO:teuthology.orchestra.run.gibba008.stdout:172.21.2.108 gibba008.front.sepia.ceph.com gibba008 2021-08-30T21:33:51.025 INFO:teuthology.provision.fog.gibba008:Deploy complete! 2021-08-30T21:33:59.812 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-08-30T21:34:00.239 INFO:teuthology.provision.fog.gibba027:Node is ready 2021-08-30T21:34:00.243 INFO:teuthology.orchestra.run.gibba027.stdout:gibba027.front.sepia.ceph.com 2021-08-30T21:34:00.292 INFO:teuthology.orchestra.run.gibba027.stdout:172.21.2.127 gibba027.front.sepia.ceph.com gibba027 2021-08-30T21:34:00.460 INFO:teuthology.provision.fog.gibba027:Deploy complete! 2021-08-30T21:34:03.008 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-08-30T21:34:03.033 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-08-30T21:34:03.409 INFO:teuthology.provision.fog.gibba041:Node is ready 2021-08-30T21:34:03.459 INFO:teuthology.orchestra.run.gibba041.stdout:gibba041.front.sepia.ceph.com 2021-08-30T21:34:03.468 INFO:teuthology.orchestra.run.gibba041.stdout:172.21.2.141 gibba041.front.sepia.ceph.com gibba041 2021-08-30T21:34:03.471 INFO:teuthology.provision.fog.gibba032:Node is ready 2021-08-30T21:34:03.476 INFO:teuthology.orchestra.run.gibba032.stdout:gibba032.front.sepia.ceph.com 2021-08-30T21:34:03.482 INFO:teuthology.orchestra.run.gibba032.stdout:172.21.2.132 gibba032.front.sepia.ceph.com gibba032 2021-08-30T21:34:03.582 INFO:teuthology.provision.fog.gibba041:Deploy complete! 2021-08-30T21:34:03.676 INFO:teuthology.provision.fog.gibba032:Deploy complete! 2021-08-30T21:34:04.478 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-08-30T21:34:04.877 INFO:teuthology.provision.fog.gibba031:Node is ready 2021-08-30T21:34:04.884 INFO:teuthology.orchestra.run.gibba031.stdout:gibba031.front.sepia.ceph.com 2021-08-30T21:34:04.892 INFO:teuthology.orchestra.run.gibba031.stdout:172.21.2.131 gibba031.front.sepia.ceph.com gibba031 2021-08-30T21:34:05.041 INFO:teuthology.provision.fog.gibba031:Deploy complete! 2021-08-30T21:34:05.254 INFO:teuthology.lock.ops:Checking gibba008.front.sepia.ceph.com 2021-08-30T21:34:05.255 INFO:teuthology.lock.ops:New key found. Updating... 2021-08-30T21:34:05.272 INFO:teuthology.lock.ops:Checking gibba027.front.sepia.ceph.com 2021-08-30T21:34:05.272 INFO:teuthology.lock.ops:New key found. Updating... 2021-08-30T21:34:05.286 INFO:teuthology.lock.ops:Checking gibba031.front.sepia.ceph.com 2021-08-30T21:34:05.286 INFO:teuthology.lock.ops:New key found. Updating... 2021-08-30T21:34:05.299 INFO:teuthology.lock.ops:Checking gibba032.front.sepia.ceph.com 2021-08-30T21:34:05.299 INFO:teuthology.lock.ops:New key found. Updating... 2021-08-30T21:34:05.313 INFO:teuthology.lock.ops:Checking gibba041.front.sepia.ceph.com 2021-08-30T21:34:05.313 INFO:teuthology.lock.ops:New key found. Updating... 2021-08-30T21:34:05.327 INFO:teuthology.lock.ops:Updating [gibba008.front.sepia.ceph.com]: set os type and version on server 2021-08-30T21:34:05.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-30T21:34:05.550 INFO:teuthology.orchestra.run.gibba008.stdout:x86_64 2021-08-30T21:34:05.555 INFO:teuthology.orchestra.run.gibba008.stdout:NAME="Ubuntu" 2021-08-30T21:34:05.555 INFO:teuthology.orchestra.run.gibba008.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-08-30T21:34:05.556 INFO:teuthology.orchestra.run.gibba008.stdout:ID=ubuntu 2021-08-30T21:34:05.556 INFO:teuthology.orchestra.run.gibba008.stdout:ID_LIKE=debian 2021-08-30T21:34:05.556 INFO:teuthology.orchestra.run.gibba008.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-08-30T21:34:05.556 INFO:teuthology.orchestra.run.gibba008.stdout:VERSION_ID="20.04" 2021-08-30T21:34:05.557 INFO:teuthology.orchestra.run.gibba008.stdout:HOME_URL="https://www.ubuntu.com/" 2021-08-30T21:34:05.557 INFO:teuthology.orchestra.run.gibba008.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-08-30T21:34:05.557 INFO:teuthology.orchestra.run.gibba008.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-08-30T21:34:05.557 INFO:teuthology.orchestra.run.gibba008.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-08-30T21:34:05.558 INFO:teuthology.orchestra.run.gibba008.stdout:VERSION_CODENAME=focal 2021-08-30T21:34:05.558 INFO:teuthology.orchestra.run.gibba008.stdout:UBUNTU_CODENAME=focal 2021-08-30T21:34:05.559 INFO:teuthology.lock.ops:Updating gibba008.front.sepia.ceph.com on lock server 2021-08-30T21:34:05.575 INFO:teuthology.lock.ops:Updating [gibba027.front.sepia.ceph.com]: set os type and version on server 2021-08-30T21:34:05.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-30T21:34:05.739 INFO:teuthology.orchestra.run.gibba027.stdout:x86_64 2021-08-30T21:34:05.748 INFO:teuthology.orchestra.run.gibba027.stdout:NAME="Ubuntu" 2021-08-30T21:34:05.748 INFO:teuthology.orchestra.run.gibba027.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-08-30T21:34:05.749 INFO:teuthology.orchestra.run.gibba027.stdout:ID=ubuntu 2021-08-30T21:34:05.749 INFO:teuthology.orchestra.run.gibba027.stdout:ID_LIKE=debian 2021-08-30T21:34:05.749 INFO:teuthology.orchestra.run.gibba027.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-08-30T21:34:05.749 INFO:teuthology.orchestra.run.gibba027.stdout:VERSION_ID="20.04" 2021-08-30T21:34:05.750 INFO:teuthology.orchestra.run.gibba027.stdout:HOME_URL="https://www.ubuntu.com/" 2021-08-30T21:34:05.750 INFO:teuthology.orchestra.run.gibba027.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-08-30T21:34:05.750 INFO:teuthology.orchestra.run.gibba027.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-08-30T21:34:05.750 INFO:teuthology.orchestra.run.gibba027.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-08-30T21:34:05.750 INFO:teuthology.orchestra.run.gibba027.stdout:VERSION_CODENAME=focal 2021-08-30T21:34:05.751 INFO:teuthology.orchestra.run.gibba027.stdout:UBUNTU_CODENAME=focal 2021-08-30T21:34:05.751 INFO:teuthology.lock.ops:Updating gibba027.front.sepia.ceph.com on lock server 2021-08-30T21:34:05.767 INFO:teuthology.lock.ops:Updating [gibba031.front.sepia.ceph.com]: set os type and version on server 2021-08-30T21:34:05.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-30T21:34:05.922 INFO:teuthology.orchestra.run.gibba031.stdout:x86_64 2021-08-30T21:34:05.931 INFO:teuthology.orchestra.run.gibba031.stdout:NAME="Ubuntu" 2021-08-30T21:34:05.931 INFO:teuthology.orchestra.run.gibba031.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-08-30T21:34:05.931 INFO:teuthology.orchestra.run.gibba031.stdout:ID=ubuntu 2021-08-30T21:34:05.931 INFO:teuthology.orchestra.run.gibba031.stdout:ID_LIKE=debian 2021-08-30T21:34:05.932 INFO:teuthology.orchestra.run.gibba031.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-08-30T21:34:05.932 INFO:teuthology.orchestra.run.gibba031.stdout:VERSION_ID="20.04" 2021-08-30T21:34:05.932 INFO:teuthology.orchestra.run.gibba031.stdout:HOME_URL="https://www.ubuntu.com/" 2021-08-30T21:34:05.932 INFO:teuthology.orchestra.run.gibba031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-08-30T21:34:05.933 INFO:teuthology.orchestra.run.gibba031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-08-30T21:34:05.933 INFO:teuthology.orchestra.run.gibba031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-08-30T21:34:05.933 INFO:teuthology.orchestra.run.gibba031.stdout:VERSION_CODENAME=focal 2021-08-30T21:34:05.933 INFO:teuthology.orchestra.run.gibba031.stdout:UBUNTU_CODENAME=focal 2021-08-30T21:34:05.934 INFO:teuthology.lock.ops:Updating gibba031.front.sepia.ceph.com on lock server 2021-08-30T21:34:05.951 INFO:teuthology.lock.ops:Updating [gibba032.front.sepia.ceph.com]: set os type and version on server 2021-08-30T21:34:05.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-30T21:34:06.070 INFO:teuthology.orchestra.run.gibba032.stdout:x86_64 2021-08-30T21:34:06.074 INFO:teuthology.orchestra.run.gibba032.stdout:NAME="Ubuntu" 2021-08-30T21:34:06.074 INFO:teuthology.orchestra.run.gibba032.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-08-30T21:34:06.075 INFO:teuthology.orchestra.run.gibba032.stdout:ID=ubuntu 2021-08-30T21:34:06.075 INFO:teuthology.orchestra.run.gibba032.stdout:ID_LIKE=debian 2021-08-30T21:34:06.075 INFO:teuthology.orchestra.run.gibba032.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-08-30T21:34:06.075 INFO:teuthology.orchestra.run.gibba032.stdout:VERSION_ID="20.04" 2021-08-30T21:34:06.076 INFO:teuthology.orchestra.run.gibba032.stdout:HOME_URL="https://www.ubuntu.com/" 2021-08-30T21:34:06.076 INFO:teuthology.orchestra.run.gibba032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-08-30T21:34:06.076 INFO:teuthology.orchestra.run.gibba032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-08-30T21:34:06.076 INFO:teuthology.orchestra.run.gibba032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-08-30T21:34:06.077 INFO:teuthology.orchestra.run.gibba032.stdout:VERSION_CODENAME=focal 2021-08-30T21:34:06.077 INFO:teuthology.orchestra.run.gibba032.stdout:UBUNTU_CODENAME=focal 2021-08-30T21:34:06.077 INFO:teuthology.lock.ops:Updating gibba032.front.sepia.ceph.com on lock server 2021-08-30T21:34:06.095 INFO:teuthology.lock.ops:Updating [gibba041.front.sepia.ceph.com]: set os type and version on server 2021-08-30T21:34:06.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-30T21:34:06.219 INFO:teuthology.orchestra.run.gibba041.stdout:x86_64 2021-08-30T21:34:06.224 INFO:teuthology.orchestra.run.gibba041.stdout:NAME="Ubuntu" 2021-08-30T21:34:06.224 INFO:teuthology.orchestra.run.gibba041.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-08-30T21:34:06.224 INFO:teuthology.orchestra.run.gibba041.stdout:ID=ubuntu 2021-08-30T21:34:06.224 INFO:teuthology.orchestra.run.gibba041.stdout:ID_LIKE=debian 2021-08-30T21:34:06.224 INFO:teuthology.orchestra.run.gibba041.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-08-30T21:34:06.225 INFO:teuthology.orchestra.run.gibba041.stdout:VERSION_ID="20.04" 2021-08-30T21:34:06.225 INFO:teuthology.orchestra.run.gibba041.stdout:HOME_URL="https://www.ubuntu.com/" 2021-08-30T21:34:06.225 INFO:teuthology.orchestra.run.gibba041.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-08-30T21:34:06.225 INFO:teuthology.orchestra.run.gibba041.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-08-30T21:34:06.226 INFO:teuthology.orchestra.run.gibba041.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-08-30T21:34:06.226 INFO:teuthology.orchestra.run.gibba041.stdout:VERSION_CODENAME=focal 2021-08-30T21:34:06.226 INFO:teuthology.orchestra.run.gibba041.stdout:UBUNTU_CODENAME=focal 2021-08-30T21:34:06.227 INFO:teuthology.lock.ops:Updating gibba041.front.sepia.ceph.com on lock server 2021-08-30T21:34:06.306 INFO:teuthology.dispatcher.supervisor:Running job 6361324 2021-08-30T21:34:06.306 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-08-27_04:10:06-fs-octopus-distro-basic-gibba/6361324 --name teuthology-2021-08-27_04:10:06-fs-octopus-distro-basic-gibba --description fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} -- /home/teuthworker/archive/teuthology-2021-08-27_04:10:06-fs-octopus-distro-basic-gibba/6361324/orig.config.yaml 2021-08-30T21:34:06.309 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-08-27_04:10:06-fs-octopus-distro-basic-gibba/6361324 2021-08-30T21:34:06.310 INFO:teuthology.dispatcher.supervisor:Job PID: 9217 2021-08-30T21:34:06.311 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-08-31T09:34:49.838 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-08-31T09:34:50.045 INFO:teuthology.kill:Killing Pids: {9217} 2021-08-31T09:34:51.828 INFO:teuthology.kill:Nuking machines: ['gibba008', 'gibba027', 'gibba031', 'gibba032', 'gibba041'] 2021-08-31T09:34:52.728 INFO:teuthology.kill:2021-08-31 09:34:52,728.728 INFO:teuthology.nuke:targets: 2021-08-31T09:34:52.729 INFO:teuthology.kill: gibba008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChOtfnDvOuX4W2OVqGbqRBoFhg5rVxqlYS9ZBCTgj/vdlxWQqNd0/NsTH05BR88Y2x6xCCY/FEh0VDWDxXF5HaD0G0nS59dCmV/DB2Mz1s49fNI1zejMHAvJ9TKEtawxfKup9r59BmKpsTz/fcxHNuolU5ta4MtLpcwQs4uPvvV2VcGaI0H0BDzjxmRkQkhymRTEPVW8Us8Dpr+EMYJ95aEJCRjzdyqp/7RENSdCBx4OM5H9VO1dublz14b0B6Ml/gl1wJIq0i5+Et8MA60DgIDj/7mFPfWRi3lDFjj/sXK1sT2jUBS+I44+3hqglQAMwuOnBerpEchgRN9Gx3O7LGHIm7todHWSAC4gb9i9mDmfKGSbZGmaihQ4b21v97QgCmv6y0pVM/kwcl/GRInZ7zAY3tXidiE6/k75N+pSO+pgiWrTBZFu+JC072kztvbZh4odahWhW6TlxOaz2ZojlOzy2aAZ9uXPjCBP1NbqbTnK7OdeyJ1PFvc2c2mXNZ310= 2021-08-31T09:34:52.729 INFO:teuthology.kill: gibba027.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBhIwKpZTzL1mXiwPSQ4iGFGU2yyZTl4HsDCjPF+q1pDEA5qbTc+Bi9ikTjjAT9rH0NahfLJHZY9fWmh3axS7uHCAfWOZgHxjHiWYIhQLe2SyNo24CjLCTA+m90P2o2ijqy3ZhLw5N/9/4nwmgmTgauyCAVMaQJLapX3zHSFM+3EN2PEZ12sQwFo/EP8DYRHh6Asql2HQFtGgyhJhZMK0EZfRKBOxJeL3wfNe+KPps5nWewhJyRGEABbKSLB0QmTVCL9QOeZlAQBxAm+XgkPPJrJQh/4O57WtLyIOS6UbA8X/4wy5oY2nVRCX6KwRJMsedrXeeYQEMhlOWnWhz32iyOMxpO0SDDNVIO6w8STiTnDh1knOd4kocC26+2iBKlTui//rAs/+yo0Oe6eI6R7JkAzcpcuxEZN3JxWU3svk3G/F/Ms4SYEMEPp0oUaFzAXYupXq/Ij3MkVaYP5zRYGZnxSmG8o2BJkSrb8L9EKiO0EKY94nwO9R2ZfoMdmYknxk= 2021-08-31T09:34:52.730 INFO:teuthology.kill: gibba031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwtqWi224yc3mGnpBpY09YzFVGG6Vsjue7QuGhGlo5joe7mbYAKgONcLwwp4eXXhgVCXjtLhoZVHtvgFc8kn16NFzcUgB6SDwgu+LJG/eBcmARZh8hWZ1+Vl6Guv/D0EsgJ+3Sk6VmUZxUJdGCoxpUclZbo1pvJrANaQIlfnGvdcxjChcTvLbG5N76ugjgpTmTzY7Aro9h2LbLKgDOedyZwn+9lqRiwq8XVmq/XN4/yE4Xx/mdTMoU3sGg5pDfvTTB+cAc439ZK1bhsK4cP7rPut5uKShCHlMtXfXypxlSQQU0zdjomnT5HCwPLCxJr4tB9liCIgbv0xfPCDXSMVW5bF/QUTlrSy/9Yq1I/viG47O028goA1O4FU0q3ChRhp27XZ2eIRsQnHA6X/eEYO7fpeDedDnEL2u77ho2ftxPCSxkmumOFpPJmWuwJrzeEAUD+Qs1wAxltUde8wLFWVB3j8Zk+nBgInY4iU6/AfG/5HA9/BN2Gn/c6qaTwqcFiwU= 2021-08-31T09:34:52.730 INFO:teuthology.kill: gibba032.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8+C7kYshkWSFfqJSfW4OB5MhxAoyUUSLqf5aQocGxekEv4uIVLwfxZl0hyf/9kyBxBirPgYQFY28iyR7w6WGyZR1w0ptSHVwLaZIxoVtUWkGLknFgxR8eApFjDF3g5pcVP6PkltHDT5+O1+/s6ILzkk7e9dCnlxidqn8E7tJDZwNJH6Mafybf7wEmwPqpkd03++Ucy2Vdp9a2j66t/9gYVszCc8RG2KO7V/xslqEPnYa7jeAHFCgTjsJr9q8+iMnK3XzpP++zsqmcC+jIaQzmYuCi5y1xGuvXdYuSmifhwcJjthBTsIdBAUX6B4V9OmTctrVC3sujI5/XULBHunZX5BK6EKJ30TgigL2EjAMVOmnclLhtm6EB1huCzvQfG4iixf5Uy3KoPc+krkMNyD9b6Fq26VYQQddGXmyP+6nspPoVRyI5Pb7byX4xHHnWz7xkMacaVKrXJT39Ve2xl7v45LBOigGfCjfBUOmlnq1kCjaZjgyk5EcOEyRhvVR2fEE= 2021-08-31T09:34:52.730 INFO:teuthology.kill: gibba041.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGO6i5fEIT5+f10zW55/J6qfVl2Ekm9Sz3gGjIkYesW/dAhg7W8a8UgeXAc5ipVGWxrNITJI7sLg4ejAoStvkaOU11680tbnRZeGlO+/2x/T1wJe6cPH0ZI8nBLkw9zx86/CUC3CuJMG/BMMkjk+6RIrIe16jWyIJhzbZnySHvr1nhXClQKPvejBUA6UrGyxPE36aGxe+sP7/cw5QvgPSMDUpdk1LM4rGjX+uN2i/CnhfxkhD8KSmoghOpC8umCbYJzWpoDxfikzSDLkbkcQLWf98nw0Lgvak2c2L10tCNOtrNHV8ZrUCLfx/DFN/EaehwD6TVPNzwWJi+SigsoSPttjEHu999rLSMj46he2fdeWkKAztW46XISOstJ8esuN9PQ9Q4SWenpmDfuc78rzuOc6ppyIrKxxGVIKyx0XW5aRgUkuRUglKV/8FpEyeELn8hLFlFmI1RcA+KEgfMqm038WFHu7rHIVV83asZMDRCSod7xkGN0umX+T6aQJ2yapE= 2021-08-31T09:34:52.730 INFO:teuthology.kill:2021-08-31 09:34:52,728.728 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-31T09:34:52.731 INFO:teuthology.kill:2021-08-31 09:34:52,731.731 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-31T09:34:52.732 INFO:teuthology.kill:2021-08-31 09:34:52,732.732 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-31T09:34:52.734 INFO:teuthology.kill:2021-08-31 09:34:52,734.734 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-31T09:34:52.735 INFO:teuthology.kill:2021-08-31 09:34:52,735.735 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-31T09:34:52.807 INFO:teuthology.kill:2021-08-31 09:34:52,807.807 INFO:teuthology.orchestra.console:Power off gibba032 2021-08-31T09:34:52.823 INFO:teuthology.kill:2021-08-31 09:34:52,822.822 INFO:teuthology.orchestra.console:Power off gibba031 2021-08-31T09:34:52.833 INFO:teuthology.kill:2021-08-31 09:34:52,833.833 INFO:teuthology.orchestra.console:Power off gibba008 2021-08-31T09:34:52.844 INFO:teuthology.kill:2021-08-31 09:34:52,843.843 INFO:teuthology.orchestra.console:Power off gibba027 2021-08-31T09:34:52.854 INFO:teuthology.kill:2021-08-31 09:34:52,853.853 INFO:teuthology.orchestra.console:Power off gibba041 2021-08-31T09:35:01.221 INFO:teuthology.kill:2021-08-31 09:35:01,221.221 INFO:teuthology.orchestra.console:Power off for gibba008 completed 2021-08-31T09:35:01.226 INFO:teuthology.kill:2021-08-31 09:35:01,226.226 INFO:teuthology.orchestra.console:Power off for gibba027 completed 2021-08-31T09:35:01.232 INFO:teuthology.kill:2021-08-31 09:35:01,232.232 INFO:teuthology.orchestra.console:Power off for gibba041 completed 2021-08-31T09:35:05.329 INFO:teuthology.kill:2021-08-31 09:35:05,329.329 INFO:teuthology.orchestra.console:Power off for gibba031 completed 2021-08-31T09:35:05.381 INFO:teuthology.kill:2021-08-31 09:35:05,381.381 INFO:teuthology.orchestra.console:Power off for gibba032 completed 2021-08-31T09:35:05.589 INFO:teuthology.task.internal:roles: ubuntu@gibba008.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-08-31T09:35:05.590 INFO:teuthology.task.internal:roles: ubuntu@gibba027.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-08-31T09:35:05.590 INFO:teuthology.task.internal:roles: ubuntu@gibba031.front.sepia.ceph.com - ['client.0'] 2021-08-31T09:35:05.591 INFO:teuthology.task.internal:roles: ubuntu@gibba032.front.sepia.ceph.com - ['client.1'] 2021-08-31T09:35:05.591 INFO:teuthology.task.internal:roles: ubuntu@gibba041.front.sepia.ceph.com - ['client.2'] 2021-08-31T09:35:05.591 INFO:teuthology.misc:Compressing logs... 2021-08-31T09:35:05.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-31T09:36:05.602 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-08-31T09:36:05.656 INFO:teuthology.kill:No teuthology processes running 2021-08-31T09:36:06.609 INFO:teuthology.kill:Nuking machines: ['gibba008', 'gibba027', 'gibba031', 'gibba032', 'gibba041'] 2021-08-31T09:36:07.441 INFO:teuthology.kill:2021-08-31 09:36:07,441.441 INFO:teuthology.nuke:targets: 2021-08-31T09:36:07.442 INFO:teuthology.kill: gibba008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChOtfnDvOuX4W2OVqGbqRBoFhg5rVxqlYS9ZBCTgj/vdlxWQqNd0/NsTH05BR88Y2x6xCCY/FEh0VDWDxXF5HaD0G0nS59dCmV/DB2Mz1s49fNI1zejMHAvJ9TKEtawxfKup9r59BmKpsTz/fcxHNuolU5ta4MtLpcwQs4uPvvV2VcGaI0H0BDzjxmRkQkhymRTEPVW8Us8Dpr+EMYJ95aEJCRjzdyqp/7RENSdCBx4OM5H9VO1dublz14b0B6Ml/gl1wJIq0i5+Et8MA60DgIDj/7mFPfWRi3lDFjj/sXK1sT2jUBS+I44+3hqglQAMwuOnBerpEchgRN9Gx3O7LGHIm7todHWSAC4gb9i9mDmfKGSbZGmaihQ4b21v97QgCmv6y0pVM/kwcl/GRInZ7zAY3tXidiE6/k75N+pSO+pgiWrTBZFu+JC072kztvbZh4odahWhW6TlxOaz2ZojlOzy2aAZ9uXPjCBP1NbqbTnK7OdeyJ1PFvc2c2mXNZ310= 2021-08-31T09:36:07.442 INFO:teuthology.kill: gibba027.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBhIwKpZTzL1mXiwPSQ4iGFGU2yyZTl4HsDCjPF+q1pDEA5qbTc+Bi9ikTjjAT9rH0NahfLJHZY9fWmh3axS7uHCAfWOZgHxjHiWYIhQLe2SyNo24CjLCTA+m90P2o2ijqy3ZhLw5N/9/4nwmgmTgauyCAVMaQJLapX3zHSFM+3EN2PEZ12sQwFo/EP8DYRHh6Asql2HQFtGgyhJhZMK0EZfRKBOxJeL3wfNe+KPps5nWewhJyRGEABbKSLB0QmTVCL9QOeZlAQBxAm+XgkPPJrJQh/4O57WtLyIOS6UbA8X/4wy5oY2nVRCX6KwRJMsedrXeeYQEMhlOWnWhz32iyOMxpO0SDDNVIO6w8STiTnDh1knOd4kocC26+2iBKlTui//rAs/+yo0Oe6eI6R7JkAzcpcuxEZN3JxWU3svk3G/F/Ms4SYEMEPp0oUaFzAXYupXq/Ij3MkVaYP5zRYGZnxSmG8o2BJkSrb8L9EKiO0EKY94nwO9R2ZfoMdmYknxk= 2021-08-31T09:36:07.443 INFO:teuthology.kill: gibba031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwtqWi224yc3mGnpBpY09YzFVGG6Vsjue7QuGhGlo5joe7mbYAKgONcLwwp4eXXhgVCXjtLhoZVHtvgFc8kn16NFzcUgB6SDwgu+LJG/eBcmARZh8hWZ1+Vl6Guv/D0EsgJ+3Sk6VmUZxUJdGCoxpUclZbo1pvJrANaQIlfnGvdcxjChcTvLbG5N76ugjgpTmTzY7Aro9h2LbLKgDOedyZwn+9lqRiwq8XVmq/XN4/yE4Xx/mdTMoU3sGg5pDfvTTB+cAc439ZK1bhsK4cP7rPut5uKShCHlMtXfXypxlSQQU0zdjomnT5HCwPLCxJr4tB9liCIgbv0xfPCDXSMVW5bF/QUTlrSy/9Yq1I/viG47O028goA1O4FU0q3ChRhp27XZ2eIRsQnHA6X/eEYO7fpeDedDnEL2u77ho2ftxPCSxkmumOFpPJmWuwJrzeEAUD+Qs1wAxltUde8wLFWVB3j8Zk+nBgInY4iU6/AfG/5HA9/BN2Gn/c6qaTwqcFiwU= 2021-08-31T09:36:07.443 INFO:teuthology.kill: gibba032.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8+C7kYshkWSFfqJSfW4OB5MhxAoyUUSLqf5aQocGxekEv4uIVLwfxZl0hyf/9kyBxBirPgYQFY28iyR7w6WGyZR1w0ptSHVwLaZIxoVtUWkGLknFgxR8eApFjDF3g5pcVP6PkltHDT5+O1+/s6ILzkk7e9dCnlxidqn8E7tJDZwNJH6Mafybf7wEmwPqpkd03++Ucy2Vdp9a2j66t/9gYVszCc8RG2KO7V/xslqEPnYa7jeAHFCgTjsJr9q8+iMnK3XzpP++zsqmcC+jIaQzmYuCi5y1xGuvXdYuSmifhwcJjthBTsIdBAUX6B4V9OmTctrVC3sujI5/XULBHunZX5BK6EKJ30TgigL2EjAMVOmnclLhtm6EB1huCzvQfG4iixf5Uy3KoPc+krkMNyD9b6Fq26VYQQddGXmyP+6nspPoVRyI5Pb7byX4xHHnWz7xkMacaVKrXJT39Ve2xl7v45LBOigGfCjfBUOmlnq1kCjaZjgyk5EcOEyRhvVR2fEE= 2021-08-31T09:36:07.443 INFO:teuthology.kill: gibba041.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGO6i5fEIT5+f10zW55/J6qfVl2Ekm9Sz3gGjIkYesW/dAhg7W8a8UgeXAc5ipVGWxrNITJI7sLg4ejAoStvkaOU11680tbnRZeGlO+/2x/T1wJe6cPH0ZI8nBLkw9zx86/CUC3CuJMG/BMMkjk+6RIrIe16jWyIJhzbZnySHvr1nhXClQKPvejBUA6UrGyxPE36aGxe+sP7/cw5QvgPSMDUpdk1LM4rGjX+uN2i/CnhfxkhD8KSmoghOpC8umCbYJzWpoDxfikzSDLkbkcQLWf98nw0Lgvak2c2L10tCNOtrNHV8ZrUCLfx/DFN/EaehwD6TVPNzwWJi+SigsoSPttjEHu999rLSMj46he2fdeWkKAztW46XISOstJ8esuN9PQ9Q4SWenpmDfuc78rzuOc6ppyIrKxxGVIKyx0XW5aRgUkuRUglKV/8FpEyeELn8hLFlFmI1RcA+KEgfMqm038WFHu7rHIVV83asZMDRCSod7xkGN0umX+T6aQJ2yapE= 2021-08-31T09:36:07.468 INFO:teuthology.kill:2021-08-31 09:36:07,468.468 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-31T09:36:07.474 INFO:teuthology.kill:2021-08-31 09:36:07,474.474 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-31T09:36:07.475 INFO:teuthology.kill:2021-08-31 09:36:07,475.475 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-31T09:36:07.476 INFO:teuthology.kill:2021-08-31 09:36:07,476.476 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-31T09:36:07.477 INFO:teuthology.kill:2021-08-31 09:36:07,477.477 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-31T09:36:07.532 INFO:teuthology.kill:2021-08-31 09:36:07,532.532 INFO:teuthology.orchestra.console:Power off gibba008 2021-08-31T09:36:07.547 INFO:teuthology.kill:2021-08-31 09:36:07,547.547 INFO:teuthology.orchestra.console:Power off gibba027 2021-08-31T09:36:07.557 INFO:teuthology.kill:2021-08-31 09:36:07,557.557 INFO:teuthology.orchestra.console:Power off gibba032 2021-08-31T09:36:07.570 INFO:teuthology.kill:2021-08-31 09:36:07,569.569 INFO:teuthology.orchestra.console:Power off gibba031 2021-08-31T09:36:07.592 INFO:teuthology.kill:2021-08-31 09:36:07,592.592 INFO:teuthology.orchestra.console:Power off gibba041 2021-08-31T09:36:07.704 INFO:teuthology.kill:2021-08-31 09:36:07,704.704 INFO:teuthology.orchestra.console:Power off for gibba008 completed 2021-08-31T09:36:07.711 INFO:teuthology.kill:2021-08-31 09:36:07,711.711 INFO:teuthology.orchestra.console:Power off for gibba027 completed 2021-08-31T09:36:07.721 INFO:teuthology.kill:2021-08-31 09:36:07,721.721 INFO:teuthology.orchestra.console:Power off for gibba032 completed 2021-08-31T09:36:07.726 INFO:teuthology.kill:2021-08-31 09:36:07,726.726 INFO:teuthology.orchestra.console:Power off for gibba031 completed 2021-08-31T09:36:07.736 INFO:teuthology.kill:2021-08-31 09:36:07,736.736 INFO:teuthology.orchestra.console:Power off for gibba041 completed 2021-08-31T09:36:07.850 INFO:teuthology.kill:2021-08-31 09:36:07,849.849 INFO:teuthology.lock.ops:unlocked gibba008.front.sepia.ceph.com 2021-08-31T09:36:07.853 INFO:teuthology.kill:2021-08-31 09:36:07,853.853 INFO:teuthology.lock.ops:unlocked gibba027.front.sepia.ceph.com 2021-08-31T09:36:07.863 INFO:teuthology.kill:2021-08-31 09:36:07,862.862 INFO:teuthology.lock.ops:unlocked gibba032.front.sepia.ceph.com 2021-08-31T09:36:07.873 INFO:teuthology.kill:2021-08-31 09:36:07,873.873 ERROR:teuthology.lock.ops:failed to unlock gibba031.front.sepia.ceph.com. reason: 500 2021-08-31T09:36:07.875 INFO:teuthology.kill:2021-08-31 09:36:07,875.875 INFO:teuthology.lock.ops:unlocked gibba041.front.sepia.ceph.com 2021-08-31T09:38:08.066 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-08-31T09:38:08.193 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-08-31T09:38:08.193 INFO:teuthology.nuke:Checking targets against current locks 2021-08-31T09:38:08.288 INFO:teuthology.nuke:Not nuking gibba041.front.sepia.ceph.com because description doesn't match 2021-08-31T09:38:08.288 INFO:teuthology.nuke:Not nuking gibba027.front.sepia.ceph.com because description doesn't match 2021-08-31T09:38:08.289 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/dispatcher/supervisor.py", line 59, in main verbose File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/dispatcher/supervisor.py", line 152, in run_job unlock_targets(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets nuke(fake_ctx, True) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable