2021-07-27T22:08:38.556 INFO:root:teuthology version: 1.1.0-73aa7e3b
2021-07-27T22:08:38.658 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi107.front.sepia.ceph.com' reimaging
2021-07-27T22:08:38.659 INFO:teuthology.lock.ops:Updating [ubuntu@smithi107.front.sepia.ceph.com]: reset os type and version on server
2021-07-27T22:08:38.660 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2021-07-27T22:08:38.679 INFO:teuthology.lock.ops:Node 'ubuntu@smithi107.front.sepia.ceph.com' reimaging is complete
2021-07-27T22:08:38.680 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi153.front.sepia.ceph.com' reimaging
2021-07-27T22:08:38.680 INFO:teuthology.lock.ops:Updating [ubuntu@smithi153.front.sepia.ceph.com]: reset os type and version on server
2021-07-27T22:08:38.680 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2021-07-27T22:08:38.699 INFO:teuthology.lock.ops:Node 'ubuntu@smithi153.front.sepia.ceph.com' reimaging is complete
2021-07-27T22:08:38.900 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of ubuntu 20.04
2021-07-27T22:08:38.906 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of ubuntu 20.04
2021-07-27T22:08:39.255 INFO:teuthology.orchestra.console:Power off smithi107
2021-07-27T22:08:39.292 INFO:teuthology.orchestra.console:Power off smithi153
2021-07-27T22:08:51.741 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2021-07-27T22:08:51.771 INFO:teuthology.orchestra.console:Power off for smithi153 completed
2021-07-27T22:08:51.843 INFO:teuthology.orchestra.console:Power on smithi107
2021-07-27T22:08:51.873 INFO:teuthology.orchestra.console:Power on smithi153
2021-07-27T22:09:00.214 INFO:teuthology.orchestra.console:Power on for smithi107 completed
2021-07-27T22:09:00.238 INFO:teuthology.orchestra.console:Power on for smithi153 completed
2021-07-27T22:09:00.316 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish
2021-07-27T22:09:00.339 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2021-07-27T22:14:10.180 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-27T22:14:10.658 INFO:teuthology.provision.fog.smithi107:Node is ready
2021-07-27T22:14:10.665 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com
2021-07-27T22:14:10.672 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107
2021-07-27T22:14:10.870 INFO:teuthology.provision.fog.smithi107:Deploy complete!
2021-07-27T22:14:11.531 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-27T22:14:12.042 INFO:teuthology.provision.fog.smithi153:Node is ready
2021-07-27T22:14:12.048 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com
2021-07-27T22:14:12.056 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2021-07-27T22:14:12.236 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2021-07-27T22:14:12.397 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com
2021-07-27T22:14:12.398 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-27T22:14:12.415 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2021-07-27T22:14:12.416 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-27T22:14:12.431 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server
2021-07-27T22:14:12.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-27T22:14:12.647 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64
2021-07-27T22:14:12.655 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu"
2021-07-27T22:14:12.655 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-07-27T22:14:12.656 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu
2021-07-27T22:14:12.656 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian
2021-07-27T22:14:12.656 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-07-27T22:14:12.657 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="20.04"
2021-07-27T22:14:12.657 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/"
2021-07-27T22:14:12.657 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-07-27T22:14:12.657 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-07-27T22:14:12.657 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-07-27T22:14:12.658 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=focal
2021-07-27T22:14:12.658 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=focal
2021-07-27T22:14:12.659 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2021-07-27T22:14:12.676 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2021-07-27T22:14:12.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-27T22:14:12.838 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2021-07-27T22:14:12.845 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu"
2021-07-27T22:14:12.845 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-07-27T22:14:12.845 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu
2021-07-27T22:14:12.846 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian
2021-07-27T22:14:12.846 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-07-27T22:14:12.846 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="20.04"
2021-07-27T22:14:12.846 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/"
2021-07-27T22:14:12.847 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-07-27T22:14:12.847 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-07-27T22:14:12.847 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-07-27T22:14:12.847 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=focal
2021-07-27T22:14:12.847 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=focal
2021-07-27T22:14:12.848 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2021-07-27T22:14:12.931 INFO:teuthology.dispatcher.supervisor:Running job 6296422
2021-07-27T22:14:12.931 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296422 --name benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} -- /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296422/orig.config.yaml
2021-07-27T22:14:12.935 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296422
2021-07-27T22:14:12.936 INFO:teuthology.dispatcher.supervisor:Job PID: 25690
2021-07-27T22:14:12.936 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-07-28T10:15:02.713 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-07-28T10:15:03.053 INFO:teuthology.kill:Killing Pids: {25690}
2021-07-28T10:15:04.334 INFO:teuthology.kill:Nuking machines: ['smithi107', 'smithi153']
2021-07-28T10:15:05.381 INFO:teuthology.kill:2021-07-28 10:15:05,380.380 INFO:teuthology.nuke:targets:
2021-07-28T10:15:05.382 INFO:teuthology.kill:  smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfvz97k00io2LZ1IUAXdKPkrDX6Avg+WxDw5kLwwUuvtpOOMKV5sd+D6kkfEKmxI0I3Sq65+PBabOO3bGd63KKpkJJyRp444Q+3cozSUcxYByN0ME93FbdkP5c6D2rjNe9YnHwXMoUQzVsjv5iqNpOj+l5WnjKnJOES+egnlEntqez6GKneicuFixI5OcJaF7cFvNucXvEeBBbem5mCovDIt7Hv1LiCVaqCHsVq7IN+yjBn8YvMPdWUQ6S5+PTuPLI2N7wSzF0hu7wpWnEmWo0X1HKcRwKPV+2Lazk8S+r03zaYdxK17Sq8QtA2mFLYwPokjmrWi69MIMCt08QGpgbJ09h+c58hUZKb5UX6Qd143dELGma2B15VXnqiNJt3FywLhz+P/ERrrbqzFZrRriyYpzmyVnRlpEOkgjCE5l/CfBTLWUZ9EgSwH9lhW7aEj2LtAb4/U3JvR2jCaOLy1dw1GCCK8z1pLYeQxCbpQmvSBYeUScSSjOdHNcwT/s9ahk=
2021-07-28T10:15:05.382 INFO:teuthology.kill:  smithi153.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCx+xToBc8Fu/RnJ9ADl1GrQcy5FEnYwfMSjPwbMWhOvNxDILHaTcACC8BLkHGcjWYkwHx/bIxmhDr6cj1jj4RdUSiTt7OsNUH2ac6Zr5z6+pFuoYQmUpPx1z5LinmRKXkGSlW3viN6LCARc3Gnu2BNPubRjX43cWzxVWKxfrCjdCQ9vt/SPuP7wOcPdH7jn4WLrtdDpRDP3DY9c6FYlC4TbkVCw8OpgBYisNPwbeoYNG7h1Vc5A/jFcJAYN12+msPty9Z3xOEXIUbWBKzySTvfpQu6TJbmJ+sJHm6kx5J8f6v6ZL/X/NpiodcW2YBHPfrgY7NiDwJ88qdBDy2vktOl3VI7kVhQMFWomYZX/7LXaPVCkbt0MW+UB49ilU99VbeDP9ipQHIP+2ANXWNBPV0AksrDZXekBN2OqXqEtXsyVxj+1N2oMiKezct0ut5TJVh2eDSA+FMlLIFntbHgHOE3UERCHaZAAEWme8exXO/uETX0h0ITwNOYkpVnIYSA5Qs=
2021-07-28T10:15:05.382 INFO:teuthology.kill:2021-07-28 10:15:05,381.381 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-28T10:15:05.383 INFO:teuthology.kill:2021-07-28 10:15:05,383.383 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-28T10:15:05.456 INFO:teuthology.kill:2021-07-28 10:15:05,455.455 INFO:teuthology.orchestra.console:Power off smithi107
2021-07-28T10:15:05.474 INFO:teuthology.kill:2021-07-28 10:15:05,474.474 INFO:teuthology.orchestra.console:Power off smithi153
2021-07-28T10:15:13.854 INFO:teuthology.kill:2021-07-28 10:15:13,854.854 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2021-07-28T10:15:13.862 INFO:teuthology.kill:2021-07-28 10:15:13,862.862 INFO:teuthology.orchestra.console:Power off for smithi153 completed
2021-07-28T10:15:14.137 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-07-28T10:15:14.138 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-07-28T10:15:14.138 INFO:teuthology.misc:Compressing logs...
2021-07-28T10:15:14.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-28T10:15:48.684 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-07-28T10:15:48.754 INFO:teuthology.kill:No teuthology processes running
2021-07-28T10:15:49.941 INFO:teuthology.kill:Nuking machines: ['smithi107', 'smithi153']
2021-07-28T10:15:50.900 INFO:teuthology.kill:2021-07-28 10:15:50,900.900 INFO:teuthology.nuke:targets:
2021-07-28T10:15:50.901 INFO:teuthology.kill:  smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfvz97k00io2LZ1IUAXdKPkrDX6Avg+WxDw5kLwwUuvtpOOMKV5sd+D6kkfEKmxI0I3Sq65+PBabOO3bGd63KKpkJJyRp444Q+3cozSUcxYByN0ME93FbdkP5c6D2rjNe9YnHwXMoUQzVsjv5iqNpOj+l5WnjKnJOES+egnlEntqez6GKneicuFixI5OcJaF7cFvNucXvEeBBbem5mCovDIt7Hv1LiCVaqCHsVq7IN+yjBn8YvMPdWUQ6S5+PTuPLI2N7wSzF0hu7wpWnEmWo0X1HKcRwKPV+2Lazk8S+r03zaYdxK17Sq8QtA2mFLYwPokjmrWi69MIMCt08QGpgbJ09h+c58hUZKb5UX6Qd143dELGma2B15VXnqiNJt3FywLhz+P/ERrrbqzFZrRriyYpzmyVnRlpEOkgjCE5l/CfBTLWUZ9EgSwH9lhW7aEj2LtAb4/U3JvR2jCaOLy1dw1GCCK8z1pLYeQxCbpQmvSBYeUScSSjOdHNcwT/s9ahk=
2021-07-28T10:15:50.902 INFO:teuthology.kill:  smithi153.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCx+xToBc8Fu/RnJ9ADl1GrQcy5FEnYwfMSjPwbMWhOvNxDILHaTcACC8BLkHGcjWYkwHx/bIxmhDr6cj1jj4RdUSiTt7OsNUH2ac6Zr5z6+pFuoYQmUpPx1z5LinmRKXkGSlW3viN6LCARc3Gnu2BNPubRjX43cWzxVWKxfrCjdCQ9vt/SPuP7wOcPdH7jn4WLrtdDpRDP3DY9c6FYlC4TbkVCw8OpgBYisNPwbeoYNG7h1Vc5A/jFcJAYN12+msPty9Z3xOEXIUbWBKzySTvfpQu6TJbmJ+sJHm6kx5J8f6v6ZL/X/NpiodcW2YBHPfrgY7NiDwJ88qdBDy2vktOl3VI7kVhQMFWomYZX/7LXaPVCkbt0MW+UB49ilU99VbeDP9ipQHIP+2ANXWNBPV0AksrDZXekBN2OqXqEtXsyVxj+1N2oMiKezct0ut5TJVh2eDSA+FMlLIFntbHgHOE3UERCHaZAAEWme8exXO/uETX0h0ITwNOYkpVnIYSA5Qs=
2021-07-28T10:15:50.922 INFO:teuthology.kill:2021-07-28 10:15:50,922.922 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-28T10:15:50.925 INFO:teuthology.kill:2021-07-28 10:15:50,925.925 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-28T10:15:50.984 INFO:teuthology.kill:2021-07-28 10:15:50,983.983 INFO:teuthology.orchestra.console:Power off smithi107
2021-07-28T10:15:50.999 INFO:teuthology.kill:2021-07-28 10:15:50,998.998 INFO:teuthology.orchestra.console:Power off smithi153
2021-07-28T10:15:51.127 INFO:teuthology.kill:2021-07-28 10:15:51,127.127 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2021-07-28T10:15:51.140 INFO:teuthology.kill:2021-07-28 10:15:51,139.139 INFO:teuthology.orchestra.console:Power off for smithi153 completed
2021-07-28T10:15:51.271 INFO:teuthology.kill:2021-07-28 10:15:51,270.270 INFO:teuthology.lock.ops:unlocked smithi107.front.sepia.ceph.com
2021-07-28T10:15:51.278 INFO:teuthology.kill:2021-07-28 10:15:51,278.278 INFO:teuthology.lock.ops:unlocked smithi153.front.sepia.ceph.com
2021-07-28T10:17:51.549 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-07-28T10:17:51.646 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-07-28T10:17:51.647 INFO:teuthology.nuke:Checking targets against current locks
2021-07-28T10:17:51.725 INFO:teuthology.nuke:Not nuking smithi153.front.sepia.ceph.com because description doesn't match
2021-07-28T10:17:51.725 INFO:teuthology.nuke:Not nuking smithi107.front.sepia.ceph.com because description doesn't match