2021-07-27T21:56:07.359 INFO:root:teuthology version: 1.1.0-73aa7e3b
2021-07-27T21:56:07.483 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi064.front.sepia.ceph.com' reimaging
2021-07-27T21:56:07.485 INFO:teuthology.lock.ops:Updating [ubuntu@smithi064.front.sepia.ceph.com]: reset os type and version on server
2021-07-27T21:56:07.485 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2021-07-27T21:56:07.505 INFO:teuthology.lock.ops:Node 'ubuntu@smithi064.front.sepia.ceph.com' reimaging is complete
2021-07-27T21:56:07.505 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging
2021-07-27T21:56:07.505 INFO:teuthology.lock.ops:Updating [ubuntu@smithi183.front.sepia.ceph.com]: reset os type and version on server
2021-07-27T21:56:07.506 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2021-07-27T21:56:07.524 INFO:teuthology.lock.ops:Node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging is complete
2021-07-27T21:56:07.732 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 8.stream
2021-07-27T21:56:07.735 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 8.stream
2021-07-27T21:56:08.086 INFO:teuthology.orchestra.console:Power off smithi183
2021-07-27T21:56:08.124 INFO:teuthology.orchestra.console:Power off smithi064
2021-07-27T21:56:08.236 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2021-07-27T21:56:08.337 INFO:teuthology.orchestra.console:Power on smithi183
2021-07-27T21:56:16.502 INFO:teuthology.orchestra.console:Power off for smithi064 completed
2021-07-27T21:56:16.604 INFO:teuthology.orchestra.console:Power on smithi064
2021-07-27T21:56:16.767 INFO:teuthology.orchestra.console:Power on for smithi183 completed
2021-07-27T21:56:16.868 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2021-07-27T21:56:24.974 INFO:teuthology.orchestra.console:Power on for smithi064 completed
2021-07-27T21:56:25.075 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish
2021-07-27T21:58:56.321 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-07-27T22:00:23.279 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-27T22:00:43.629 INFO:teuthology.provision.fog.smithi183:Node is ready
2021-07-27T22:00:43.649 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com
2021-07-27T22:00:43.707 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2021-07-27T22:00:44.070 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2021-07-27T22:01:09.685 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-27T22:01:09.959 INFO:teuthology.provision.fog.smithi064:Node is ready
2021-07-27T22:01:09.978 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com
2021-07-27T22:01:10.037 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064
2021-07-27T22:01:10.399 INFO:teuthology.provision.fog.smithi064:Deploy complete!
2021-07-27T22:01:10.526 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com
2021-07-27T22:01:10.527 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-27T22:01:10.544 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2021-07-27T22:01:10.544 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-27T22:01:10.558 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server
2021-07-27T22:01:10.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-27T22:01:10.785 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64
2021-07-27T22:01:10.840 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream"
2021-07-27T22:01:10.840 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8"
2021-07-27T22:01:10.840 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos"
2021-07-27T22:01:10.840 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora"
2021-07-27T22:01:10.841 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8"
2021-07-27T22:01:10.841 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8"
2021-07-27T22:01:10.841 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 8"
2021-07-27T22:01:10.841 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31"
2021-07-27T22:01:10.842 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-07-27T22:01:10.842 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/"
2021-07-27T22:01:10.842 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-07-27T22:01:10.842 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-07-27T22:01:10.842 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-07-27T22:01:10.844 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2021-07-27T22:01:10.858 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2021-07-27T22:01:10.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-27T22:01:11.099 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2021-07-27T22:01:11.155 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream"
2021-07-27T22:01:11.156 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8"
2021-07-27T22:01:11.156 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos"
2021-07-27T22:01:11.156 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora"
2021-07-27T22:01:11.156 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8"
2021-07-27T22:01:11.156 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8"
2021-07-27T22:01:11.157 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 8"
2021-07-27T22:01:11.157 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2021-07-27T22:01:11.157 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-07-27T22:01:11.157 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/"
2021-07-27T22:01:11.158 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-07-27T22:01:11.158 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-07-27T22:01:11.158 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-07-27T22:01:11.159 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2021-07-27T22:01:11.236 INFO:teuthology.dispatcher.supervisor:Running job 6296397
2021-07-27T22:01:11.236 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296397 --name benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/cache-agent-big} -- /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296397/orig.config.yaml
2021-07-27T22:01:11.239 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296397
2021-07-27T22:01:11.240 INFO:teuthology.dispatcher.supervisor:Job PID: 8810
2021-07-27T22:01:11.241 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-07-28T10:01:30.997 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-07-28T10:01:31.382 INFO:teuthology.kill:Killing Pids: {8810}
2021-07-28T10:01:32.592 INFO:teuthology.kill:Nuking machines: ['smithi064', 'smithi183']
2021-07-28T10:01:33.546 INFO:teuthology.kill:2021-07-28 10:01:33,545.545 INFO:teuthology.nuke:targets:
2021-07-28T10:01:33.547 INFO:teuthology.kill:  smithi064.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaJoWhtHU9ypZLvsZH4jT7Nz/BgVADS39jFhJmUr6KfP/KXX/3h0Ih9CUY7dCMWIzP4MK2ufaApQlessV2jpUnnhO93Zj0GR3IPUwCe05CJyrG/BciGnVujRj9imEfwc45VuIIA95vxs8kX3IxEB0077X92EkX1UGIPeKs9+h52uNL5gq5VgkSDT1f0p8hXb4hQSzY6+fVdskxS0hD2kvF+SOz9loLlRFNh+PygtoUDJrqtkWnzzTSJ0zXEpinpFL2tculVBcZ67ljPkdRUmEElvqoHSvI5uNnRKZRX7HEnJSyxyYn8rMwcsSxcwsDPtUqG2V0xvb/YCso1cGggGVg1s6hnUiT5xhdRMSiZgYcL+oFnEHXuHMi+OSxG6Zs9MdB5lu5bT1Vl7TRuWPDrRUq7vZnVXWLaXqvW9F8dDmN588X44JD8ApzCps5PNnLpY1qwWXfj6PgebDmlyq4qnbmHdbL/4tGXR5TGmmjaogDMYJo2inx0ndAZqXKpx5plxU=
2021-07-28T10:01:33.547 INFO:teuthology.kill:  smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFt8w19pPFD1xHFGy+apawOgMfgcDZ8BjiqBBfn89LX1913F6fv6uGBk/wxdUoGdQmKph8u7dqIs9FuLRLSV0m4o2k+GeM/edzpcGpLKnPGiSHW7IEWshKtwM9Xp83+u5UrMdc9oIuG/NnhnreQWHemhLra7+09/nImBBrlKbIn7Z1OL5+lPdLnc/PT5INY/H4GNKcrm80ACze1jePmJphDv5HbT3RxpREBGje9HsmOEMV+uIqRYB0DMpSH1QbkW2ilHXrMK0DIEK4+8kE7eWZPv3laTRj7M/hsKBuQeYyDPXq0kY4w3F5tTXkjCphNgIZHXx/o9rjtZtNsOm3uEgWfLPCY+NXzjcE7QjrMkperb+sfxVVVa8L6/ZT5sXipn/GfZltEkQSpewZsPzbT8fETHJWtzG42vyJ+yVhIQAQ/BHxUh3wlNpzefiQugW+5F3Ej6lY7btFJYQgQd/2eh+RK36OFb+Q7V5PgIqQ7WaCFnCauWB9FDcpYWlZDSfa6Cc=
2021-07-28T10:01:33.547 INFO:teuthology.kill:2021-07-28 10:01:33,546.546 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-28T10:01:33.548 INFO:teuthology.kill:2021-07-28 10:01:33,548.548 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-28T10:01:33.606 INFO:teuthology.kill:2021-07-28 10:01:33,606.606 INFO:teuthology.orchestra.console:Power off smithi064
2021-07-28T10:01:33.624 INFO:teuthology.kill:2021-07-28 10:01:33,623.623 INFO:teuthology.orchestra.console:Power off smithi183
2021-07-28T10:01:41.990 INFO:teuthology.kill:2021-07-28 10:01:41,989.989 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2021-07-28T10:01:46.095 INFO:teuthology.kill:2021-07-28 10:01:46,095.095 INFO:teuthology.orchestra.console:Power off for smithi064 completed
2021-07-28T10:01:46.324 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-07-28T10:01:46.325 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-07-28T10:01:46.325 INFO:teuthology.misc:Compressing logs...
2021-07-28T10:01:46.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-28T10:02:21.003 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-07-28T10:02:21.066 INFO:teuthology.kill:No teuthology processes running
2021-07-28T10:02:22.149 INFO:teuthology.kill:Nuking machines: ['smithi064', 'smithi183']
2021-07-28T10:02:23.155 INFO:teuthology.kill:2021-07-28 10:02:23,155.155 INFO:teuthology.nuke:targets:
2021-07-28T10:02:23.156 INFO:teuthology.kill:  smithi064.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaJoWhtHU9ypZLvsZH4jT7Nz/BgVADS39jFhJmUr6KfP/KXX/3h0Ih9CUY7dCMWIzP4MK2ufaApQlessV2jpUnnhO93Zj0GR3IPUwCe05CJyrG/BciGnVujRj9imEfwc45VuIIA95vxs8kX3IxEB0077X92EkX1UGIPeKs9+h52uNL5gq5VgkSDT1f0p8hXb4hQSzY6+fVdskxS0hD2kvF+SOz9loLlRFNh+PygtoUDJrqtkWnzzTSJ0zXEpinpFL2tculVBcZ67ljPkdRUmEElvqoHSvI5uNnRKZRX7HEnJSyxyYn8rMwcsSxcwsDPtUqG2V0xvb/YCso1cGggGVg1s6hnUiT5xhdRMSiZgYcL+oFnEHXuHMi+OSxG6Zs9MdB5lu5bT1Vl7TRuWPDrRUq7vZnVXWLaXqvW9F8dDmN588X44JD8ApzCps5PNnLpY1qwWXfj6PgebDmlyq4qnbmHdbL/4tGXR5TGmmjaogDMYJo2inx0ndAZqXKpx5plxU=
2021-07-28T10:02:23.156 INFO:teuthology.kill:  smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFt8w19pPFD1xHFGy+apawOgMfgcDZ8BjiqBBfn89LX1913F6fv6uGBk/wxdUoGdQmKph8u7dqIs9FuLRLSV0m4o2k+GeM/edzpcGpLKnPGiSHW7IEWshKtwM9Xp83+u5UrMdc9oIuG/NnhnreQWHemhLra7+09/nImBBrlKbIn7Z1OL5+lPdLnc/PT5INY/H4GNKcrm80ACze1jePmJphDv5HbT3RxpREBGje9HsmOEMV+uIqRYB0DMpSH1QbkW2ilHXrMK0DIEK4+8kE7eWZPv3laTRj7M/hsKBuQeYyDPXq0kY4w3F5tTXkjCphNgIZHXx/o9rjtZtNsOm3uEgWfLPCY+NXzjcE7QjrMkperb+sfxVVVa8L6/ZT5sXipn/GfZltEkQSpewZsPzbT8fETHJWtzG42vyJ+yVhIQAQ/BHxUh3wlNpzefiQugW+5F3Ej6lY7btFJYQgQd/2eh+RK36OFb+Q7V5PgIqQ7WaCFnCauWB9FDcpYWlZDSfa6Cc=
2021-07-28T10:02:23.176 INFO:teuthology.kill:2021-07-28 10:02:23,176.176 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-28T10:02:23.179 INFO:teuthology.kill:2021-07-28 10:02:23,179.179 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-28T10:02:23.236 INFO:teuthology.kill:2021-07-28 10:02:23,235.235 INFO:teuthology.orchestra.console:Power off smithi064
2021-07-28T10:02:23.276 INFO:teuthology.kill:2021-07-28 10:02:23,274.274 INFO:teuthology.orchestra.console:Power off smithi183
2021-07-28T10:02:23.384 INFO:teuthology.kill:2021-07-28 10:02:23,383.383 INFO:teuthology.orchestra.console:Power off for smithi064 completed
2021-07-28T10:02:23.415 INFO:teuthology.kill:2021-07-28 10:02:23,415.415 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2021-07-28T10:02:23.524 INFO:teuthology.kill:2021-07-28 10:02:23,523.523 INFO:teuthology.lock.ops:unlocked smithi064.front.sepia.ceph.com
2021-07-28T10:02:23.554 INFO:teuthology.kill:2021-07-28 10:02:23,553.553 INFO:teuthology.lock.ops:unlocked smithi183.front.sepia.ceph.com
2021-07-28T10:04:23.756 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-07-28T10:04:23.855 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-07-28T10:04:23.856 INFO:teuthology.nuke:Checking targets against current locks
2021-07-28T10:04:23.930 INFO:teuthology.nuke:Not nuking smithi064.front.sepia.ceph.com because description doesn't match
2021-07-28T10:04:23.931 INFO:teuthology.nuke:Not nuking smithi183.front.sepia.ceph.com because description doesn't match