2021-07-27T22:29:41.561 INFO:root:teuthology version: 1.1.0-73aa7e3b
2021-07-27T22:29:41.658 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging
2021-07-27T22:29:41.660 INFO:teuthology.lock.ops:Updating [ubuntu@smithi002.front.sepia.ceph.com]: reset os type and version on server
2021-07-27T22:29:41.660 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2021-07-27T22:29:41.675 INFO:teuthology.lock.ops:Node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging is complete
2021-07-27T22:29:41.675 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi073.front.sepia.ceph.com' reimaging
2021-07-27T22:29:41.675 INFO:teuthology.lock.ops:Updating [ubuntu@smithi073.front.sepia.ceph.com]: reset os type and version on server
2021-07-27T22:29:41.676 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2021-07-27T22:29:41.692 INFO:teuthology.lock.ops:Node 'ubuntu@smithi073.front.sepia.ceph.com' reimaging is complete
2021-07-27T22:29:41.877 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 8.stream
2021-07-27T22:29:41.895 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 8.stream
2021-07-27T22:29:42.213 INFO:teuthology.orchestra.console:Power off smithi002
2021-07-27T22:29:42.270 INFO:teuthology.orchestra.console:Power off smithi073
2021-07-27T22:29:50.591 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2021-07-27T22:29:50.693 INFO:teuthology.orchestra.console:Power on smithi002
2021-07-27T22:29:54.749 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2021-07-27T22:29:54.850 INFO:teuthology.orchestra.console:Power on smithi073
2021-07-27T22:29:59.057 INFO:teuthology.orchestra.console:Power on for smithi002 completed
2021-07-27T22:29:59.102 INFO:teuthology.orchestra.console:Power on for smithi073 completed
2021-07-27T22:29:59.159 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2021-07-27T22:29:59.203 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish
2021-07-27T22:33:41.415 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-27T22:33:57.293 INFO:teuthology.provision.fog.smithi002:Node is ready
2021-07-27T22:33:57.328 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com
2021-07-27T22:33:57.390 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002
2021-07-27T22:33:57.786 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2021-07-27T22:34:46.204 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-27T22:34:46.504 INFO:teuthology.provision.fog.smithi073:Node is ready
2021-07-27T22:34:46.522 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com
2021-07-27T22:34:46.580 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073
2021-07-27T22:34:46.926 INFO:teuthology.provision.fog.smithi073:Deploy complete!
2021-07-27T22:34:47.073 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2021-07-27T22:34:47.074 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-27T22:34:47.156 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com
2021-07-27T22:34:47.156 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-27T22:34:47.171 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2021-07-27T22:34:47.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-27T22:34:47.419 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2021-07-27T22:34:47.476 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream"
2021-07-27T22:34:47.477 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8"
2021-07-27T22:34:47.477 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos"
2021-07-27T22:34:47.477 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora"
2021-07-27T22:34:47.477 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8"
2021-07-27T22:34:47.477 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8"
2021-07-27T22:34:47.478 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 8"
2021-07-27T22:34:47.478 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2021-07-27T22:34:47.478 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-07-27T22:34:47.478 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/"
2021-07-27T22:34:47.479 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-07-27T22:34:47.479 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-07-27T22:34:47.479 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-07-27T22:34:47.480 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2021-07-27T22:34:47.499 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server
2021-07-27T22:34:47.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-27T22:34:47.778 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64
2021-07-27T22:34:47.835 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream"
2021-07-27T22:34:47.835 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8"
2021-07-27T22:34:47.835 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos"
2021-07-27T22:34:47.836 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora"
2021-07-27T22:34:47.836 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8"
2021-07-27T22:34:47.836 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8"
2021-07-27T22:34:47.836 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8"
2021-07-27T22:34:47.837 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2021-07-27T22:34:47.837 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-07-27T22:34:47.837 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/"
2021-07-27T22:34:47.837 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-07-27T22:34:47.837 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-07-27T22:34:47.838 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-07-27T22:34:47.838 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2021-07-27T22:34:47.919 INFO:teuthology.dispatcher.supervisor:Running job 6296461
2021-07-27T22:34:47.920 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296461 --name benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} -- /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296461/orig.config.yaml
2021-07-27T22:34:47.923 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296461
2021-07-27T22:34:47.924 INFO:teuthology.dispatcher.supervisor:Job PID: 27198
2021-07-27T22:34:47.924 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-07-28T10:35:36.932 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-07-28T10:35:37.197 INFO:teuthology.kill:Killing Pids: {27198}
2021-07-28T10:35:38.280 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi073']
2021-07-28T10:35:39.246 INFO:teuthology.kill:2021-07-28 10:35:39,246.246 INFO:teuthology.nuke:targets:
2021-07-28T10:35:39.247 INFO:teuthology.kill:  smithi002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdhRE26hnczreBD6YdlFai4S3Y6d+FewoolzbQiaLUEbS1N6P6MMXpv/ND032cFSk1Cb6moVAuek7D4k5NqwZ9IokQeLO7tkxST3As+CXoSplaWFiyrUDzeCo0jOwhXvz2c7UtZzCKEWFLPvbJ/f9IzXzvzdmR7Uu9kI1f1pAF2yOz8nKlrl8hq0+enR00Cjm/YziXrciWuS1LU4HsuYiCfFX90EDmGfgiX9FAfhrQ5kow8kzsMzZdvlNmSePkzpqt9jkiPbFNtHYKPokTwXGqx6VFSaJ21mTax7KGxacssK1o4DiBGRLR0J3JVpYl2cjrnxDkesfEBYzc4qIvoI5nN/4Z5Ln0Qotj6EiFPBLjTunWScyl6zAfDYaO5w0kaYpHgY0pWanTgSq41KdFu1luEZTBHT5LvDUPfuNbIp8XaAfax3+LC+52oBRwbrgRRCCzah/YgX7io77OCfFWbtvaCxHQ6LM91KTU2jTpARr+du2bTHoOfKkkXd2Hpx/s4Ds=
2021-07-28T10:35:39.248 INFO:teuthology.kill:  smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHKc73t7JajoXThWmNTZtHTawKi/fHt3IjQUcCifI6cY4LHEfIp+HPQS+7z9BK3/q4VgWrCh341t3es5l9Z352P9uPU0Wl0Iaut5kSClHqs0IRA870EcPk1Hbckgrph1UrVRMmEGA5MmRDfx5V/jrNcSHr9NEQ+WdMVuDcyIYb8O6ntb4DOwqpiEotj+nZ+i/wvpGhblBBsK/ROHvo0SLmiySrl/sQgr3d9BZN/226d+0ThNS0QzlQqGLn/FptG6HC9bgUFLy1/DcZlYO4cjcanvK8dquJhoroJlIDnbrAKMJXFsy1/K8r5d5kI5JXaRZigR1HRvyxPqCB6pcCEBekkaVZytv0A4yjItaoA59oK6axs0BZGw4nQjcT5gIwnsi72oa3YOjU/fFL+OcnnqCesRXfB0xkYoOobm7cPNk2sZvI0cIcjT5lzFISDWKK7rIBS1DlDYqhffwk6Qn4iyoRsgDYRR6eoqfJFSgaMEH2o9Z0XEjhrD+FHICGwwT14Bs=
2021-07-28T10:35:39.248 INFO:teuthology.kill:2021-07-28 10:35:39,247.247 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-28T10:35:39.249 INFO:teuthology.kill:2021-07-28 10:35:39,249.249 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-28T10:35:39.316 INFO:teuthology.kill:2021-07-28 10:35:39,316.316 INFO:teuthology.orchestra.console:Power off smithi002
2021-07-28T10:35:39.330 INFO:teuthology.kill:2021-07-28 10:35:39,330.330 INFO:teuthology.orchestra.console:Power off smithi073
2021-07-28T10:35:47.693 INFO:teuthology.kill:2021-07-28 10:35:47,692.692 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2021-07-28T10:35:47.697 INFO:teuthology.kill:2021-07-28 10:35:47,697.697 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2021-07-28T10:35:47.929 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-07-28T10:35:47.930 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-07-28T10:35:47.930 INFO:teuthology.misc:Compressing logs...
2021-07-28T10:35:47.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-28T10:36:47.995 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-07-28T10:36:48.052 INFO:teuthology.kill:No teuthology processes running
2021-07-28T10:36:49.136 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi073']
2021-07-28T10:36:50.068 INFO:teuthology.kill:2021-07-28 10:36:50,068.068 INFO:teuthology.nuke:targets:
2021-07-28T10:36:50.069 INFO:teuthology.kill:  smithi002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdhRE26hnczreBD6YdlFai4S3Y6d+FewoolzbQiaLUEbS1N6P6MMXpv/ND032cFSk1Cb6moVAuek7D4k5NqwZ9IokQeLO7tkxST3As+CXoSplaWFiyrUDzeCo0jOwhXvz2c7UtZzCKEWFLPvbJ/f9IzXzvzdmR7Uu9kI1f1pAF2yOz8nKlrl8hq0+enR00Cjm/YziXrciWuS1LU4HsuYiCfFX90EDmGfgiX9FAfhrQ5kow8kzsMzZdvlNmSePkzpqt9jkiPbFNtHYKPokTwXGqx6VFSaJ21mTax7KGxacssK1o4DiBGRLR0J3JVpYl2cjrnxDkesfEBYzc4qIvoI5nN/4Z5Ln0Qotj6EiFPBLjTunWScyl6zAfDYaO5w0kaYpHgY0pWanTgSq41KdFu1luEZTBHT5LvDUPfuNbIp8XaAfax3+LC+52oBRwbrgRRCCzah/YgX7io77OCfFWbtvaCxHQ6LM91KTU2jTpARr+du2bTHoOfKkkXd2Hpx/s4Ds=
2021-07-28T10:36:50.070 INFO:teuthology.kill:  smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHKc73t7JajoXThWmNTZtHTawKi/fHt3IjQUcCifI6cY4LHEfIp+HPQS+7z9BK3/q4VgWrCh341t3es5l9Z352P9uPU0Wl0Iaut5kSClHqs0IRA870EcPk1Hbckgrph1UrVRMmEGA5MmRDfx5V/jrNcSHr9NEQ+WdMVuDcyIYb8O6ntb4DOwqpiEotj+nZ+i/wvpGhblBBsK/ROHvo0SLmiySrl/sQgr3d9BZN/226d+0ThNS0QzlQqGLn/FptG6HC9bgUFLy1/DcZlYO4cjcanvK8dquJhoroJlIDnbrAKMJXFsy1/K8r5d5kI5JXaRZigR1HRvyxPqCB6pcCEBekkaVZytv0A4yjItaoA59oK6axs0BZGw4nQjcT5gIwnsi72oa3YOjU/fFL+OcnnqCesRXfB0xkYoOobm7cPNk2sZvI0cIcjT5lzFISDWKK7rIBS1DlDYqhffwk6Qn4iyoRsgDYRR6eoqfJFSgaMEH2o9Z0XEjhrD+FHICGwwT14Bs=
2021-07-28T10:36:50.088 INFO:teuthology.kill:2021-07-28 10:36:50,088.088 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-28T10:36:50.094 INFO:teuthology.kill:2021-07-28 10:36:50,094.094 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-28T10:36:50.140 INFO:teuthology.kill:2021-07-28 10:36:50,139.139 INFO:teuthology.orchestra.console:Power off smithi073
2021-07-28T10:36:50.154 INFO:teuthology.kill:2021-07-28 10:36:50,154.154 INFO:teuthology.orchestra.console:Power off smithi002
2021-07-28T10:36:50.289 INFO:teuthology.kill:2021-07-28 10:36:50,289.289 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2021-07-28T10:36:50.293 INFO:teuthology.kill:2021-07-28 10:36:50,292.292 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2021-07-28T10:36:50.437 INFO:teuthology.kill:2021-07-28 10:36:50,437.437 INFO:teuthology.lock.ops:unlocked smithi073.front.sepia.ceph.com
2021-07-28T10:36:50.438 INFO:teuthology.kill:2021-07-28 10:36:50,437.437 INFO:teuthology.lock.ops:unlocked smithi002.front.sepia.ceph.com
2021-07-28T10:38:50.741 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-07-28T10:38:50.829 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-07-28T10:38:50.829 INFO:teuthology.nuke:Checking targets against current locks
2021-07-28T10:38:50.904 INFO:teuthology.nuke:Not nuking smithi073.front.sepia.ceph.com because description doesn't match
2021-07-28T10:38:50.905 INFO:teuthology.nuke:Not nuking smithi002.front.sepia.ceph.com because description doesn't match