2021-09-14T20:52:02.714 INFO:root:teuthology version: 1.1.0-b135a4f8
2021-09-14T20:52:02.811 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi067.front.sepia.ceph.com' reimaging
2021-09-14T20:52:02.812 INFO:teuthology.lock.ops:Updating [ubuntu@smithi067.front.sepia.ceph.com]: reset os type and version on server
2021-09-14T20:52:02.814 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2021-09-14T20:52:02.839 INFO:teuthology.lock.ops:Node 'ubuntu@smithi067.front.sepia.ceph.com' reimaging is complete
2021-09-14T20:52:02.839 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi083.front.sepia.ceph.com' reimaging
2021-09-14T20:52:02.839 INFO:teuthology.lock.ops:Updating [ubuntu@smithi083.front.sepia.ceph.com]: reset os type and version on server
2021-09-14T20:52:02.840 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server
2021-09-14T20:52:02.855 INFO:teuthology.lock.ops:Node 'ubuntu@smithi083.front.sepia.ceph.com' reimaging is complete
2021-09-14T20:52:03.056 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of rhel 8.4
2021-09-14T20:52:03.076 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of rhel 8.4
2021-09-14T20:52:03.357 INFO:teuthology.orchestra.console:Power off smithi083
2021-09-14T20:52:03.393 INFO:teuthology.orchestra.console:Power off smithi067
2021-09-14T20:52:03.502 INFO:teuthology.orchestra.console:Power off for smithi083 completed
2021-09-14T20:52:03.533 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2021-09-14T20:52:03.605 INFO:teuthology.orchestra.console:Power on smithi083
2021-09-14T20:52:03.634 INFO:teuthology.orchestra.console:Power on smithi067
2021-09-14T20:52:11.974 INFO:teuthology.orchestra.console:Power on for smithi083 completed
2021-09-14T20:52:11.992 INFO:teuthology.orchestra.console:Power on for smithi067 completed
2021-09-14T20:52:12.076 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish
2021-09-14T20:52:12.093 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish
2021-09-14T20:56:52.929 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-09-14T20:56:53.153 INFO:teuthology.provision.fog.smithi067:Node is ready
2021-09-14T20:56:53.169 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com
2021-09-14T20:56:53.225 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067
2021-09-14T20:56:53.555 INFO:teuthology.provision.fog.smithi067:Deploy complete!
2021-09-14T20:56:58.852 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-09-14T20:56:59.045 INFO:teuthology.provision.fog.smithi083:Node is ready
2021-09-14T20:56:59.102 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com
2021-09-14T20:56:59.159 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083
2021-09-14T20:56:59.497 INFO:teuthology.provision.fog.smithi083:Deploy complete!
2021-09-14T20:56:59.640 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com
2021-09-14T20:56:59.641 INFO:teuthology.lock.ops:New key found. Updating...
2021-09-14T20:56:59.661 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com
2021-09-14T20:56:59.662 INFO:teuthology.lock.ops:New key found. Updating...
2021-09-14T20:56:59.677 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server
2021-09-14T20:56:59.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-09-14T20:56:59.915 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64
2021-09-14T20:56:59.970 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux"
2021-09-14T20:56:59.971 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.4 (Ootpa)"
2021-09-14T20:56:59.971 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel"
2021-09-14T20:56:59.971 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora"
2021-09-14T20:56:59.972 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.4"
2021-09-14T20:56:59.972 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8"
2021-09-14T20:56:59.972 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-09-14T20:56:59.972 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31"
2021-09-14T20:56:59.973 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-09-14T20:56:59.973 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/"
2021-09-14T20:56:59.973 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-09-14T20:56:59.973 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-09-14T20:56:59.973 INFO:teuthology.orchestra.run.smithi067.stdout:
2021-09-14T20:56:59.974 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-09-14T20:56:59.974 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-09-14T20:56:59.974 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-09-14T20:56:59.974 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-09-14T20:56:59.976 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2021-09-14T20:56:59.992 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server
2021-09-14T20:56:59.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-09-14T20:57:00.211 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64
2021-09-14T20:57:00.265 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux"
2021-09-14T20:57:00.265 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.4 (Ootpa)"
2021-09-14T20:57:00.265 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel"
2021-09-14T20:57:00.266 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora"
2021-09-14T20:57:00.266 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.4"
2021-09-14T20:57:00.266 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8"
2021-09-14T20:57:00.266 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-09-14T20:57:00.267 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31"
2021-09-14T20:57:00.267 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-09-14T20:57:00.267 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/"
2021-09-14T20:57:00.267 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-09-14T20:57:00.268 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-09-14T20:57:00.268 INFO:teuthology.orchestra.run.smithi083.stdout:
2021-09-14T20:57:00.268 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-09-14T20:57:00.268 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-09-14T20:57:00.268 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-09-14T20:57:00.269 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-09-14T20:57:00.269 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server
2021-09-14T20:57:00.347 INFO:teuthology.dispatcher.supervisor:Running job 6390056
2021-09-14T20:57:00.347 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/bin/teuthology -v --owner scheduled_ozeneva@teuthology --archive /home/teuthworker/archive/ozeneva-2021-09-14_18:00:14-rados-wip-omri-tracer-distro-basic-smithi/6390056 --name ozeneva-2021-09-14_18:00:14-rados-wip-omri-tracer-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} -- /home/teuthworker/archive/ozeneva-2021-09-14_18:00:14-rados-wip-omri-tracer-distro-basic-smithi/6390056/orig.config.yaml
2021-09-14T20:57:00.350 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ozeneva-2021-09-14_18:00:14-rados-wip-omri-tracer-distro-basic-smithi/6390056
2021-09-14T20:57:00.351 INFO:teuthology.dispatcher.supervisor:Job PID: 22522
2021-09-14T20:57:00.351 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-09-14T21:31:02.609 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/ozeneva-2021-09-14_18:00:14-rados-wip-omri-tracer-distro-basic-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2021-09-15T08:57:48.480 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-09-15T08:57:48.709 INFO:teuthology.kill:Killing Pids: {22522}
2021-09-15T08:57:49.703 INFO:teuthology.kill:Nuking machines: ['smithi067', 'smithi083']
2021-09-15T08:57:50.564 INFO:teuthology.kill:2021-09-15 08:57:50,563.563 INFO:teuthology.nuke:targets:
2021-09-15T08:57:50.565 INFO:teuthology.kill:  smithi067.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChMm16ZJ+UMe74zJAb/RyrSHbI9S3rYFDdeg1pZMw1bWt7mOY6tCMk/ex/Qghx8i1rEk6qackWxRwrX79wEsE7MntazXbSY+UG4WCosQbzx/6W/xrm3y4cf2sncl2RJPUJknjmfBCEEzr6hJryr+HXvfHVanPs1M52aJkkPV5cmlz69718Vm8n8q7OCvBO/QYZ/gm5lUK/6NvEI21kqNZ4apKrtFd+4I23P0gyxogN4IrxEfyHQz/FvEL8C9+KhkV8TqsVaZJ61MvkluNbxZ47iFALAc70BO5oe251Fv7sIm9VPVfTn6CJOq+7jItLfDJjlIfKMda5MrCUGFDzMBafwgydxhAjmaPEXezIerrQBrl4tcQmeZQt3giGPrY4QCvgC8zghL/ouM9+12eFisTTI2+F+9mxg/TIPDp+N3BqOBqD2BwyeP2sjRs7g5kyLNdi98JN1Lz+sz/yVz0GocIogBHHhw9ARK1qdj6MZf2kvPeT+uR8bkwIvA5eBcQL620=
2021-09-15T08:57:50.565 INFO:teuthology.kill:  smithi083.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCopzbtfrFlKUwbtokAnXkE6ENutZ6hLcNpRM3MaJUfecBRKaHHQGAAaxSKqcUFv2Ln+q2iGm4XtnEPCEe3NGSWOAjdXkMOQZFzVgVLMRcoZ2XGA1262jslWrzSwfg3MJf/LcUeGlQWLJ2BSe0JcERADZXq5r+JljDKAbmDYz5ABaD8H0NdmMH4OILp7JFdWArieTSsbE+M3eIjnno5BdnIFirZeW+O62b4rav6imqPv/deepPT8+B6khgt63+nKcJC8Z5Bs9zz25BFy8gmKuOuUbD5LIX/TXmTeVtjU0/h55D57UKKY4LSGa2jQ/jNi2ePTXEkc9H1D1mowB4IloZqf8c3f1jvIhHIQfahEQzMlXhzevLNKA6bA5OyhA2f1hoiRr0PdsRpQOtf+uS+QnHRYiZdHPoP3orwVqcOlU9kAt12qI/nAG9cuA2USsWC4yPI+5mGRi95obRCTqYxG/+ofCwzFN8KBdVV06p11p2TLaxmR7mFYRwET0ExfC9a+ds=
2021-09-15T08:57:50.565 INFO:teuthology.kill:2021-09-15 08:57:50,564.564 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-09-15T08:57:50.567 INFO:teuthology.kill:2021-09-15 08:57:50,566.566 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-09-15T08:57:50.633 INFO:teuthology.kill:2021-09-15 08:57:50,633.633 INFO:teuthology.orchestra.console:Power off smithi067
2021-09-15T08:57:50.648 INFO:teuthology.kill:2021-09-15 08:57:50,648.648 INFO:teuthology.orchestra.console:Power off smithi083
2021-09-15T08:58:03.121 INFO:teuthology.kill:2021-09-15 08:58:03,120.120 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2021-09-15T08:58:03.125 INFO:teuthology.kill:2021-09-15 08:58:03,125.125 INFO:teuthology.orchestra.console:Power off for smithi083 completed
2021-09-15T08:58:03.342 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-09-15T08:58:03.343 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-09-15T08:58:03.343 INFO:teuthology.misc:Compressing logs...
2021-09-15T08:58:03.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-09-15T08:58:21.775 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-09-15T08:58:21.827 INFO:teuthology.kill:No teuthology processes running
2021-09-15T08:58:22.792 INFO:teuthology.kill:Nuking machines: ['smithi067', 'smithi083']
2021-09-15T08:58:23.611 INFO:teuthology.kill:2021-09-15 08:58:23,611.611 INFO:teuthology.nuke:targets:
2021-09-15T08:58:23.612 INFO:teuthology.kill:  smithi067.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQChMm16ZJ+UMe74zJAb/RyrSHbI9S3rYFDdeg1pZMw1bWt7mOY6tCMk/ex/Qghx8i1rEk6qackWxRwrX79wEsE7MntazXbSY+UG4WCosQbzx/6W/xrm3y4cf2sncl2RJPUJknjmfBCEEzr6hJryr+HXvfHVanPs1M52aJkkPV5cmlz69718Vm8n8q7OCvBO/QYZ/gm5lUK/6NvEI21kqNZ4apKrtFd+4I23P0gyxogN4IrxEfyHQz/FvEL8C9+KhkV8TqsVaZJ61MvkluNbxZ47iFALAc70BO5oe251Fv7sIm9VPVfTn6CJOq+7jItLfDJjlIfKMda5MrCUGFDzMBafwgydxhAjmaPEXezIerrQBrl4tcQmeZQt3giGPrY4QCvgC8zghL/ouM9+12eFisTTI2+F+9mxg/TIPDp+N3BqOBqD2BwyeP2sjRs7g5kyLNdi98JN1Lz+sz/yVz0GocIogBHHhw9ARK1qdj6MZf2kvPeT+uR8bkwIvA5eBcQL620=
2021-09-15T08:58:23.613 INFO:teuthology.kill:  smithi083.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCopzbtfrFlKUwbtokAnXkE6ENutZ6hLcNpRM3MaJUfecBRKaHHQGAAaxSKqcUFv2Ln+q2iGm4XtnEPCEe3NGSWOAjdXkMOQZFzVgVLMRcoZ2XGA1262jslWrzSwfg3MJf/LcUeGlQWLJ2BSe0JcERADZXq5r+JljDKAbmDYz5ABaD8H0NdmMH4OILp7JFdWArieTSsbE+M3eIjnno5BdnIFirZeW+O62b4rav6imqPv/deepPT8+B6khgt63+nKcJC8Z5Bs9zz25BFy8gmKuOuUbD5LIX/TXmTeVtjU0/h55D57UKKY4LSGa2jQ/jNi2ePTXEkc9H1D1mowB4IloZqf8c3f1jvIhHIQfahEQzMlXhzevLNKA6bA5OyhA2f1hoiRr0PdsRpQOtf+uS+QnHRYiZdHPoP3orwVqcOlU9kAt12qI/nAG9cuA2USsWC4yPI+5mGRi95obRCTqYxG/+ofCwzFN8KBdVV06p11p2TLaxmR7mFYRwET0ExfC9a+ds=
2021-09-15T08:58:23.633 INFO:teuthology.kill:2021-09-15 08:58:23,633.633 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-09-15T08:58:23.636 INFO:teuthology.kill:2021-09-15 08:58:23,635.635 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-09-15T08:58:23.689 INFO:teuthology.kill:2021-09-15 08:58:23,688.688 INFO:teuthology.orchestra.console:Power off smithi067
2021-09-15T08:58:23.700 INFO:teuthology.kill:2021-09-15 08:58:23,700.700 INFO:teuthology.orchestra.console:Power off smithi083
2021-09-15T08:58:23.829 INFO:teuthology.kill:2021-09-15 08:58:23,828.828 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2021-09-15T08:58:23.840 INFO:teuthology.kill:2021-09-15 08:58:23,840.840 INFO:teuthology.orchestra.console:Power off for smithi083 completed
2021-09-15T08:58:23.973 INFO:teuthology.kill:2021-09-15 08:58:23,972.972 INFO:teuthology.lock.ops:unlocked smithi067.front.sepia.ceph.com
2021-09-15T08:58:23.981 INFO:teuthology.kill:2021-09-15 08:58:23,981.981 INFO:teuthology.lock.ops:unlocked smithi083.front.sepia.ceph.com
2021-09-15T09:00:24.192 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15