2021-02-20T16:31:49.460 INFO:root:teuthology version: 1.1.0-9a6b849c
2021-02-20T16:31:49.556 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi078.front.sepia.ceph.com' reimaging
2021-02-20T16:31:49.557 INFO:teuthology.lock.ops:Updating [ubuntu@smithi078.front.sepia.ceph.com]: reset os type and version on server
2021-02-20T16:31:49.557 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2021-02-20T16:31:49.570 INFO:teuthology.lock.ops:Node 'ubuntu@smithi078.front.sepia.ceph.com' reimaging is complete
2021-02-20T16:31:49.570 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi184.front.sepia.ceph.com' reimaging
2021-02-20T16:31:49.570 INFO:teuthology.lock.ops:Updating [ubuntu@smithi184.front.sepia.ceph.com]: reset os type and version on server
2021-02-20T16:31:49.571 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server
2021-02-20T16:31:49.585 INFO:teuthology.lock.ops:Node 'ubuntu@smithi184.front.sepia.ceph.com' reimaging is complete
2021-02-20T16:31:49.782 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of rhel 8.3
2021-02-20T16:31:49.787 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of rhel 8.3
2021-02-20T16:31:50.118 INFO:teuthology.orchestra.console:Power off smithi078
2021-02-20T16:31:50.133 INFO:teuthology.orchestra.console:Power off smithi184
2021-02-20T16:32:02.593 INFO:teuthology.orchestra.console:Power off for smithi078 completed
2021-02-20T16:32:02.599 INFO:teuthology.orchestra.console:Power off for smithi184 completed
2021-02-20T16:32:02.695 INFO:teuthology.orchestra.console:Power on smithi078
2021-02-20T16:32:02.704 INFO:teuthology.orchestra.console:Power on smithi184
2021-02-20T16:32:06.947 INFO:teuthology.orchestra.console:Power on for smithi078 completed
2021-02-20T16:32:06.953 INFO:teuthology.orchestra.console:Power on for smithi184 completed
2021-02-20T16:32:07.049 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish
2021-02-20T16:32:07.054 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish
2021-02-20T16:34:38.401 ERROR:teuthology.orchestra.connection:Error authenticating with smithi078.front.sepia.ceph.com: Authentication failed.
2021-02-20T16:36:48.076 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-20T16:36:49.843 INFO:teuthology.provision.fog.smithi184:Node is ready
2021-02-20T16:36:49.859 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com
2021-02-20T16:36:49.915 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184
2021-02-20T16:36:50.254 INFO:teuthology.provision.fog.smithi184:Deploy complete!
2021-02-20T16:36:51.777 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-20T16:36:52.089 INFO:teuthology.provision.fog.smithi078:Node is ready
2021-02-20T16:36:52.104 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com
2021-02-20T16:36:52.159 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078
2021-02-20T16:36:52.488 INFO:teuthology.provision.fog.smithi078:Deploy complete!
2021-02-20T16:36:52.627 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com
2021-02-20T16:36:52.631 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-20T16:36:52.648 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com
2021-02-20T16:36:52.649 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-20T16:36:52.665 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server
2021-02-20T16:36:52.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-20T16:36:52.942 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64
2021-02-20T16:36:52.996 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux"
2021-02-20T16:36:52.996 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.3 (Ootpa)"
2021-02-20T16:36:52.997 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel"
2021-02-20T16:36:52.997 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora"
2021-02-20T16:36:52.997 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.3"
2021-02-20T16:36:52.997 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8"
2021-02-20T16:36:52.998 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-02-20T16:36:52.998 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2021-02-20T16:36:52.998 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-02-20T16:36:52.998 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/"
2021-02-20T16:36:52.998 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-02-20T16:36:52.999 INFO:teuthology.orchestra.run.smithi078.stdout:
2021-02-20T16:36:52.999 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-02-20T16:36:52.999 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-02-20T16:36:52.999 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-02-20T16:36:53.000 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-02-20T16:36:53.001 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2021-02-20T16:36:53.017 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server
2021-02-20T16:36:53.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-20T16:36:53.241 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64
2021-02-20T16:36:53.298 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux"
2021-02-20T16:36:53.299 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.3 (Ootpa)"
2021-02-20T16:36:53.299 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel"
2021-02-20T16:36:53.300 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora"
2021-02-20T16:36:53.300 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.3"
2021-02-20T16:36:53.300 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8"
2021-02-20T16:36:53.301 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-02-20T16:36:53.301 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31"
2021-02-20T16:36:53.301 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-02-20T16:36:53.301 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/"
2021-02-20T16:36:53.302 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-02-20T16:36:53.302 INFO:teuthology.orchestra.run.smithi184.stdout:
2021-02-20T16:36:53.302 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-02-20T16:36:53.302 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-02-20T16:36:53.302 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-02-20T16:36:53.303 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-02-20T16:36:53.303 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server
2021-02-20T16:36:53.378 INFO:teuthology.dispatcher.supervisor:Running job 5898774
2021-02-20T16:36:53.378 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/virtualenv/bin/teuthology -v --owner scheduled_jdillaman@dillaman-rh --archive /home/teuthworker/archive/jdillaman-2021-02-20_10:14:11-rbd-wip-jd-testing-distro-basic-smithi/5898774 --name jdillaman-2021-02-20_10:14:11-rbd-wip-jd-testing-distro-basic-smithi --description rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_journal} -- /home/teuthworker/archive/jdillaman-2021-02-20_10:14:11-rbd-wip-jd-testing-distro-basic-smithi/5898774/orig.config.yaml
2021-02-20T16:36:53.381 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/jdillaman-2021-02-20_10:14:11-rbd-wip-jd-testing-distro-basic-smithi/5898774
2021-02-20T16:36:53.382 INFO:teuthology.dispatcher.supervisor:Job PID: 22711
2021-02-20T16:36:53.383 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-02-21T04:37:09.799 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-02-21T04:37:10.239 INFO:teuthology.kill:Killing Pids: {22711}
2021-02-21T04:37:11.241 INFO:teuthology.kill:Nuking machines: ['smithi078', 'smithi184']
2021-02-21T04:37:12.052 INFO:teuthology.kill:2021-02-21 04:37:12,051.051 INFO:teuthology.nuke:targets:
2021-02-21T04:37:12.052 INFO:teuthology.kill:  smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTXlbjO786A8b2l+2o5qLpC601mC4ctj8d9ii96++dwsn/IY+sg2JLUJHcCKRsYxx8yhdlF2xEoLnjyJjHNLh2JxeLEoJxw/duZaGkmi0wmkKwZIyQxiyGCQHqumWGSg3GfkUgDqR9d1/oapBm/el/n6NaPPJYVtoiwK7A7O5Vk7eJwA7utHhjv54XkB9FxPvBNuHoKQ8A6c4NxdeSndJ9aWZW2qJSqGKwH32U115qef9yl7wMJB5UmvZiVGBpaLMjjiwepy1/shQ3INbcbOq7/4At7ObqIQ6MPpvFbETgQAMya8naOLgdzDA1nvjzJLrmqUi2DKwcO+Dg0ZSbZBjI7xlFtHHM0kidjVHtIqCsTepUI/PESXdXoVF2vDPyQnYm3xWZD0pH5IpfsvIi0ScnqxwNiv3bDb7QAm76rgS+PoadTZHBdOKJea2Rs2hbQyTfGLsDooqRTc7BQDUJumg/UMFSGnuL67rv7I77AQFZFlBgSBt4e3h0zZW5cWt3L2c=
2021-02-21T04:37:12.053 INFO:teuthology.kill:  smithi184.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDd+PlEbC0DjeOJ0BRmQF6655UEhfyCNy7vtR9OCwLiJ3KdyVxGiAHw8CYPzKWIVovSUr3TG0HPBxbIRrl2cRK0QMQSfNRZABpUWvNCU7/MZGRHAYifdV1gxfk7NHCgMIdLBVGvZZW9Dth337LrLmHucr7LRgnB4oGbtDogBWc5ClJq44MwgbHeI3O+UCw89JIrEtiUErYwejnp+Hq4dSVD7RiV1gRgfi4EnKIHyqbQ7BjkGZpqLhb2zDvEPp53mQkYi2UshMcUgXDFrzlZKFpaVqThgDGOhjtK5rn7OD2IV5V3LvyJFOtaNZQAT7KR8cMuOMJQgTsCFst5BDy+olIFSUQSI/G4OBPQBKpP257+WSBcE/7PztiLwBHjaLe7uqnd2LzTL2MyTk+OUzkf4UafGG3Gj6vpsKjWr97+2Bp4JxmHmpQknDwu7DI5F3pMyVuvWabFRiYvT0ApiNeYegp+Z+wkEVaQbm1SC9Mv1k+7ETF8b8+ACambPmDBg7xsGc=
2021-02-21T04:37:12.053 INFO:teuthology.kill:2021-02-21 04:37:12,052.052 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-21T04:37:12.059 INFO:teuthology.kill:2021-02-21 04:37:12,059.059 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-21T04:37:12.119 INFO:teuthology.kill:2021-02-21 04:37:12,119.119 INFO:teuthology.orchestra.console:Power off smithi078
2021-02-21T04:37:12.134 INFO:teuthology.kill:2021-02-21 04:37:12,133.133 INFO:teuthology.orchestra.console:Power off smithi184
2021-02-21T04:37:24.614 INFO:teuthology.kill:2021-02-21 04:37:24,613.613 INFO:teuthology.orchestra.console:Power off for smithi078 completed
2021-02-21T04:37:24.620 INFO:teuthology.kill:2021-02-21 04:37:24,620.620 INFO:teuthology.orchestra.console:Power off for smithi184 completed
2021-02-21T04:37:24.853 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-02-21T04:37:24.854 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-02-21T04:37:24.854 INFO:teuthology.misc:Compressing logs...
2021-02-21T04:37:24.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-21T04:37:59.362 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-02-21T04:37:59.415 INFO:teuthology.kill:No teuthology processes running
2021-02-21T04:38:00.378 INFO:teuthology.kill:Nuking machines: ['smithi078', 'smithi184']
2021-02-21T04:38:01.195 INFO:teuthology.kill:2021-02-21 04:38:01,195.195 INFO:teuthology.nuke:targets:
2021-02-21T04:38:01.196 INFO:teuthology.kill:  smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTXlbjO786A8b2l+2o5qLpC601mC4ctj8d9ii96++dwsn/IY+sg2JLUJHcCKRsYxx8yhdlF2xEoLnjyJjHNLh2JxeLEoJxw/duZaGkmi0wmkKwZIyQxiyGCQHqumWGSg3GfkUgDqR9d1/oapBm/el/n6NaPPJYVtoiwK7A7O5Vk7eJwA7utHhjv54XkB9FxPvBNuHoKQ8A6c4NxdeSndJ9aWZW2qJSqGKwH32U115qef9yl7wMJB5UmvZiVGBpaLMjjiwepy1/shQ3INbcbOq7/4At7ObqIQ6MPpvFbETgQAMya8naOLgdzDA1nvjzJLrmqUi2DKwcO+Dg0ZSbZBjI7xlFtHHM0kidjVHtIqCsTepUI/PESXdXoVF2vDPyQnYm3xWZD0pH5IpfsvIi0ScnqxwNiv3bDb7QAm76rgS+PoadTZHBdOKJea2Rs2hbQyTfGLsDooqRTc7BQDUJumg/UMFSGnuL67rv7I77AQFZFlBgSBt4e3h0zZW5cWt3L2c=
2021-02-21T04:38:01.196 INFO:teuthology.kill:  smithi184.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDd+PlEbC0DjeOJ0BRmQF6655UEhfyCNy7vtR9OCwLiJ3KdyVxGiAHw8CYPzKWIVovSUr3TG0HPBxbIRrl2cRK0QMQSfNRZABpUWvNCU7/MZGRHAYifdV1gxfk7NHCgMIdLBVGvZZW9Dth337LrLmHucr7LRgnB4oGbtDogBWc5ClJq44MwgbHeI3O+UCw89JIrEtiUErYwejnp+Hq4dSVD7RiV1gRgfi4EnKIHyqbQ7BjkGZpqLhb2zDvEPp53mQkYi2UshMcUgXDFrzlZKFpaVqThgDGOhjtK5rn7OD2IV5V3LvyJFOtaNZQAT7KR8cMuOMJQgTsCFst5BDy+olIFSUQSI/G4OBPQBKpP257+WSBcE/7PztiLwBHjaLe7uqnd2LzTL2MyTk+OUzkf4UafGG3Gj6vpsKjWr97+2Bp4JxmHmpQknDwu7DI5F3pMyVuvWabFRiYvT0ApiNeYegp+Z+wkEVaQbm1SC9Mv1k+7ETF8b8+ACambPmDBg7xsGc=
2021-02-21T04:38:01.219 INFO:teuthology.kill:2021-02-21 04:38:01,219.219 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-21T04:38:01.222 INFO:teuthology.kill:2021-02-21 04:38:01,222.222 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-21T04:38:01.285 INFO:teuthology.kill:2021-02-21 04:38:01,284.284 INFO:teuthology.orchestra.console:Power off smithi078
2021-02-21T04:38:01.301 INFO:teuthology.kill:2021-02-21 04:38:01,301.301 INFO:teuthology.orchestra.console:Power off smithi184
2021-02-21T04:38:01.438 INFO:teuthology.kill:2021-02-21 04:38:01,438.438 INFO:teuthology.orchestra.console:Power off for smithi078 completed
2021-02-21T04:38:01.451 INFO:teuthology.kill:2021-02-21 04:38:01,450.450 INFO:teuthology.orchestra.console:Power off for smithi184 completed
2021-02-21T04:38:01.582 INFO:teuthology.kill:2021-02-21 04:38:01,581.581 INFO:teuthology.lock.ops:unlocked smithi078.front.sepia.ceph.com
2021-02-21T04:38:01.588 INFO:teuthology.kill:2021-02-21 04:38:01,588.588 INFO:teuthology.lock.ops:unlocked smithi184.front.sepia.ceph.com
2021-02-21T04:40:01.768 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-02-21T04:40:01.857 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-02-21T04:40:01.858 INFO:teuthology.nuke:Checking targets against current locks
2021-02-21T04:40:01.939 INFO:teuthology.nuke:Not nuking smithi184.front.sepia.ceph.com because description doesn't match
2021-02-21T04:40:01.940 INFO:teuthology.nuke:Not nuking smithi078.front.sepia.ceph.com because description doesn't match