2021-05-13T16:40:25.971 INFO:root:teuthology version: 1.1.0-19220a3b
2021-05-13T16:40:26.066 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi043.front.sepia.ceph.com' reimaging
2021-05-13T16:40:26.067 INFO:teuthology.lock.ops:Updating [ubuntu@smithi043.front.sepia.ceph.com]: reset os type and version on server
2021-05-13T16:40:26.067 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2021-05-13T16:40:26.085 INFO:teuthology.lock.ops:Node 'ubuntu@smithi043.front.sepia.ceph.com' reimaging is complete
2021-05-13T16:40:26.086 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi141.front.sepia.ceph.com' reimaging
2021-05-13T16:40:26.086 INFO:teuthology.lock.ops:Updating [ubuntu@smithi141.front.sepia.ceph.com]: reset os type and version on server
2021-05-13T16:40:26.087 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2021-05-13T16:40:26.100 INFO:teuthology.lock.ops:Node 'ubuntu@smithi141.front.sepia.ceph.com' reimaging is complete
2021-05-13T16:40:26.299 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of rhel 8.3
2021-05-13T16:40:26.307 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of rhel 8.3
2021-05-13T16:40:26.722 INFO:teuthology.orchestra.console:Power off smithi043
2021-05-13T16:40:26.734 INFO:teuthology.orchestra.console:Power off smithi141
2021-05-13T16:40:35.087 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2021-05-13T16:40:35.093 INFO:teuthology.orchestra.console:Power off for smithi141 completed
2021-05-13T16:40:35.189 INFO:teuthology.orchestra.console:Power on smithi043
2021-05-13T16:40:35.197 INFO:teuthology.orchestra.console:Power on smithi141
2021-05-13T16:40:43.556 INFO:teuthology.orchestra.console:Power on for smithi043 completed
2021-05-13T16:40:43.633 INFO:teuthology.orchestra.console:Power on for smithi141 completed
2021-05-13T16:40:43.657 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2021-05-13T16:40:43.734 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish
2021-05-13T16:43:00.141 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed.
2021-05-13T16:44:31.997 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-13T16:44:47.281 INFO:teuthology.provision.fog.smithi043:Node is ready
2021-05-13T16:44:47.301 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2021-05-13T16:44:47.358 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2021-05-13T16:44:47.716 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2021-05-13T16:45:24.706 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-13T16:45:24.996 INFO:teuthology.provision.fog.smithi141:Node is ready
2021-05-13T16:45:25.010 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com
2021-05-13T16:45:25.064 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141
2021-05-13T16:45:25.373 INFO:teuthology.provision.fog.smithi141:Deploy complete!
2021-05-13T16:45:25.502 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2021-05-13T16:45:25.503 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-13T16:45:25.519 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com
2021-05-13T16:45:25.519 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-13T16:45:25.533 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2021-05-13T16:45:25.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-13T16:45:25.832 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2021-05-13T16:45:25.886 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux"
2021-05-13T16:45:25.886 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.3 (Ootpa)"
2021-05-13T16:45:25.886 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel"
2021-05-13T16:45:25.886 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora"
2021-05-13T16:45:25.887 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.3"
2021-05-13T16:45:25.887 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8"
2021-05-13T16:45:25.887 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-05-13T16:45:25.887 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2021-05-13T16:45:25.888 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-05-13T16:45:25.888 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/"
2021-05-13T16:45:25.888 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-05-13T16:45:25.888 INFO:teuthology.orchestra.run.smithi043.stdout:
2021-05-13T16:45:25.889 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-05-13T16:45:25.889 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-05-13T16:45:25.889 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-05-13T16:45:25.889 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-05-13T16:45:25.891 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2021-05-13T16:45:25.905 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server
2021-05-13T16:45:25.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-13T16:45:26.183 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64
2021-05-13T16:45:26.237 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Red Hat Enterprise Linux"
2021-05-13T16:45:26.237 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8.3 (Ootpa)"
2021-05-13T16:45:26.237 INFO:teuthology.orchestra.run.smithi141.stdout:ID="rhel"
2021-05-13T16:45:26.238 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="fedora"
2021-05-13T16:45:26.238 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8.3"
2021-05-13T16:45:26.240 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8"
2021-05-13T16:45:26.240 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-05-13T16:45:26.240 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31"
2021-05-13T16:45:26.240 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-05-13T16:45:26.240 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.redhat.com/"
2021-05-13T16:45:26.241 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-05-13T16:45:26.241 INFO:teuthology.orchestra.run.smithi141.stdout:
2021-05-13T16:45:26.241 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-05-13T16:45:26.241 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-05-13T16:45:26.242 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-05-13T16:45:26.242 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-05-13T16:45:26.242 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2021-05-13T16:45:26.359 INFO:teuthology.dispatcher.supervisor:Running job 6113520
2021-05-13T16:45:26.359 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-05-13_15:35:24-rados-no_column_b-distro-basic-smithi/6113520 --name benhanokh-2021-05-13_15:35:24-rados-no_column_b-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} -- /home/teuthworker/archive/benhanokh-2021-05-13_15:35:24-rados-no_column_b-distro-basic-smithi/6113520/orig.config.yaml
2021-05-13T16:45:26.363 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-05-13_15:35:24-rados-no_column_b-distro-basic-smithi/6113520
2021-05-13T16:45:26.363 INFO:teuthology.dispatcher.supervisor:Job PID: 3750
2021-05-13T16:45:26.364 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-05-14T04:45:43.657 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-05-14T04:45:43.905 INFO:teuthology.kill:Killing Pids: {3750}
2021-05-14T04:45:44.966 INFO:teuthology.kill:Nuking machines: ['smithi043', 'smithi141']
2021-05-14T04:45:45.876 INFO:teuthology.kill:2021-05-14 04:45:45,876.876 INFO:teuthology.nuke:targets:
2021-05-14T04:45:45.877 INFO:teuthology.kill:  smithi043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjytEKJPvkC2N3MM/xvsKNknV41w/gY1Hhcn4HFSpRi/ztbE/bhmdIeoNXb6gqgL+D4Hr5SDHyxcbARmZWEcGM72V58dcqACjs6nYIQ+Muy0DTGxfVHVUX7RO0iB+/CeS0u0+LKCL01Xtybrg1D7y9fUclF3qfLUuHrFRGUj11+bzaMHGsCoWB4NBhPSN3Zs/sLQUgWT/K4/cBUCgANUHXQMa+0SdxquQzVpJTjWcanqkjI2Dm7B/LbCN9t/qStJwvZVlgopfY5QzeLMysltqawwBwilJvSS7J6VVkB9Y5cKt7YPTJn+2A8koY8ohvVEc59xRLcCxLhTthdzCefxIzGoy1KEq8tuiUk+koJRECZDjmGBLnYMNXbxeneqa7Xjw6ob7ai0XNTX/XcuzCP46JpROCyBZYXyP7bz8q/ivTKOHQIAToZBFi3Y3YHAFbGg+AszgnnNa5xqHDytXjJAZ4seQxcDVJWXVesPy3moWnrgEacaU2pHei1ZaSpJBiQ38=
2021-05-14T04:45:45.877 INFO:teuthology.kill:  smithi141.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGUk3sGW0T1MqWymQ8orpUbvy6Hki9Ph/E4CFNDefNGWalKbsb7XrYvmjsUr9Qyql0YTSQI4kxtuROSLE0Arn+/0oq17UF2ta2Hm6ZjUQE9R4EEFjgZQASU2M2rTHkzVCNU9c9rDw6SO9LJll6JJ6I51vZyH/Z13+kA3zA55PSVmx2UtXqBQPWIaCM8vqdm6nylI53cvsr7zPunbtXb6SQtNDlfWyOKo/8yMZd9HHjxN+IkqkJvsnYk2pCAOakBA7AP8s/a8WH8y0EFQ0rLd3zvsNL9eArA8HI2PDOijyQDDcSs9s8uhuj5pEALwkfaGv4PsIQjt6CFwtImEJS4tgsIK3AtGEdZFJPOljywMGGQzd5IDmHP3TU8p2IshJbg7ftRjZdo/wfCSgHLvZpgnpldb7OWG+tvDxSNkhoHPhDYJQWT4LtXjVD6ivKWabLZtIn9/wNoQ8pk4lfFUpXjhVZjh4UXidzW6UM4TSjiT9aNhtUGkYneSji1Ba95qAOXrk=
2021-05-14T04:45:45.878 INFO:teuthology.kill:2021-05-14 04:45:45,876.876 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-14T04:45:45.878 INFO:teuthology.kill:2021-05-14 04:45:45,878.878 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-14T04:45:45.935 INFO:teuthology.kill:2021-05-14 04:45:45,935.935 INFO:teuthology.orchestra.console:Power off smithi141
2021-05-14T04:45:45.948 INFO:teuthology.kill:2021-05-14 04:45:45,947.947 INFO:teuthology.orchestra.console:Power off smithi043
2021-05-14T04:45:54.307 INFO:teuthology.kill:2021-05-14 04:45:54,307.307 INFO:teuthology.orchestra.console:Power off for smithi141 completed
2021-05-14T04:45:54.320 INFO:teuthology.kill:2021-05-14 04:45:54,319.319 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2021-05-14T04:45:54.551 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-05-14T04:45:54.552 INFO:teuthology.task.internal:roles: ubuntu@smithi141.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-05-14T04:45:54.552 INFO:teuthology.misc:Compressing logs...
2021-05-14T04:45:54.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-14T04:46:54.557 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-05-14T04:46:54.621 INFO:teuthology.kill:No teuthology processes running
2021-05-14T04:46:55.728 INFO:teuthology.kill:Nuking machines: ['smithi043', 'smithi141']
2021-05-14T04:46:56.626 INFO:teuthology.kill:2021-05-14 04:46:56,625.625 INFO:teuthology.nuke:targets:
2021-05-14T04:46:56.627 INFO:teuthology.kill:  smithi043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjytEKJPvkC2N3MM/xvsKNknV41w/gY1Hhcn4HFSpRi/ztbE/bhmdIeoNXb6gqgL+D4Hr5SDHyxcbARmZWEcGM72V58dcqACjs6nYIQ+Muy0DTGxfVHVUX7RO0iB+/CeS0u0+LKCL01Xtybrg1D7y9fUclF3qfLUuHrFRGUj11+bzaMHGsCoWB4NBhPSN3Zs/sLQUgWT/K4/cBUCgANUHXQMa+0SdxquQzVpJTjWcanqkjI2Dm7B/LbCN9t/qStJwvZVlgopfY5QzeLMysltqawwBwilJvSS7J6VVkB9Y5cKt7YPTJn+2A8koY8ohvVEc59xRLcCxLhTthdzCefxIzGoy1KEq8tuiUk+koJRECZDjmGBLnYMNXbxeneqa7Xjw6ob7ai0XNTX/XcuzCP46JpROCyBZYXyP7bz8q/ivTKOHQIAToZBFi3Y3YHAFbGg+AszgnnNa5xqHDytXjJAZ4seQxcDVJWXVesPy3moWnrgEacaU2pHei1ZaSpJBiQ38=
2021-05-14T04:46:56.627 INFO:teuthology.kill:  smithi141.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGUk3sGW0T1MqWymQ8orpUbvy6Hki9Ph/E4CFNDefNGWalKbsb7XrYvmjsUr9Qyql0YTSQI4kxtuROSLE0Arn+/0oq17UF2ta2Hm6ZjUQE9R4EEFjgZQASU2M2rTHkzVCNU9c9rDw6SO9LJll6JJ6I51vZyH/Z13+kA3zA55PSVmx2UtXqBQPWIaCM8vqdm6nylI53cvsr7zPunbtXb6SQtNDlfWyOKo/8yMZd9HHjxN+IkqkJvsnYk2pCAOakBA7AP8s/a8WH8y0EFQ0rLd3zvsNL9eArA8HI2PDOijyQDDcSs9s8uhuj5pEALwkfaGv4PsIQjt6CFwtImEJS4tgsIK3AtGEdZFJPOljywMGGQzd5IDmHP3TU8p2IshJbg7ftRjZdo/wfCSgHLvZpgnpldb7OWG+tvDxSNkhoHPhDYJQWT4LtXjVD6ivKWabLZtIn9/wNoQ8pk4lfFUpXjhVZjh4UXidzW6UM4TSjiT9aNhtUGkYneSji1Ba95qAOXrk=
2021-05-14T04:46:56.645 INFO:teuthology.kill:2021-05-14 04:46:56,645.645 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-14T04:46:56.648 INFO:teuthology.kill:2021-05-14 04:46:56,648.648 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-14T04:46:56.696 INFO:teuthology.kill:2021-05-14 04:46:56,696.696 INFO:teuthology.orchestra.console:Power off smithi141
2021-05-14T04:46:56.707 INFO:teuthology.kill:2021-05-14 04:46:56,707.707 INFO:teuthology.orchestra.console:Power off smithi043
2021-05-14T04:46:56.834 INFO:teuthology.kill:2021-05-14 04:46:56,834.834 INFO:teuthology.orchestra.console:Power off for smithi141 completed
2021-05-14T04:46:56.844 INFO:teuthology.kill:2021-05-14 04:46:56,844.844 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2021-05-14T04:46:56.981 INFO:teuthology.kill:2021-05-14 04:46:56,980.980 INFO:teuthology.lock.ops:unlocked smithi043.front.sepia.ceph.com
2021-05-14T04:46:56.984 INFO:teuthology.kill:2021-05-14 04:46:56,984.984 INFO:teuthology.lock.ops:unlocked smithi141.front.sepia.ceph.com
2021-05-14T04:48:57.159 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15