2021-08-11T19:58:11.858 INFO:root:teuthology version: 1.1.0-321319b1
2021-08-11T19:58:11.950 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi150.front.sepia.ceph.com' reimaging
2021-08-11T19:58:11.951 INFO:teuthology.lock.ops:Updating [ubuntu@smithi150.front.sepia.ceph.com]: reset os type and version on server
2021-08-11T19:58:11.952 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2021-08-11T19:58:11.968 INFO:teuthology.lock.ops:Node 'ubuntu@smithi150.front.sepia.ceph.com' reimaging is complete
2021-08-11T19:58:11.968 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi166.front.sepia.ceph.com' reimaging
2021-08-11T19:58:11.969 INFO:teuthology.lock.ops:Updating [ubuntu@smithi166.front.sepia.ceph.com]: reset os type and version on server
2021-08-11T19:58:11.969 INFO:teuthology.lock.ops:Updating smithi166.front.sepia.ceph.com on lock server
2021-08-11T19:58:11.985 INFO:teuthology.lock.ops:Node 'ubuntu@smithi166.front.sepia.ceph.com' reimaging is complete
2021-08-11T19:58:12.179 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 8.3
2021-08-11T19:58:12.221 INFO:teuthology.provision.fog.smithi166:Scheduling deploy of centos 8.3
2021-08-11T19:58:12.646 INFO:teuthology.orchestra.console:Power off smithi150
2021-08-11T19:58:12.659 INFO:teuthology.orchestra.console:Power off smithi166
2021-08-11T19:58:25.130 INFO:teuthology.orchestra.console:Power off for smithi150 completed
2021-08-11T19:58:25.135 INFO:teuthology.orchestra.console:Power off for smithi166 completed
2021-08-11T19:58:25.232 INFO:teuthology.orchestra.console:Power on smithi150
2021-08-11T19:58:25.241 INFO:teuthology.orchestra.console:Power on smithi166
2021-08-11T19:58:29.490 INFO:teuthology.orchestra.console:Power on for smithi150 completed
2021-08-11T19:58:29.591 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish
2021-08-11T19:58:33.604 INFO:teuthology.orchestra.console:Power on for smithi166 completed
2021-08-11T19:58:33.705 INFO:teuthology.provision.fog.smithi166:Waiting for deploy to finish
2021-08-11T20:03:40.437 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-11T20:03:55.655 INFO:teuthology.provision.fog.smithi150:Node is ready
2021-08-11T20:03:55.675 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com
2021-08-11T20:03:55.732 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150
2021-08-11T20:03:56.140 INFO:teuthology.provision.fog.smithi150:Deploy complete!
2021-08-11T20:04:00.067 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-11T20:04:20.723 INFO:teuthology.provision.fog.smithi166:Node is ready
2021-08-11T20:04:20.742 INFO:teuthology.orchestra.run.smithi166.stdout:smithi166.front.sepia.ceph.com
2021-08-11T20:04:20.799 INFO:teuthology.orchestra.run.smithi166.stdout:172.21.15.166 smithi166.front.sepia.ceph.com smithi166
2021-08-11T20:04:21.144 INFO:teuthology.provision.fog.smithi166:Deploy complete!
2021-08-11T20:04:21.274 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com
2021-08-11T20:04:21.275 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-11T20:04:21.291 INFO:teuthology.lock.ops:Checking smithi166.front.sepia.ceph.com
2021-08-11T20:04:21.291 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-11T20:04:21.307 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server
2021-08-11T20:04:21.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-11T20:04:21.517 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64
2021-08-11T20:04:21.573 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Linux"
2021-08-11T20:04:21.573 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8"
2021-08-11T20:04:21.574 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2021-08-11T20:04:21.574 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2021-08-11T20:04:21.574 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8"
2021-08-11T20:04:21.574 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8"
2021-08-11T20:04:21.575 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Linux 8"
2021-08-11T20:04:21.575 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2021-08-11T20:04:21.575 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-08-11T20:04:21.575 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2021-08-11T20:04:21.576 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-08-11T20:04:21.576 INFO:teuthology.orchestra.run.smithi150.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-08-11T20:04:21.576 INFO:teuthology.orchestra.run.smithi150.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-08-11T20:04:21.577 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2021-08-11T20:04:21.593 INFO:teuthology.lock.ops:Updating [smithi166.front.sepia.ceph.com]: set os type and version on server
2021-08-11T20:04:21.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-11T20:04:21.798 INFO:teuthology.orchestra.run.smithi166.stdout:x86_64
2021-08-11T20:04:21.852 INFO:teuthology.orchestra.run.smithi166.stdout:NAME="CentOS Linux"
2021-08-11T20:04:21.853 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION="8"
2021-08-11T20:04:21.853 INFO:teuthology.orchestra.run.smithi166.stdout:ID="centos"
2021-08-11T20:04:21.853 INFO:teuthology.orchestra.run.smithi166.stdout:ID_LIKE="rhel fedora"
2021-08-11T20:04:21.853 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION_ID="8"
2021-08-11T20:04:21.854 INFO:teuthology.orchestra.run.smithi166.stdout:PLATFORM_ID="platform:el8"
2021-08-11T20:04:21.854 INFO:teuthology.orchestra.run.smithi166.stdout:PRETTY_NAME="CentOS Linux 8"
2021-08-11T20:04:21.854 INFO:teuthology.orchestra.run.smithi166.stdout:ANSI_COLOR="0;31"
2021-08-11T20:04:21.855 INFO:teuthology.orchestra.run.smithi166.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-08-11T20:04:21.855 INFO:teuthology.orchestra.run.smithi166.stdout:HOME_URL="https://centos.org/"
2021-08-11T20:04:21.855 INFO:teuthology.orchestra.run.smithi166.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-08-11T20:04:21.855 INFO:teuthology.orchestra.run.smithi166.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-08-11T20:04:21.856 INFO:teuthology.orchestra.run.smithi166.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-08-11T20:04:21.856 INFO:teuthology.lock.ops:Updating smithi166.front.sepia.ceph.com on lock server
2021-08-11T20:04:21.931 INFO:teuthology.dispatcher.supervisor:Running job 6335143
2021-08-11T20:04:21.932 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2021-08-11_18:55:50-rados:thrash-wip-ronenf-unique-scrub-distro-basic-smithi/6335143 --name rfriedma-2021-08-11_18:55:50-rados:thrash-wip-ronenf-unique-scrub-distro-basic-smithi --description rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} -- /home/teuthworker/archive/rfriedma-2021-08-11_18:55:50-rados:thrash-wip-ronenf-unique-scrub-distro-basic-smithi/6335143/orig.config.yaml
2021-08-11T20:04:21.935 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2021-08-11_18:55:50-rados:thrash-wip-ronenf-unique-scrub-distro-basic-smithi/6335143
2021-08-11T20:04:21.936 INFO:teuthology.dispatcher.supervisor:Job PID: 6221
2021-08-11T20:04:21.937 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-08-12T08:04:39.524 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-08-12T08:04:39.725 INFO:teuthology.kill:Killing Pids: {6221}
2021-08-12T08:04:40.864 INFO:teuthology.kill:Nuking machines: ['smithi150', 'smithi166']
2021-08-12T08:04:41.859 INFO:teuthology.kill:2021-08-12 08:04:41,859.859 INFO:teuthology.nuke:targets:
2021-08-12T08:04:41.860 INFO:teuthology.kill:  smithi150.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHgMt9FSetrX8mlIixqxDXKLI4UCWjn8sLLorTQXJKO2fvCrA9Qpz+fVMI7ghmoLULSS834kalsz4slbKA/861c7E6mjeCUNmwTm59s7RvKJwKsH7oZ+/WwPugzan+V8I1ZK3tYDc052STjlhko2D/o0cE48dDpgMU9YTXrP71iGKA+YqzEsWY/FAoHMMJI1IwRurCwtJe9ahTOAKWxJZyIqj+i0rw3A85BoBpWyaMKYn/Bg+I/Asywnf1zVKBm+ufxbrevaFPyklcGRm+R42z+XI5bwiHMzUnR0/liQhsPVPz4HcYjaUnPXJiKT6UQYUSbfXVYVonWYFXN1xK7K+uQSJceG0+OE7wU7y4cVolK1zON4Agvm8VXpRAIt8mFM50CswYYGvtiH8RG0wivvyydZ46G1RcSChkImMS8zl2cUkF8GreASfxwMNgdfSdVuRNy1VCIBB8r9Ul3SJ5FxTY0jqxYwt+qjMe+LamNHHZlKH1/q6dDGYAY15Wtz5d168=
2021-08-12T08:04:41.860 INFO:teuthology.kill:  smithi166.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZ8ZSEyoCPeRK5S9Y4z4elEYN+a0JbMB9R1QR5RJzhQt5vasLxhvWpI0T5tqaeYHYmSH36epC2Qn1r1MS7cudcI1pcK6nmdT/2545o1zWEBeIPF069gwRo8sB5d7ltebBofyNdrQcfaD6hBvjesTeNtALH6RAIv/RSkrhNSrrFwgeoSxXZv5i/8YGrNSVKq9yAxdHQv2uCVCHcZW1lBVFwsNDlQl2u/gA2pbVbNaNZ7gwsGd7zaeSmVny2IIsxsNvziCgQZwarC+kDqFpcXP56TCoDc2Wty5Ry82N+WDz8vnFcX+fZisY0enqSpYUHjNEGXILAHGrXEbUbIST3O8gn0KDj2WfFNG9gk9Mm7Y6ecJHiSFGU9oCFMexoUSIsjlz6JsdRtYNFcRT01w7vXRBghJx31SZ3r13G7UfaTTxbklcTUGI+iAGzMrOYY7P/Af2OyPOIiPZENuCI5ZY6dVqyF3aBtWOUn1YhJQ7nR1v0fL1IyuoDivJD13LmAwmYOzE=
2021-08-12T08:04:41.861 INFO:teuthology.kill:2021-08-12 08:04:41,859.859 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-12T08:04:41.862 INFO:teuthology.kill:2021-08-12 08:04:41,862.862 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-12T08:04:41.947 INFO:teuthology.kill:2021-08-12 08:04:41,946.946 INFO:teuthology.orchestra.console:Power off smithi150
2021-08-12T08:04:41.965 INFO:teuthology.kill:2021-08-12 08:04:41,964.964 INFO:teuthology.orchestra.console:Power off smithi166
2021-08-12T08:04:50.335 INFO:teuthology.kill:2021-08-12 08:04:50,334.334 INFO:teuthology.orchestra.console:Power off for smithi166 completed
2021-08-12T08:04:54.439 INFO:teuthology.kill:2021-08-12 08:04:54,439.439 INFO:teuthology.orchestra.console:Power off for smithi150 completed
2021-08-12T08:04:54.688 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-08-12T08:04:54.689 INFO:teuthology.task.internal:roles: ubuntu@smithi166.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-08-12T08:04:54.689 INFO:teuthology.misc:Compressing logs...
2021-08-12T08:04:54.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-12T08:05:29.163 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-08-12T08:05:29.223 INFO:teuthology.kill:No teuthology processes running
2021-08-12T08:05:30.382 INFO:teuthology.kill:Nuking machines: ['smithi150', 'smithi166']
2021-08-12T08:05:31.380 INFO:teuthology.kill:2021-08-12 08:05:31,380.380 INFO:teuthology.nuke:targets:
2021-08-12T08:05:31.381 INFO:teuthology.kill:  smithi150.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHgMt9FSetrX8mlIixqxDXKLI4UCWjn8sLLorTQXJKO2fvCrA9Qpz+fVMI7ghmoLULSS834kalsz4slbKA/861c7E6mjeCUNmwTm59s7RvKJwKsH7oZ+/WwPugzan+V8I1ZK3tYDc052STjlhko2D/o0cE48dDpgMU9YTXrP71iGKA+YqzEsWY/FAoHMMJI1IwRurCwtJe9ahTOAKWxJZyIqj+i0rw3A85BoBpWyaMKYn/Bg+I/Asywnf1zVKBm+ufxbrevaFPyklcGRm+R42z+XI5bwiHMzUnR0/liQhsPVPz4HcYjaUnPXJiKT6UQYUSbfXVYVonWYFXN1xK7K+uQSJceG0+OE7wU7y4cVolK1zON4Agvm8VXpRAIt8mFM50CswYYGvtiH8RG0wivvyydZ46G1RcSChkImMS8zl2cUkF8GreASfxwMNgdfSdVuRNy1VCIBB8r9Ul3SJ5FxTY0jqxYwt+qjMe+LamNHHZlKH1/q6dDGYAY15Wtz5d168=
2021-08-12T08:05:31.382 INFO:teuthology.kill:  smithi166.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZ8ZSEyoCPeRK5S9Y4z4elEYN+a0JbMB9R1QR5RJzhQt5vasLxhvWpI0T5tqaeYHYmSH36epC2Qn1r1MS7cudcI1pcK6nmdT/2545o1zWEBeIPF069gwRo8sB5d7ltebBofyNdrQcfaD6hBvjesTeNtALH6RAIv/RSkrhNSrrFwgeoSxXZv5i/8YGrNSVKq9yAxdHQv2uCVCHcZW1lBVFwsNDlQl2u/gA2pbVbNaNZ7gwsGd7zaeSmVny2IIsxsNvziCgQZwarC+kDqFpcXP56TCoDc2Wty5Ry82N+WDz8vnFcX+fZisY0enqSpYUHjNEGXILAHGrXEbUbIST3O8gn0KDj2WfFNG9gk9Mm7Y6ecJHiSFGU9oCFMexoUSIsjlz6JsdRtYNFcRT01w7vXRBghJx31SZ3r13G7UfaTTxbklcTUGI+iAGzMrOYY7P/Af2OyPOIiPZENuCI5ZY6dVqyF3aBtWOUn1YhJQ7nR1v0fL1IyuoDivJD13LmAwmYOzE=
2021-08-12T08:05:31.402 INFO:teuthology.kill:2021-08-12 08:05:31,402.402 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-12T08:05:31.406 INFO:teuthology.kill:2021-08-12 08:05:31,406.406 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-12T08:05:31.468 INFO:teuthology.kill:2021-08-12 08:05:31,468.468 INFO:teuthology.orchestra.console:Power off smithi166
2021-08-12T08:05:31.481 INFO:teuthology.kill:2021-08-12 08:05:31,481.481 INFO:teuthology.orchestra.console:Power off smithi150
2021-08-12T08:05:31.614 INFO:teuthology.kill:2021-08-12 08:05:31,613.613 INFO:teuthology.orchestra.console:Power off for smithi166 completed
2021-08-12T08:05:31.625 INFO:teuthology.kill:2021-08-12 08:05:31,625.625 INFO:teuthology.orchestra.console:Power off for smithi150 completed
2021-08-12T08:05:31.767 INFO:teuthology.kill:2021-08-12 08:05:31,766.766 INFO:teuthology.lock.ops:unlocked smithi166.front.sepia.ceph.com
2021-08-12T08:05:31.768 INFO:teuthology.kill:2021-08-12 08:05:31,768.768 INFO:teuthology.lock.ops:unlocked smithi150.front.sepia.ceph.com
2021-08-12T08:07:32.088 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-08-12T08:07:32.176 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-08-12T08:07:32.177 INFO:teuthology.nuke:Checking targets against current locks
2021-08-12T08:07:32.263 INFO:teuthology.nuke:Not nuking smithi150.front.sepia.ceph.com because description doesn't match
2021-08-12T08:07:32.263 INFO:teuthology.nuke:Not nuking smithi166.front.sepia.ceph.com because description doesn't match