2021-08-25T07:07:56.813 INFO:root:teuthology version: 1.1.0-d0ccb5e7
2021-08-25T07:07:56.928 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging
2021-08-25T07:07:56.930 INFO:teuthology.lock.ops:Updating [ubuntu@smithi136.front.sepia.ceph.com]: reset os type and version on server
2021-08-25T07:07:56.930 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2021-08-25T07:07:56.947 INFO:teuthology.lock.ops:Node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging is complete
2021-08-25T07:07:56.948 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi137.front.sepia.ceph.com' reimaging
2021-08-25T07:07:56.949 INFO:teuthology.lock.ops:Updating [ubuntu@smithi137.front.sepia.ceph.com]: reset os type and version on server
2021-08-25T07:07:56.950 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2021-08-25T07:07:56.968 INFO:teuthology.lock.ops:Node 'ubuntu@smithi137.front.sepia.ceph.com' reimaging is complete
2021-08-25T07:07:57.163 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 8.3
2021-08-25T07:07:57.167 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of centos 8.3
2021-08-25T07:07:57.468 INFO:teuthology.orchestra.console:Power off smithi136
2021-08-25T07:07:57.482 INFO:teuthology.orchestra.console:Power off smithi137
2021-08-25T07:08:05.844 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2021-08-25T07:08:05.945 INFO:teuthology.orchestra.console:Power on smithi137
2021-08-25T07:08:09.948 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2021-08-25T07:08:10.050 INFO:teuthology.orchestra.console:Power on smithi136
2021-08-25T07:08:14.312 INFO:teuthology.orchestra.console:Power on for smithi136 completed
2021-08-25T07:08:14.317 INFO:teuthology.orchestra.console:Power on for smithi137 completed
2021-08-25T07:08:14.414 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2021-08-25T07:08:14.418 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish
2021-08-25T07:12:46.282 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-25T07:12:46.598 INFO:teuthology.provision.fog.smithi137:Node is ready
2021-08-25T07:12:46.614 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com
2021-08-25T07:12:46.671 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137
2021-08-25T07:12:47.005 INFO:teuthology.provision.fog.smithi137:Deploy complete!
2021-08-25T07:12:55.404 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-25T07:12:55.670 INFO:teuthology.provision.fog.smithi136:Node is ready
2021-08-25T07:12:55.726 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2021-08-25T07:12:55.781 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2021-08-25T07:12:56.107 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2021-08-25T07:12:56.252 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2021-08-25T07:12:56.253 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-25T07:12:56.270 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com
2021-08-25T07:12:56.270 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-25T07:12:56.286 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2021-08-25T07:12:56.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-25T07:12:56.539 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2021-08-25T07:12:56.593 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Linux"
2021-08-25T07:12:56.594 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8"
2021-08-25T07:12:56.594 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos"
2021-08-25T07:12:56.594 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora"
2021-08-25T07:12:56.594 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8"
2021-08-25T07:12:56.595 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8"
2021-08-25T07:12:56.595 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Linux 8"
2021-08-25T07:12:56.595 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2021-08-25T07:12:56.595 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-08-25T07:12:56.596 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/"
2021-08-25T07:12:56.596 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-08-25T07:12:56.596 INFO:teuthology.orchestra.run.smithi136.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-08-25T07:12:56.596 INFO:teuthology.orchestra.run.smithi136.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-08-25T07:12:56.597 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2021-08-25T07:12:56.616 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server
2021-08-25T07:12:56.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-25T07:12:56.892 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64
2021-08-25T07:12:56.951 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Linux"
2021-08-25T07:12:56.951 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8"
2021-08-25T07:12:56.951 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos"
2021-08-25T07:12:56.951 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora"
2021-08-25T07:12:56.952 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8"
2021-08-25T07:12:56.952 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8"
2021-08-25T07:12:56.952 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Linux 8"
2021-08-25T07:12:56.953 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31"
2021-08-25T07:12:56.953 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-08-25T07:12:56.953 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/"
2021-08-25T07:12:56.953 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-08-25T07:12:56.954 INFO:teuthology.orchestra.run.smithi137.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-08-25T07:12:56.954 INFO:teuthology.orchestra.run.smithi137.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-08-25T07:12:56.955 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2021-08-25T07:12:57.090 INFO:teuthology.dispatcher.supervisor:Running job 6357427
2021-08-25T07:12:57.090 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-08-24_21:46:09-rados-wip-yuri6-testing-2021-08-24-1249-distro-basic-smithi/6357427 --name yuriw-2021-08-24_21:46:09-rados-wip-yuri6-testing-2021-08-24-1249-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} -- /home/teuthworker/archive/yuriw-2021-08-24_21:46:09-rados-wip-yuri6-testing-2021-08-24-1249-distro-basic-smithi/6357427/orig.config.yaml
2021-08-25T07:12:57.094 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-08-24_21:46:09-rados-wip-yuri6-testing-2021-08-24-1249-distro-basic-smithi/6357427
2021-08-25T07:12:57.095 INFO:teuthology.dispatcher.supervisor:Job PID: 18510
2021-08-25T07:12:57.095 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-08-25T19:13:48.515 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-08-25T19:13:48.726 INFO:teuthology.kill:Killing Pids: {18510}
2021-08-25T19:13:49.948 INFO:teuthology.kill:Nuking machines: ['smithi136', 'smithi137']
2021-08-25T19:13:50.994 INFO:teuthology.kill:2021-08-25 19:13:50,994.994 INFO:teuthology.nuke:targets:
2021-08-25T19:13:50.995 INFO:teuthology.kill:  smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdaSE9wEsAbNw3qr6rXYMOKVTLyXrjcwJ4shZxfOXH/HkuJ/r+L4ywk0Cxex3/OoPxhHmyp5sMYFClmxXIrkQS0JN2AaP+21AQHPfgHzK74hIagpZ6lipQ/GDXoQWoqfWJ+PRtrcDQNX5kgBSswfzfMYKL31BLNERdIyOqSOQci9GQEQwYDrbvlS+Mwxqh2Yb2aJKDpbJHeDrT0r0ywgwzWLqQmi4Nwh67bTPziMbyIw6GmsAl3OjQ7PbSvaNnTzFX+OMW80BtGIaRVQtaW6XnZLfZquqTGh95I8rRzSLowYXNjr1s2547CCVxgrKtgSwky6iz6jH+yZeKSd5z13ZlGYak96x8J3G9DRoNGo7wFg413TOp0rhS9hcSNcx1X2mbjuUCitMtzOp04/d4uCvSOD2+bPr/axDzaul6Q+pl2r6CVy6/cUbEP8Iz/YaLqJJdsjiq/ygWpW1cBfK6oBzuZPn0g8NuZ0SOP9sbesljVDlOXvhaTxbTzNfBobaetq8=
2021-08-25T19:13:50.996 INFO:teuthology.kill:  smithi137.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVuJ2aQefgbg3tRZRJCxfWiIvk5w2rCqhVr2y48Ta/itv0rFZSCRYSuX8VZ8d3kTHZEfMIULzfXdm0z4XEg5twM4P12cP4qm8qtJ9TGfLuHIIzN/q8wzbJx4PuF5ImZY7Zmr4KmEduo6x2v7jhrvgST3Ddf5SLXSQy31t10B9ZGLFFsbNBdi1j/JyrcWju0oQPLZD3/3MdMujKWH6taMXiGfGrjaw7Vxw1moZeplF8rCUY9oc0XWi3XOl9Ggd1dQoU5tklSx678NhLLEBkWVmTXbH7iIdLqLqA20NsIBIf/3G2DehM1mD/NW9o+bXxMbpBzaxjg4FszO5OJWYlh/GiH9s4PPVnRknOA8//gdxk4Uan/QRvIhzr5HeKdU0h/3ormTO50hNpLC52yGlPN6W32ExjaQOgvq5OK+hErSP1dhFA2ueyulchA5DnYA36zs59dHdOIvw+rDIOfo8Zlb0mmUFfCrM8DKF6Jk0qbP2gG6YS98xQcDjCUWe3dN10fh8=
2021-08-25T19:13:50.996 INFO:teuthology.kill:2021-08-25 19:13:50,994.994 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-25T19:13:50.997 INFO:teuthology.kill:2021-08-25 19:13:50,997.997 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-25T19:13:51.063 INFO:teuthology.kill:2021-08-25 19:13:51,063.063 INFO:teuthology.orchestra.console:Power off smithi136
2021-08-25T19:13:51.083 INFO:teuthology.kill:2021-08-25 19:13:51,083.083 INFO:teuthology.orchestra.console:Power off smithi137
2021-08-25T19:13:59.445 INFO:teuthology.kill:2021-08-25 19:13:59,444.444 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2021-08-25T19:14:03.568 INFO:teuthology.kill:2021-08-25 19:14:03,567.567 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2021-08-25T19:14:03.792 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-08-25T19:14:03.793 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-08-25T19:14:03.794 INFO:teuthology.misc:Compressing logs...
2021-08-25T19:14:03.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-25T19:15:03.861 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_d0ccb5e7543966c9868cca0e1d0b1e1f5b5df280/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-08-25T19:15:03.938 INFO:teuthology.kill:No teuthology processes running
2021-08-25T19:15:05.332 INFO:teuthology.kill:Nuking machines: ['smithi136', 'smithi137']
2021-08-25T19:15:06.475 INFO:teuthology.kill:2021-08-25 19:15:06,474.474 INFO:teuthology.nuke:targets:
2021-08-25T19:15:06.476 INFO:teuthology.kill:  smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdaSE9wEsAbNw3qr6rXYMOKVTLyXrjcwJ4shZxfOXH/HkuJ/r+L4ywk0Cxex3/OoPxhHmyp5sMYFClmxXIrkQS0JN2AaP+21AQHPfgHzK74hIagpZ6lipQ/GDXoQWoqfWJ+PRtrcDQNX5kgBSswfzfMYKL31BLNERdIyOqSOQci9GQEQwYDrbvlS+Mwxqh2Yb2aJKDpbJHeDrT0r0ywgwzWLqQmi4Nwh67bTPziMbyIw6GmsAl3OjQ7PbSvaNnTzFX+OMW80BtGIaRVQtaW6XnZLfZquqTGh95I8rRzSLowYXNjr1s2547CCVxgrKtgSwky6iz6jH+yZeKSd5z13ZlGYak96x8J3G9DRoNGo7wFg413TOp0rhS9hcSNcx1X2mbjuUCitMtzOp04/d4uCvSOD2+bPr/axDzaul6Q+pl2r6CVy6/cUbEP8Iz/YaLqJJdsjiq/ygWpW1cBfK6oBzuZPn0g8NuZ0SOP9sbesljVDlOXvhaTxbTzNfBobaetq8=
2021-08-25T19:15:06.476 INFO:teuthology.kill:  smithi137.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVuJ2aQefgbg3tRZRJCxfWiIvk5w2rCqhVr2y48Ta/itv0rFZSCRYSuX8VZ8d3kTHZEfMIULzfXdm0z4XEg5twM4P12cP4qm8qtJ9TGfLuHIIzN/q8wzbJx4PuF5ImZY7Zmr4KmEduo6x2v7jhrvgST3Ddf5SLXSQy31t10B9ZGLFFsbNBdi1j/JyrcWju0oQPLZD3/3MdMujKWH6taMXiGfGrjaw7Vxw1moZeplF8rCUY9oc0XWi3XOl9Ggd1dQoU5tklSx678NhLLEBkWVmTXbH7iIdLqLqA20NsIBIf/3G2DehM1mD/NW9o+bXxMbpBzaxjg4FszO5OJWYlh/GiH9s4PPVnRknOA8//gdxk4Uan/QRvIhzr5HeKdU0h/3ormTO50hNpLC52yGlPN6W32ExjaQOgvq5OK+hErSP1dhFA2ueyulchA5DnYA36zs59dHdOIvw+rDIOfo8Zlb0mmUFfCrM8DKF6Jk0qbP2gG6YS98xQcDjCUWe3dN10fh8=
2021-08-25T19:15:06.498 INFO:teuthology.kill:2021-08-25 19:15:06,497.497 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-25T19:15:06.503 INFO:teuthology.kill:2021-08-25 19:15:06,503.503 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-25T19:15:06.563 INFO:teuthology.kill:2021-08-25 19:15:06,563.563 INFO:teuthology.orchestra.console:Power off smithi136
2021-08-25T19:15:06.578 INFO:teuthology.kill:2021-08-25 19:15:06,577.577 INFO:teuthology.orchestra.console:Power off smithi137
2021-08-25T19:15:06.719 INFO:teuthology.kill:2021-08-25 19:15:06,718.718 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2021-08-25T19:15:06.726 INFO:teuthology.kill:2021-08-25 19:15:06,726.726 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2021-08-25T19:15:06.861 INFO:teuthology.kill:2021-08-25 19:15:06,861.861 INFO:teuthology.lock.ops:unlocked smithi136.front.sepia.ceph.com
2021-08-25T19:15:06.870 INFO:teuthology.kill:2021-08-25 19:15:06,870.870 ERROR:teuthology.lock.ops:failed to unlock smithi137.front.sepia.ceph.com. reason: 500
2021-08-25T19:17:07.151 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-08-25T19:17:07.243 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-08-25T19:17:07.244 INFO:teuthology.nuke:Checking targets against current locks
2021-08-25T19:17:07.337 INFO:teuthology.nuke:Not nuking smithi136.front.sepia.ceph.com because description doesn't match
2021-08-25T19:17:07.355 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-25T19:17:07.413 INFO:teuthology.orchestra.console:Power off smithi137
2021-08-25T19:17:07.560 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2021-08-25T19:17:07.705 INFO:teuthology.lock.ops:unlocked smithi137.front.sepia.ceph.com