2021-07-25T08:41:10.013 INFO:root:teuthology version: 1.1.0-b6f3efab
2021-07-25T08:41:10.125 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi037.front.sepia.ceph.com' reimaging
2021-07-25T08:41:10.126 INFO:teuthology.lock.ops:Updating [ubuntu@smithi037.front.sepia.ceph.com]: reset os type and version on server
2021-07-25T08:41:10.126 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2021-07-25T08:41:10.142 INFO:teuthology.lock.ops:Node 'ubuntu@smithi037.front.sepia.ceph.com' reimaging is complete
2021-07-25T08:41:10.142 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi098.front.sepia.ceph.com' reimaging
2021-07-25T08:41:10.143 INFO:teuthology.lock.ops:Updating [ubuntu@smithi098.front.sepia.ceph.com]: reset os type and version on server
2021-07-25T08:41:10.143 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2021-07-25T08:41:10.159 INFO:teuthology.lock.ops:Node 'ubuntu@smithi098.front.sepia.ceph.com' reimaging is complete
2021-07-25T08:41:10.352 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 8.2
2021-07-25T08:41:10.365 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 8.2
2021-07-25T08:41:10.729 INFO:teuthology.orchestra.console:Power off smithi037
2021-07-25T08:41:10.747 INFO:teuthology.orchestra.console:Power off smithi098
2021-07-25T08:41:19.115 INFO:teuthology.orchestra.console:Power off for smithi098 completed
2021-07-25T08:41:19.216 INFO:teuthology.orchestra.console:Power on smithi098
2021-07-25T08:41:23.220 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2021-07-25T08:41:23.322 INFO:teuthology.orchestra.console:Power on smithi037
2021-07-25T08:41:27.576 INFO:teuthology.orchestra.console:Power on for smithi037 completed
2021-07-25T08:41:27.603 INFO:teuthology.orchestra.console:Power on for smithi098 completed
2021-07-25T08:41:27.678 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish
2021-07-25T08:41:27.704 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish
2021-07-25T08:45:34.298 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-25T08:45:44.637 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-25T08:45:44.957 INFO:teuthology.provision.fog.smithi037:Node is ready
2021-07-25T08:45:44.972 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com
2021-07-25T08:45:45.027 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037
2021-07-25T08:45:45.359 INFO:teuthology.provision.fog.smithi037:Deploy complete!
2021-07-25T08:45:54.491 INFO:teuthology.provision.fog.smithi098:Node is ready
2021-07-25T08:45:54.512 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com
2021-07-25T08:45:54.568 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098
2021-07-25T08:45:54.921 INFO:teuthology.provision.fog.smithi098:Deploy complete!
2021-07-25T08:45:55.049 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com
2021-07-25T08:45:55.050 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-25T08:45:55.066 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com
2021-07-25T08:45:55.067 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-25T08:45:55.083 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server
2021-07-25T08:45:55.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-25T08:45:55.369 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64
2021-07-25T08:45:55.425 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Linux"
2021-07-25T08:45:55.425 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8 (Core)"
2021-07-25T08:45:55.426 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos"
2021-07-25T08:45:55.426 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora"
2021-07-25T08:45:55.426 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8"
2021-07-25T08:45:55.426 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8"
2021-07-25T08:45:55.427 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-07-25T08:45:55.427 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2021-07-25T08:45:55.427 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-07-25T08:45:55.427 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.centos.org/"
2021-07-25T08:45:55.427 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-07-25T08:45:55.428 INFO:teuthology.orchestra.run.smithi037.stdout:
2021-07-25T08:45:55.428 INFO:teuthology.orchestra.run.smithi037.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-07-25T08:45:55.428 INFO:teuthology.orchestra.run.smithi037.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-07-25T08:45:55.428 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-07-25T08:45:55.428 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-07-25T08:45:55.429 INFO:teuthology.orchestra.run.smithi037.stdout:
2021-07-25T08:45:55.430 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2021-07-25T08:45:55.450 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server
2021-07-25T08:45:55.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-25T08:45:55.719 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64
2021-07-25T08:45:55.775 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Linux"
2021-07-25T08:45:55.775 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8 (Core)"
2021-07-25T08:45:55.776 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2021-07-25T08:45:55.776 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2021-07-25T08:45:55.776 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8"
2021-07-25T08:45:55.776 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2021-07-25T08:45:55.776 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-07-25T08:45:55.777 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2021-07-25T08:45:55.777 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-07-25T08:45:55.777 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.centos.org/"
2021-07-25T08:45:55.777 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-07-25T08:45:55.778 INFO:teuthology.orchestra.run.smithi098.stdout:
2021-07-25T08:45:55.778 INFO:teuthology.orchestra.run.smithi098.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-07-25T08:45:55.778 INFO:teuthology.orchestra.run.smithi098.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-07-25T08:45:55.780 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-07-25T08:45:55.780 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-07-25T08:45:55.781 INFO:teuthology.orchestra.run.smithi098.stdout:
2021-07-25T08:45:55.781 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2021-07-25T08:45:55.863 INFO:teuthology.dispatcher.supervisor:Running job 6292305
2021-07-25T08:45:55.864 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-07-25_08:37:41-rados:cephadm:thrash-WIP_GBH_obj_scrubber2-distro-basic-smithi/6292305 --name benhanokh-2021-07-25_08:37:41-rados:cephadm:thrash-WIP_GBH_obj_scrubber2-distro-basic-smithi --description rados:cephadm:thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} -- /home/teuthworker/archive/benhanokh-2021-07-25_08:37:41-rados:cephadm:thrash-WIP_GBH_obj_scrubber2-distro-basic-smithi/6292305/orig.config.yaml
2021-07-25T08:45:55.867 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-07-25_08:37:41-rados:cephadm:thrash-WIP_GBH_obj_scrubber2-distro-basic-smithi/6292305
2021-07-25T08:45:55.868 INFO:teuthology.dispatcher.supervisor:Job PID: 32465
2021-07-25T08:45:55.868 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-07-25T20:46:39.743 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-07-25T20:46:39.936 INFO:teuthology.kill:Killing Pids: {32465}
2021-07-25T20:46:40.903 INFO:teuthology.kill:Nuking machines: ['smithi037', 'smithi098']
2021-07-25T20:46:41.713 INFO:teuthology.kill:2021-07-25 20:46:41,712.712 INFO:teuthology.nuke:targets:
2021-07-25T20:46:41.714 INFO:teuthology.kill:  smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfjNKW9wMO4klCxNb/tHiFq2KtfmzeAWgIKuhY9+isk+ffHJVc+pz4IEMFCvz8HU0WiUjyJ+MW6T6vUh/+4zOMcC/oi1uPzJvFTa0ehFlgFJYa5Fnzzrty07ZouMRF3eK7eNoZWwVf62JBSuVlW34x13jvs5w+U/8jJNyTmIIh/RSh6AMLA6q4ktKKJvmh87FxmYDGTGgRwJCjtKupn26rDPtg1l+hVxVEGuRLxmKx0yzqic5ujqz6LEsUBCK3DcgLN+HP1MMhSwsn0QUpa6i/DeJvlpKc935k7DdNPM2CVPjk5z+SeeSbUpjtaCsjh0KVprC5sUhXi3c7iThglAwXqESKPfSms6BY/rmqP52TxQnJkROpTdvwHdWDjnNZ3YASB43WNWgqSUoF31AMLQ3o2Z1O6UYTIOFf4z7ZPVmerZ+hG+K/moELWZwKkCwJ874CWv+knfAjkpf2ua5uPP7x7lpF25GvVlyMmxtHnraImxBACmzQY0pnKu8L9nFVFAU=
2021-07-25T20:46:41.714 INFO:teuthology.kill:  smithi098.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5oezm/qdCNJkMwFXsbNPflOoKGrnPGrDrw+BrF1nwtZ3CaUUEEuoIMbzwzHK+3shdbV0tMPvlxKnpkMfFTGoV/EG4uJLG1TBgAjM4FBggf4swMbMuVHfMVGCPQ74NWLhxwZ2/qNI/TkkPWHDcJnnGzhag7Z6AnlhQCsOwNBDicm13FDfMrDjVSOhKyCiyCx4qhdF1mpQhb/Ml9cFQbHwe0XT5S9wPk6XoEooWEiqcaFiKUoOGPCIehycK61iYpmtHANbbmdnpVPKWpogBUMdn/tnwpBb8qnnDV99L0IcvrAWkKSIdE0DXYblVSjMz5dMysPNouyi26QzmzKtHxvlCNxpZer8fEqOQ23Hu1HxEGWqLJgjZLBoL0yFlijfItjxpP227qZtcW+OX8IQdneLWZT0y6a+bgWfQh7OV02lKZQ+R2qFjC+5u3b71qe4p3GUroWp9SDequ34AFlZJSRCzxY1+gCgIYrVML8Z6MwYI5lkzRg/a5sp3Bq2WWv1Aba8=
2021-07-25T20:46:41.714 INFO:teuthology.kill:2021-07-25 20:46:41,713.713 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-25T20:46:41.715 INFO:teuthology.kill:2021-07-25 20:46:41,715.715 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-25T20:46:41.771 INFO:teuthology.kill:2021-07-25 20:46:41,771.771 INFO:teuthology.orchestra.console:Power off smithi037
2021-07-25T20:46:41.784 INFO:teuthology.kill:2021-07-25 20:46:41,783.783 INFO:teuthology.orchestra.console:Power off smithi098
2021-07-25T20:46:50.148 INFO:teuthology.kill:2021-07-25 20:46:50,147.147 INFO:teuthology.orchestra.console:Power off for smithi098 completed
2021-07-25T20:46:50.152 INFO:teuthology.kill:2021-07-25 20:46:50,152.152 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2021-07-25T20:46:50.381 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a']
2021-07-25T20:46:50.382 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
2021-07-25T20:46:50.382 INFO:teuthology.misc:Compressing logs...
2021-07-25T20:46:50.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-25T20:47:50.434 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-07-25T20:47:50.478 INFO:teuthology.kill:No teuthology processes running
2021-07-25T20:47:51.416 INFO:teuthology.kill:Nuking machines: ['smithi037', 'smithi098']
2021-07-25T20:47:52.219 INFO:teuthology.kill:2021-07-25 20:47:52,219.219 INFO:teuthology.nuke:targets:
2021-07-25T20:47:52.220 INFO:teuthology.kill:  smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfjNKW9wMO4klCxNb/tHiFq2KtfmzeAWgIKuhY9+isk+ffHJVc+pz4IEMFCvz8HU0WiUjyJ+MW6T6vUh/+4zOMcC/oi1uPzJvFTa0ehFlgFJYa5Fnzzrty07ZouMRF3eK7eNoZWwVf62JBSuVlW34x13jvs5w+U/8jJNyTmIIh/RSh6AMLA6q4ktKKJvmh87FxmYDGTGgRwJCjtKupn26rDPtg1l+hVxVEGuRLxmKx0yzqic5ujqz6LEsUBCK3DcgLN+HP1MMhSwsn0QUpa6i/DeJvlpKc935k7DdNPM2CVPjk5z+SeeSbUpjtaCsjh0KVprC5sUhXi3c7iThglAwXqESKPfSms6BY/rmqP52TxQnJkROpTdvwHdWDjnNZ3YASB43WNWgqSUoF31AMLQ3o2Z1O6UYTIOFf4z7ZPVmerZ+hG+K/moELWZwKkCwJ874CWv+knfAjkpf2ua5uPP7x7lpF25GvVlyMmxtHnraImxBACmzQY0pnKu8L9nFVFAU=
2021-07-25T20:47:52.221 INFO:teuthology.kill:  smithi098.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5oezm/qdCNJkMwFXsbNPflOoKGrnPGrDrw+BrF1nwtZ3CaUUEEuoIMbzwzHK+3shdbV0tMPvlxKnpkMfFTGoV/EG4uJLG1TBgAjM4FBggf4swMbMuVHfMVGCPQ74NWLhxwZ2/qNI/TkkPWHDcJnnGzhag7Z6AnlhQCsOwNBDicm13FDfMrDjVSOhKyCiyCx4qhdF1mpQhb/Ml9cFQbHwe0XT5S9wPk6XoEooWEiqcaFiKUoOGPCIehycK61iYpmtHANbbmdnpVPKWpogBUMdn/tnwpBb8qnnDV99L0IcvrAWkKSIdE0DXYblVSjMz5dMysPNouyi26QzmzKtHxvlCNxpZer8fEqOQ23Hu1HxEGWqLJgjZLBoL0yFlijfItjxpP227qZtcW+OX8IQdneLWZT0y6a+bgWfQh7OV02lKZQ+R2qFjC+5u3b71qe4p3GUroWp9SDequ34AFlZJSRCzxY1+gCgIYrVML8Z6MwYI5lkzRg/a5sp3Bq2WWv1Aba8=
2021-07-25T20:47:52.239 INFO:teuthology.kill:2021-07-25 20:47:52,239.239 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-25T20:47:52.241 INFO:teuthology.kill:2021-07-25 20:47:52,241.241 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-25T20:47:52.292 INFO:teuthology.kill:2021-07-25 20:47:52,292.292 INFO:teuthology.orchestra.console:Power off smithi037
2021-07-25T20:47:52.304 INFO:teuthology.kill:2021-07-25 20:47:52,303.303 INFO:teuthology.orchestra.console:Power off smithi098
2021-07-25T20:47:52.432 INFO:teuthology.kill:2021-07-25 20:47:52,432.432 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2021-07-25T20:47:52.441 INFO:teuthology.kill:2021-07-25 20:47:52,440.440 INFO:teuthology.orchestra.console:Power off for smithi098 completed
2021-07-25T20:47:52.570 INFO:teuthology.kill:2021-07-25 20:47:52,569.569 INFO:teuthology.lock.ops:unlocked smithi037.front.sepia.ceph.com
2021-07-25T20:47:52.576 INFO:teuthology.kill:2021-07-25 20:47:52,576.576 INFO:teuthology.lock.ops:unlocked smithi098.front.sepia.ceph.com
2021-07-25T20:49:52.750 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15