2021-08-04T10:33:11.589 INFO:root:teuthology version: 1.1.0-04c2febe
2021-08-04T10:33:11.695 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi115.front.sepia.ceph.com' reimaging
2021-08-04T10:33:11.696 INFO:teuthology.lock.ops:Updating [ubuntu@smithi115.front.sepia.ceph.com]: reset os type and version on server
2021-08-04T10:33:11.697 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2021-08-04T10:33:11.713 INFO:teuthology.lock.ops:Node 'ubuntu@smithi115.front.sepia.ceph.com' reimaging is complete
2021-08-04T10:33:11.714 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging
2021-08-04T10:33:11.714 INFO:teuthology.lock.ops:Updating [ubuntu@smithi197.front.sepia.ceph.com]: reset os type and version on server
2021-08-04T10:33:11.714 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2021-08-04T10:33:11.730 INFO:teuthology.lock.ops:Node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging is complete
2021-08-04T10:33:11.929 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 8.2
2021-08-04T10:33:11.936 INFO:teuthology.provision.fog.smithi197:Scheduling deploy of centos 8.2
2021-08-04T10:33:12.283 INFO:teuthology.orchestra.console:Power off smithi197
2021-08-04T10:33:12.297 INFO:teuthology.orchestra.console:Power off smithi115
2021-08-04T10:33:20.654 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2021-08-04T10:33:20.755 INFO:teuthology.orchestra.console:Power on smithi197
2021-08-04T10:33:24.771 INFO:teuthology.orchestra.console:Power off for smithi115 completed
2021-08-04T10:33:24.873 INFO:teuthology.orchestra.console:Power on smithi115
2021-08-04T10:33:29.117 INFO:teuthology.orchestra.console:Power on for smithi197 completed
2021-08-04T10:33:29.124 INFO:teuthology.orchestra.console:Power on for smithi115 completed
2021-08-04T10:33:29.219 INFO:teuthology.provision.fog.smithi197:Waiting for deploy to finish
2021-08-04T10:33:29.225 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish
2021-08-04T10:36:00.822 ERROR:teuthology.orchestra.connection:Error authenticating with smithi197.front.sepia.ceph.com: Authentication failed.
2021-08-04T10:38:14.135 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-04T10:38:14.474 INFO:teuthology.provision.fog.smithi197:Node is ready
2021-08-04T10:38:14.490 INFO:teuthology.orchestra.run.smithi197.stdout:smithi197.front.sepia.ceph.com
2021-08-04T10:38:14.546 INFO:teuthology.orchestra.run.smithi197.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197
2021-08-04T10:38:14.882 INFO:teuthology.provision.fog.smithi197:Deploy complete!
2021-08-04T10:38:16.496 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-04T10:38:16.787 INFO:teuthology.provision.fog.smithi115:Node is ready
2021-08-04T10:38:16.802 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com
2021-08-04T10:38:16.858 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115
2021-08-04T10:38:17.174 INFO:teuthology.provision.fog.smithi115:Deploy complete!
2021-08-04T10:38:17.312 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com
2021-08-04T10:38:17.313 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-04T10:38:17.330 INFO:teuthology.lock.ops:Checking smithi197.front.sepia.ceph.com
2021-08-04T10:38:17.331 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-04T10:38:17.347 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server
2021-08-04T10:38:17.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-04T10:38:17.615 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64
2021-08-04T10:38:17.669 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Linux"
2021-08-04T10:38:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8 (Core)"
2021-08-04T10:38:17.670 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2021-08-04T10:38:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2021-08-04T10:38:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8"
2021-08-04T10:38:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8"
2021-08-04T10:38:17.671 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-08-04T10:38:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2021-08-04T10:38:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-08-04T10:38:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.centos.org/"
2021-08-04T10:38:17.672 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-08-04T10:38:17.673 INFO:teuthology.orchestra.run.smithi115.stdout:
2021-08-04T10:38:17.673 INFO:teuthology.orchestra.run.smithi115.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-08-04T10:38:17.673 INFO:teuthology.orchestra.run.smithi115.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-08-04T10:38:17.673 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-08-04T10:38:17.673 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-08-04T10:38:17.674 INFO:teuthology.orchestra.run.smithi115.stdout:
2021-08-04T10:38:17.675 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2021-08-04T10:38:17.693 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: set os type and version on server
2021-08-04T10:38:17.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-04T10:38:17.963 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64
2021-08-04T10:38:18.018 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="CentOS Linux"
2021-08-04T10:38:18.018 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="8 (Core)"
2021-08-04T10:38:18.018 INFO:teuthology.orchestra.run.smithi197.stdout:ID="centos"
2021-08-04T10:38:18.019 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE="rhel fedora"
2021-08-04T10:38:18.019 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="8"
2021-08-04T10:38:18.019 INFO:teuthology.orchestra.run.smithi197.stdout:PLATFORM_ID="platform:el8"
2021-08-04T10:38:18.019 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="CentOS Linux 8 (Core)"
2021-08-04T10:38:18.019 INFO:teuthology.orchestra.run.smithi197.stdout:ANSI_COLOR="0;31"
2021-08-04T10:38:18.020 INFO:teuthology.orchestra.run.smithi197.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-08-04T10:38:18.020 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://www.centos.org/"
2021-08-04T10:38:18.020 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-08-04T10:38:18.020 INFO:teuthology.orchestra.run.smithi197.stdout:
2021-08-04T10:38:18.021 INFO:teuthology.orchestra.run.smithi197.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-08-04T10:38:18.021 INFO:teuthology.orchestra.run.smithi197.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-08-04T10:38:18.021 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT="centos"
2021-08-04T10:38:18.021 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8"
2021-08-04T10:38:18.021 INFO:teuthology.orchestra.run.smithi197.stdout:
2021-08-04T10:38:18.022 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2021-08-04T10:38:18.098 INFO:teuthology.dispatcher.supervisor:Running job 6310694
2021-08-04T10:38:18.099 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_04c2febe7099917d97a71271f17abb5710030132/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-08-04_06:12:22-rados-wip_gbenhano_ncbz-distro-basic-smithi/6310694 --name benhanokh-2021-08-04_06:12:22-rados-wip_gbenhano_ncbz-distro-basic-smithi --description rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} -- /home/teuthworker/archive/benhanokh-2021-08-04_06:12:22-rados-wip_gbenhano_ncbz-distro-basic-smithi/6310694/orig.config.yaml
2021-08-04T10:38:18.103 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-08-04_06:12:22-rados-wip_gbenhano_ncbz-distro-basic-smithi/6310694
2021-08-04T10:38:18.103 INFO:teuthology.dispatcher.supervisor:Job PID: 20544
2021-08-04T10:38:18.104 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-08-04T22:38:34.562 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-08-04T22:38:34.732 INFO:teuthology.kill:Killing Pids: {20544}
2021-08-04T22:38:35.786 INFO:teuthology.kill:Nuking machines: ['smithi115', 'smithi197']
2021-08-04T22:38:36.763 INFO:teuthology.kill:2021-08-04 22:38:36,762.762 INFO:teuthology.nuke:targets:
2021-08-04T22:38:36.764 INFO:teuthology.kill:  smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkz3rc1COT+N9b3tTsAAw0Lj+uiL1lU6eGM3THkTvNEnIwoBjXyVgUx/8w4Rnqo8Gxls3YtacZQsZ1l6VphtgnR9MBv152P8HTir0+SNHf3ZA3EW4lao1KIGTn3qUE5oeW17Y9g6MZjhEQFW19rHXzSil5Q7HFcDtSW2CShzexeA/nKOFVSoQ9S7WawvVJw1JeqEJJGEeeFy55gzkUVDpByWffANdo1/Nx9A7AdIyUsvRx74QTccRIheNtFK8+rbKrMtapaimsg3bSnNN1Eb+wCz02SjftKTNEhPD4+5ego79XbZwH1zKRlNwbbbZTeRGEzirQvlWp437ukt+Nn/BMizSYFekv1QC8/2Q+xZx8JBhmte2QkV30NDqv9aQDLTMd9ZBE3ix01+TwfYITG+hqyuY/Y58u1Dq/GB6ginXBxf8BXO+GuqhPD2EK8V6tVcImCUo54gd2QU5AfLSwhASSxHLTMaTpztq4ulLT9t7vl7cax/k0NROGkbN9uOL/uDM=
2021-08-04T22:38:36.764 INFO:teuthology.kill:  smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcN4w/9czP07LRiUdj5j0Az+1KjKMv1cOTMkoFw0f/IXiM/BMdl8J0q1KPlI2C0c97ZRAyZVfRduE0X5BufjqHkPOGNqAJQb/3E/XQGwCQEemqbsx7dwj1zl+O+LbX1Xj/S5GNKoEwRwYGzwf0ev22ajmze9xOjn7WwRlnfSRr/dwFaC9Eth7pkDzP9X9eFw9W5YguIHQ5Sq4zQIgROUEhxMQEuM11uXM0LbGGipVBsGbIbH6WBfg9/mEqiV0zwRzBHu8bs4/Hoqc1n/NScsX2DrDYTER+7v1TXBRUQJW+sX8BTPjRXDO2XeTLr7Sb2ojBMZpdbA/MNt7OpVHGigB4kjCf4xWXlMx2seCLpL36sFAdEGI7SHFyWzyprovpwYRXjOkNTIb2J9W9INhMpxWiQV+9BVu1PwqZWf+lC1A2SMK/4DnOAWRuy9ARYQCSADTDb1WeWOBXPFAGv4IdnoAJAF/6r/661VYPGKIkdN21p4aSoCEgCryGGRqDQz1eWPM=
2021-08-04T22:38:36.764 INFO:teuthology.kill:2021-08-04 22:38:36,763.763 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-04T22:38:36.765 INFO:teuthology.kill:2021-08-04 22:38:36,765.765 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-04T22:38:36.825 INFO:teuthology.kill:2021-08-04 22:38:36,824.824 INFO:teuthology.orchestra.console:Power off smithi115
2021-08-04T22:38:36.838 INFO:teuthology.kill:2021-08-04 22:38:36,838.838 INFO:teuthology.orchestra.console:Power off smithi197
2021-08-04T22:38:45.195 INFO:teuthology.kill:2021-08-04 22:38:45,195.195 INFO:teuthology.orchestra.console:Power off for smithi115 completed
2021-08-04T22:38:45.201 INFO:teuthology.kill:2021-08-04 22:38:45,201.201 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2021-08-04T22:38:45.403 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a']
2021-08-04T22:38:45.404 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
2021-08-04T22:38:45.404 INFO:teuthology.misc:Compressing logs...
2021-08-04T22:38:45.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-04T22:39:45.409 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_04c2febe7099917d97a71271f17abb5710030132/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_04c2febe7099917d97a71271f17abb5710030132/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_04c2febe7099917d97a71271f17abb5710030132/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_04c2febe7099917d97a71271f17abb5710030132/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_04c2febe7099917d97a71271f17abb5710030132/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_04c2febe7099917d97a71271f17abb5710030132/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_04c2febe7099917d97a71271f17abb5710030132/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-08-04T22:39:45.459 INFO:teuthology.kill:No teuthology processes running
2021-08-04T22:39:46.503 INFO:teuthology.kill:Nuking machines: ['smithi115', 'smithi197']
2021-08-04T22:39:47.387 INFO:teuthology.kill:2021-08-04 22:39:47,387.387 INFO:teuthology.nuke:targets:
2021-08-04T22:39:47.388 INFO:teuthology.kill:  smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkz3rc1COT+N9b3tTsAAw0Lj+uiL1lU6eGM3THkTvNEnIwoBjXyVgUx/8w4Rnqo8Gxls3YtacZQsZ1l6VphtgnR9MBv152P8HTir0+SNHf3ZA3EW4lao1KIGTn3qUE5oeW17Y9g6MZjhEQFW19rHXzSil5Q7HFcDtSW2CShzexeA/nKOFVSoQ9S7WawvVJw1JeqEJJGEeeFy55gzkUVDpByWffANdo1/Nx9A7AdIyUsvRx74QTccRIheNtFK8+rbKrMtapaimsg3bSnNN1Eb+wCz02SjftKTNEhPD4+5ego79XbZwH1zKRlNwbbbZTeRGEzirQvlWp437ukt+Nn/BMizSYFekv1QC8/2Q+xZx8JBhmte2QkV30NDqv9aQDLTMd9ZBE3ix01+TwfYITG+hqyuY/Y58u1Dq/GB6ginXBxf8BXO+GuqhPD2EK8V6tVcImCUo54gd2QU5AfLSwhASSxHLTMaTpztq4ulLT9t7vl7cax/k0NROGkbN9uOL/uDM=
2021-08-04T22:39:47.388 INFO:teuthology.kill:  smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcN4w/9czP07LRiUdj5j0Az+1KjKMv1cOTMkoFw0f/IXiM/BMdl8J0q1KPlI2C0c97ZRAyZVfRduE0X5BufjqHkPOGNqAJQb/3E/XQGwCQEemqbsx7dwj1zl+O+LbX1Xj/S5GNKoEwRwYGzwf0ev22ajmze9xOjn7WwRlnfSRr/dwFaC9Eth7pkDzP9X9eFw9W5YguIHQ5Sq4zQIgROUEhxMQEuM11uXM0LbGGipVBsGbIbH6WBfg9/mEqiV0zwRzBHu8bs4/Hoqc1n/NScsX2DrDYTER+7v1TXBRUQJW+sX8BTPjRXDO2XeTLr7Sb2ojBMZpdbA/MNt7OpVHGigB4kjCf4xWXlMx2seCLpL36sFAdEGI7SHFyWzyprovpwYRXjOkNTIb2J9W9INhMpxWiQV+9BVu1PwqZWf+lC1A2SMK/4DnOAWRuy9ARYQCSADTDb1WeWOBXPFAGv4IdnoAJAF/6r/661VYPGKIkdN21p4aSoCEgCryGGRqDQz1eWPM=
2021-08-04T22:39:47.410 INFO:teuthology.kill:2021-08-04 22:39:47,410.410 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-04T22:39:47.413 INFO:teuthology.kill:2021-08-04 22:39:47,412.412 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-08-04T22:39:47.467 INFO:teuthology.kill:2021-08-04 22:39:47,466.466 INFO:teuthology.orchestra.console:Power off smithi197
2021-08-04T22:39:47.488 INFO:teuthology.kill:2021-08-04 22:39:47,488.488 INFO:teuthology.orchestra.console:Power off smithi115
2021-08-04T22:39:47.619 INFO:teuthology.kill:2021-08-04 22:39:47,619.619 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2021-08-04T22:39:47.628 INFO:teuthology.kill:2021-08-04 22:39:47,628.628 INFO:teuthology.orchestra.console:Power off for smithi115 completed
2021-08-04T22:39:47.759 INFO:teuthology.kill:2021-08-04 22:39:47,758.758 INFO:teuthology.lock.ops:unlocked smithi197.front.sepia.ceph.com
2021-08-04T22:39:47.766 INFO:teuthology.kill:2021-08-04 22:39:47,766.766 INFO:teuthology.lock.ops:unlocked smithi115.front.sepia.ceph.com
2021-08-04T22:41:47.929 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15