2021-05-01T06:18:04.205 INFO:root:teuthology version: 1.1.0-bea5b739
2021-05-01T06:18:04.306 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi013.front.sepia.ceph.com' reimaging
2021-05-01T06:18:04.307 INFO:teuthology.lock.ops:Updating [ubuntu@smithi013.front.sepia.ceph.com]: reset os type and version on server
2021-05-01T06:18:04.307 INFO:teuthology.lock.ops:Updating smithi013.front.sepia.ceph.com on lock server
2021-05-01T06:18:04.339 INFO:teuthology.lock.ops:Node 'ubuntu@smithi013.front.sepia.ceph.com' reimaging is complete
2021-05-01T06:18:04.340 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi058.front.sepia.ceph.com' reimaging
2021-05-01T06:18:04.340 INFO:teuthology.lock.ops:Updating [ubuntu@smithi058.front.sepia.ceph.com]: reset os type and version on server
2021-05-01T06:18:04.340 INFO:teuthology.lock.ops:Updating smithi058.front.sepia.ceph.com on lock server
2021-05-01T06:18:04.354 INFO:teuthology.lock.ops:Node 'ubuntu@smithi058.front.sepia.ceph.com' reimaging is complete
2021-05-01T06:18:04.563 INFO:teuthology.provision.fog.smithi013:Scheduling deploy of rhel 8.3
2021-05-01T06:18:04.566 INFO:teuthology.provision.fog.smithi058:Scheduling deploy of rhel 8.3
2021-05-01T06:18:04.990 INFO:teuthology.orchestra.console:Power off smithi013
2021-05-01T06:18:05.003 INFO:teuthology.orchestra.console:Power off smithi058
2021-05-01T06:18:13.362 INFO:teuthology.orchestra.console:Power off for smithi013 completed
2021-05-01T06:18:13.369 INFO:teuthology.orchestra.console:Power off for smithi058 completed
2021-05-01T06:18:13.463 INFO:teuthology.orchestra.console:Power on smithi013
2021-05-01T06:18:13.471 INFO:teuthology.orchestra.console:Power on smithi058
2021-05-01T06:18:21.832 INFO:teuthology.orchestra.console:Power on for smithi013 completed
2021-05-01T06:18:21.927 INFO:teuthology.orchestra.console:Power on for smithi058 completed
2021-05-01T06:18:21.933 INFO:teuthology.provision.fog.smithi013:Waiting for deploy to finish
2021-05-01T06:18:22.028 INFO:teuthology.provision.fog.smithi058:Waiting for deploy to finish
2021-05-01T06:22:29.780 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-01T06:22:29.784 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-01T06:22:30.087 INFO:teuthology.provision.fog.smithi013:Node is ready
2021-05-01T06:22:30.101 INFO:teuthology.orchestra.run.smithi013.stdout:smithi013.front.sepia.ceph.com
2021-05-01T06:22:30.157 INFO:teuthology.orchestra.run.smithi013.stdout:172.21.15.13 smithi013.front.sepia.ceph.com smithi013
2021-05-01T06:22:30.204 INFO:teuthology.provision.fog.smithi058:Node is ready
2021-05-01T06:22:30.219 INFO:teuthology.orchestra.run.smithi058.stdout:smithi058.front.sepia.ceph.com
2021-05-01T06:22:30.276 INFO:teuthology.orchestra.run.smithi058.stdout:172.21.15.58 smithi058.front.sepia.ceph.com smithi058
2021-05-01T06:22:30.493 INFO:teuthology.provision.fog.smithi013:Deploy complete!
2021-05-01T06:22:30.603 INFO:teuthology.provision.fog.smithi058:Deploy complete!
2021-05-01T06:22:30.746 INFO:teuthology.lock.ops:Checking smithi013.front.sepia.ceph.com
2021-05-01T06:22:30.747 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-01T06:22:30.763 INFO:teuthology.lock.ops:Checking smithi058.front.sepia.ceph.com
2021-05-01T06:22:30.763 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-01T06:22:30.777 INFO:teuthology.lock.ops:Updating [smithi013.front.sepia.ceph.com]: set os type and version on server
2021-05-01T06:22:30.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-01T06:22:31.064 INFO:teuthology.orchestra.run.smithi013.stdout:x86_64
2021-05-01T06:22:31.118 INFO:teuthology.orchestra.run.smithi013.stdout:NAME="Red Hat Enterprise Linux"
2021-05-01T06:22:31.118 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION="8.3 (Ootpa)"
2021-05-01T06:22:31.118 INFO:teuthology.orchestra.run.smithi013.stdout:ID="rhel"
2021-05-01T06:22:31.118 INFO:teuthology.orchestra.run.smithi013.stdout:ID_LIKE="fedora"
2021-05-01T06:22:31.118 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION_ID="8.3"
2021-05-01T06:22:31.119 INFO:teuthology.orchestra.run.smithi013.stdout:PLATFORM_ID="platform:el8"
2021-05-01T06:22:31.119 INFO:teuthology.orchestra.run.smithi013.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-05-01T06:22:31.119 INFO:teuthology.orchestra.run.smithi013.stdout:ANSI_COLOR="0;31"
2021-05-01T06:22:31.119 INFO:teuthology.orchestra.run.smithi013.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-05-01T06:22:31.119 INFO:teuthology.orchestra.run.smithi013.stdout:HOME_URL="https://www.redhat.com/"
2021-05-01T06:22:31.119 INFO:teuthology.orchestra.run.smithi013.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-05-01T06:22:31.119 INFO:teuthology.orchestra.run.smithi013.stdout:
2021-05-01T06:22:31.119 INFO:teuthology.orchestra.run.smithi013.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-05-01T06:22:31.119 INFO:teuthology.orchestra.run.smithi013.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-05-01T06:22:31.119 INFO:teuthology.orchestra.run.smithi013.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-05-01T06:22:31.119 INFO:teuthology.orchestra.run.smithi013.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-05-01T06:22:31.121 INFO:teuthology.lock.ops:Updating smithi013.front.sepia.ceph.com on lock server
2021-05-01T06:22:31.136 INFO:teuthology.lock.ops:Updating [smithi058.front.sepia.ceph.com]: set os type and version on server
2021-05-01T06:22:31.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-01T06:22:31.420 INFO:teuthology.orchestra.run.smithi058.stdout:x86_64
2021-05-01T06:22:31.474 INFO:teuthology.orchestra.run.smithi058.stdout:NAME="Red Hat Enterprise Linux"
2021-05-01T06:22:31.474 INFO:teuthology.orchestra.run.smithi058.stdout:VERSION="8.3 (Ootpa)"
2021-05-01T06:22:31.474 INFO:teuthology.orchestra.run.smithi058.stdout:ID="rhel"
2021-05-01T06:22:31.474 INFO:teuthology.orchestra.run.smithi058.stdout:ID_LIKE="fedora"
2021-05-01T06:22:31.474 INFO:teuthology.orchestra.run.smithi058.stdout:VERSION_ID="8.3"
2021-05-01T06:22:31.474 INFO:teuthology.orchestra.run.smithi058.stdout:PLATFORM_ID="platform:el8"
2021-05-01T06:22:31.474 INFO:teuthology.orchestra.run.smithi058.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-05-01T06:22:31.474 INFO:teuthology.orchestra.run.smithi058.stdout:ANSI_COLOR="0;31"
2021-05-01T06:22:31.475 INFO:teuthology.orchestra.run.smithi058.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-05-01T06:22:31.475 INFO:teuthology.orchestra.run.smithi058.stdout:HOME_URL="https://www.redhat.com/"
2021-05-01T06:22:31.475 INFO:teuthology.orchestra.run.smithi058.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-05-01T06:22:31.475 INFO:teuthology.orchestra.run.smithi058.stdout:
2021-05-01T06:22:31.475 INFO:teuthology.orchestra.run.smithi058.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-05-01T06:22:31.475 INFO:teuthology.orchestra.run.smithi058.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-05-01T06:22:31.475 INFO:teuthology.orchestra.run.smithi058.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-05-01T06:22:31.475 INFO:teuthology.orchestra.run.smithi058.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-05-01T06:22:31.476 INFO:teuthology.lock.ops:Updating smithi058.front.sepia.ceph.com on lock server
2021-05-01T06:22:31.561 INFO:teuthology.dispatcher.supervisor:Running job 6082239
2021-05-01T06:22:31.561 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_bea5b7399b9dcb9d756a32fdfc32f498319d425f/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-04-29_13:53:41-rados-benhanokh-NCB-distro-basic-smithi/6082239 --name benhanokh-2021-04-29_13:53:41-rados-benhanokh-NCB-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/dedup-io-snaps} -- /home/teuthworker/archive/benhanokh-2021-04-29_13:53:41-rados-benhanokh-NCB-distro-basic-smithi/6082239/orig.config.yaml
2021-05-01T06:22:31.564 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-04-29_13:53:41-rados-benhanokh-NCB-distro-basic-smithi/6082239
2021-05-01T06:22:31.565 INFO:teuthology.dispatcher.supervisor:Job PID: 25807
2021-05-01T06:22:31.565 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-05-01T18:23:20.648 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-05-01T18:23:20.878 INFO:teuthology.kill:Killing Pids: {25807}
2021-05-01T18:23:21.939 INFO:teuthology.kill:Nuking machines: ['smithi013', 'smithi058']
2021-05-01T18:23:22.854 INFO:teuthology.kill:2021-05-01 18:23:22,853.853 INFO:teuthology.nuke:targets:
2021-05-01T18:23:22.854 INFO:teuthology.kill:  smithi013.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqpO+IvLvYHhkNO3BtyN9QEPRvaG5GDv5fr2nI95LDPV9TBcjU7wtXdyS8Ic1tEUdVzU4zyyhY1XERMRNbTpSJ2qMiLDP7kEpjbTddnkyg++a7gB1Zn/QfvahIUPLVVePuhfBdA/wwnFjgeXQHfGghFjA29hM2v7ax3ZWrlanG0Kc/1DbGFq93ZYOxo6+FSXG/atUJfnCStNTr3dnyu7kSuZbojU6JG2EgoUjwDJMa4YY8rV+20Wy7AXeLsnV7K/Vej0CvVNOUPuE3wzyHFStXJ8x/Go/go2QgtIH8bZvQozxLUwq5u4xcItKSCmlqyHyzeypWhMdswC8krju7Bm3AuuaviA/QSXkL7ipCKUjtJge/+BraLxLU6uVW64SaB5E/WDDNsX7PHNmPN1mA2fVVVWq/lHNxo0Na6NoBadjOTg+o1dv/uwA7XDHWY3tWU+pm1ny9CCFELDgpbFI/v4O6X9L5YDG/N26YbZvLh8uuiJY0TQ1UDsHfCirPQVWqj/k=
2021-05-01T18:23:22.854 INFO:teuthology.kill:  smithi058.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzaI7f8KSYpSjDm4+kliM3EXWuhiNRXxguDntlwtFhYLVkyUfKqfBDxnkTYdMPoXRDFg65EEYj24lESbIgFXGs40kq3uqaJ5I4x+wzzI0Y4mK+/tv0xxyP061rmAGhGIm+xbZtgZfH1zfiuqmU+gVAVo6uzZrw6FZ1yb2OiQdvid6wTmLpTcYBP+Zt0PXMz8WsfBNfoRzFCyWtIMJoDoJ+Zt8m1GYJwZRkqr2rBgtgBkpO8qMtrYJEMUzpfdsei3aUhvBMOjoBTBha1e3lK6nfyrWJHvmKUN9AxpFx1C6S77VQ/2ifNWl2vP5V6RC9WW7BCkvWG0xZ3iHC8qfNNq4WWbey+g61DlVZh8af8jWMgQCMHq7MbG+3NrlmwdVYDwNIFLB6yaKzMExYy4/ERdE06KCKI4Ps2KklntoWqFgqWHKFjURCdggWDzucN0jexmLMOK47FuzXunuoMn/cYGMVchCu2U6Z0mEaHoHAAgJaKUgGtk6Dm8Zzkkx+5YzoekE=
2021-05-01T18:23:22.854 INFO:teuthology.kill:2021-05-01 18:23:22,854.854 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-01T18:23:22.856 INFO:teuthology.kill:2021-05-01 18:23:22,856.856 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-01T18:23:22.917 INFO:teuthology.kill:2021-05-01 18:23:22,916.916 INFO:teuthology.orchestra.console:Power off smithi013
2021-05-01T18:23:22.929 INFO:teuthology.kill:2021-05-01 18:23:22,928.928 INFO:teuthology.orchestra.console:Power off smithi058
2021-05-01T18:23:31.285 INFO:teuthology.kill:2021-05-01 18:23:31,285.285 INFO:teuthology.orchestra.console:Power off for smithi013 completed
2021-05-01T18:23:31.292 INFO:teuthology.kill:2021-05-01 18:23:31,292.292 INFO:teuthology.orchestra.console:Power off for smithi058 completed
2021-05-01T18:23:31.518 INFO:teuthology.task.internal:roles: ubuntu@smithi013.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-05-01T18:23:31.518 INFO:teuthology.task.internal:roles: ubuntu@smithi058.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-05-01T18:23:31.518 INFO:teuthology.misc:Compressing logs...
2021-05-01T18:23:31.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-01T18:24:31.579 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_bea5b7399b9dcb9d756a32fdfc32f498319d425f/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_bea5b7399b9dcb9d756a32fdfc32f498319d425f/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_bea5b7399b9dcb9d756a32fdfc32f498319d425f/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_bea5b7399b9dcb9d756a32fdfc32f498319d425f/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_bea5b7399b9dcb9d756a32fdfc32f498319d425f/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_bea5b7399b9dcb9d756a32fdfc32f498319d425f/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_bea5b7399b9dcb9d756a32fdfc32f498319d425f/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-05-01T18:24:31.643 INFO:teuthology.kill:No teuthology processes running
2021-05-01T18:24:32.749 INFO:teuthology.kill:Nuking machines: ['smithi013', 'smithi058']
2021-05-01T18:24:33.669 INFO:teuthology.kill:2021-05-01 18:24:33,669.669 INFO:teuthology.nuke:targets:
2021-05-01T18:24:33.670 INFO:teuthology.kill:  smithi013.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqpO+IvLvYHhkNO3BtyN9QEPRvaG5GDv5fr2nI95LDPV9TBcjU7wtXdyS8Ic1tEUdVzU4zyyhY1XERMRNbTpSJ2qMiLDP7kEpjbTddnkyg++a7gB1Zn/QfvahIUPLVVePuhfBdA/wwnFjgeXQHfGghFjA29hM2v7ax3ZWrlanG0Kc/1DbGFq93ZYOxo6+FSXG/atUJfnCStNTr3dnyu7kSuZbojU6JG2EgoUjwDJMa4YY8rV+20Wy7AXeLsnV7K/Vej0CvVNOUPuE3wzyHFStXJ8x/Go/go2QgtIH8bZvQozxLUwq5u4xcItKSCmlqyHyzeypWhMdswC8krju7Bm3AuuaviA/QSXkL7ipCKUjtJge/+BraLxLU6uVW64SaB5E/WDDNsX7PHNmPN1mA2fVVVWq/lHNxo0Na6NoBadjOTg+o1dv/uwA7XDHWY3tWU+pm1ny9CCFELDgpbFI/v4O6X9L5YDG/N26YbZvLh8uuiJY0TQ1UDsHfCirPQVWqj/k=
2021-05-01T18:24:33.670 INFO:teuthology.kill:  smithi058.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzaI7f8KSYpSjDm4+kliM3EXWuhiNRXxguDntlwtFhYLVkyUfKqfBDxnkTYdMPoXRDFg65EEYj24lESbIgFXGs40kq3uqaJ5I4x+wzzI0Y4mK+/tv0xxyP061rmAGhGIm+xbZtgZfH1zfiuqmU+gVAVo6uzZrw6FZ1yb2OiQdvid6wTmLpTcYBP+Zt0PXMz8WsfBNfoRzFCyWtIMJoDoJ+Zt8m1GYJwZRkqr2rBgtgBkpO8qMtrYJEMUzpfdsei3aUhvBMOjoBTBha1e3lK6nfyrWJHvmKUN9AxpFx1C6S77VQ/2ifNWl2vP5V6RC9WW7BCkvWG0xZ3iHC8qfNNq4WWbey+g61DlVZh8af8jWMgQCMHq7MbG+3NrlmwdVYDwNIFLB6yaKzMExYy4/ERdE06KCKI4Ps2KklntoWqFgqWHKFjURCdggWDzucN0jexmLMOK47FuzXunuoMn/cYGMVchCu2U6Z0mEaHoHAAgJaKUgGtk6Dm8Zzkkx+5YzoekE=
2021-05-01T18:24:33.690 INFO:teuthology.kill:2021-05-01 18:24:33,690.690 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-01T18:24:33.692 INFO:teuthology.kill:2021-05-01 18:24:33,692.692 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-05-01T18:24:33.753 INFO:teuthology.kill:2021-05-01 18:24:33,752.752 INFO:teuthology.orchestra.console:Power off smithi013
2021-05-01T18:24:33.765 INFO:teuthology.kill:2021-05-01 18:24:33,765.765 INFO:teuthology.orchestra.console:Power off smithi058
2021-05-01T18:24:33.893 INFO:teuthology.kill:2021-05-01 18:24:33,892.892 INFO:teuthology.orchestra.console:Power off for smithi013 completed
2021-05-01T18:24:33.904 INFO:teuthology.kill:2021-05-01 18:24:33,904.904 INFO:teuthology.orchestra.console:Power off for smithi058 completed
2021-05-01T18:24:34.037 INFO:teuthology.kill:2021-05-01 18:24:34,036.036 INFO:teuthology.lock.ops:unlocked smithi013.front.sepia.ceph.com
2021-05-01T18:24:34.044 INFO:teuthology.kill:2021-05-01 18:24:34,044.044 INFO:teuthology.lock.ops:unlocked smithi058.front.sepia.ceph.com
2021-05-01T18:26:34.327 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-05-01T18:26:34.421 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-05-01T18:26:34.421 INFO:teuthology.nuke:Checking targets against current locks
2021-05-01T18:26:34.510 INFO:teuthology.nuke:Not nuking smithi058.front.sepia.ceph.com because description doesn't match
2021-05-01T18:26:34.510 INFO:teuthology.nuke:Not nuking smithi013.front.sepia.ceph.com because description doesn't match