2021-09-01T17:10:12.287 INFO:root:teuthology version: 1.1.0-df69d6db
2021-09-01T17:10:12.380 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi154.front.sepia.ceph.com' reimaging
2021-09-01T17:10:12.382 INFO:teuthology.lock.ops:Updating [ubuntu@smithi154.front.sepia.ceph.com]: reset os type and version on server
2021-09-01T17:10:12.382 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2021-09-01T17:10:12.399 INFO:teuthology.lock.ops:Node 'ubuntu@smithi154.front.sepia.ceph.com' reimaging is complete
2021-09-01T17:10:12.399 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi159.front.sepia.ceph.com' reimaging
2021-09-01T17:10:12.400 INFO:teuthology.lock.ops:Updating [ubuntu@smithi159.front.sepia.ceph.com]: reset os type and version on server
2021-09-01T17:10:12.402 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2021-09-01T17:10:12.423 INFO:teuthology.lock.ops:Node 'ubuntu@smithi159.front.sepia.ceph.com' reimaging is complete
2021-09-01T17:10:12.620 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 8.stream
2021-09-01T17:10:12.642 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 8.stream
2021-09-01T17:10:12.956 INFO:teuthology.orchestra.console:Power off smithi159
2021-09-01T17:10:12.969 INFO:teuthology.orchestra.console:Power off smithi154
2021-09-01T17:10:21.326 INFO:teuthology.orchestra.console:Power off for smithi159 completed
2021-09-01T17:10:21.330 INFO:teuthology.orchestra.console:Power off for smithi154 completed
2021-09-01T17:10:21.428 INFO:teuthology.orchestra.console:Power on smithi159
2021-09-01T17:10:21.435 INFO:teuthology.orchestra.console:Power on smithi154
2021-09-01T17:10:29.793 INFO:teuthology.orchestra.console:Power on for smithi159 completed
2021-09-01T17:10:29.799 INFO:teuthology.orchestra.console:Power on for smithi154 completed
2021-09-01T17:10:29.895 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2021-09-01T17:10:29.900 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish
2021-09-01T17:13:01.093 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: Authentication failed.
2021-09-01T17:13:01.101 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: Authentication failed.
2021-09-01T17:15:14.364 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-09-01T17:15:14.379 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-09-01T17:15:14.620 INFO:teuthology.provision.fog.smithi154:Node is ready
2021-09-01T17:15:14.636 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com
2021-09-01T17:15:14.652 INFO:teuthology.provision.fog.smithi159:Node is ready
2021-09-01T17:15:14.669 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com
2021-09-01T17:15:14.693 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154
2021-09-01T17:15:14.726 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2021-09-01T17:15:15.041 INFO:teuthology.provision.fog.smithi154:Deploy complete!
2021-09-01T17:15:15.059 INFO:teuthology.provision.fog.smithi159:Deploy complete!
2021-09-01T17:15:15.206 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com
2021-09-01T17:15:15.207 INFO:teuthology.lock.ops:New key found. Updating...
2021-09-01T17:15:15.227 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com
2021-09-01T17:15:15.227 INFO:teuthology.lock.ops:New key found. Updating...
2021-09-01T17:15:15.243 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server
2021-09-01T17:15:15.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-09-01T17:15:15.428 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64
2021-09-01T17:15:15.483 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2021-09-01T17:15:15.484 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8"
2021-09-01T17:15:15.484 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2021-09-01T17:15:15.484 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2021-09-01T17:15:15.485 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8"
2021-09-01T17:15:15.485 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8"
2021-09-01T17:15:15.485 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8"
2021-09-01T17:15:15.485 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2021-09-01T17:15:15.486 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-09-01T17:15:15.486 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2021-09-01T17:15:15.486 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-09-01T17:15:15.486 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-09-01T17:15:15.486 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-09-01T17:15:15.488 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2021-09-01T17:15:15.504 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server
2021-09-01T17:15:15.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-09-01T17:15:15.700 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2021-09-01T17:15:15.756 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream"
2021-09-01T17:15:15.756 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8"
2021-09-01T17:15:15.757 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos"
2021-09-01T17:15:15.757 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora"
2021-09-01T17:15:15.757 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8"
2021-09-01T17:15:15.758 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2021-09-01T17:15:15.758 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8"
2021-09-01T17:15:15.758 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2021-09-01T17:15:15.758 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-09-01T17:15:15.759 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/"
2021-09-01T17:15:15.759 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-09-01T17:15:15.760 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-09-01T17:15:15.760 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-09-01T17:15:15.761 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2021-09-01T17:15:15.846 INFO:teuthology.dispatcher.supervisor:Running job 6370563
2021-09-01T17:15:15.846 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/virtualenv/bin/teuthology -v --owner scheduled_soumyakoduri@teuthology --archive /home/teuthworker/archive/soumyakoduri-2021-09-01_15:57:42-rgw-cloudtiering-distro-basic-smithi/6370563 --name soumyakoduri-2021-09-01_15:57:42-rgw-cloudtiering-distro-basic-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{centos_8.stream} tasks/test_multi} -- /home/teuthworker/archive/soumyakoduri-2021-09-01_15:57:42-rgw-cloudtiering-distro-basic-smithi/6370563/orig.config.yaml
2021-09-01T17:15:15.850 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/soumyakoduri-2021-09-01_15:57:42-rgw-cloudtiering-distro-basic-smithi/6370563
2021-09-01T17:15:15.851 INFO:teuthology.dispatcher.supervisor:Job PID: 26436
2021-09-01T17:15:15.851 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-09-02T05:15:34.481 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-09-02T05:15:34.729 INFO:teuthology.kill:Killing Pids: {26436}
2021-09-02T05:15:35.820 INFO:teuthology.kill:Nuking machines: ['smithi154', 'smithi159']
2021-09-02T05:15:36.762 INFO:teuthology.kill:2021-09-02 05:15:36,762.762 INFO:teuthology.nuke:targets:
2021-09-02T05:15:36.763 INFO:teuthology.kill:  smithi154.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMkVpgf0KLPyvfPESV47ryv6o5xjmxmnYE6xxyqsznG0dJKxj9hxe8tWcHBs18tsPc++QpMTHzoPibKp6P+lEZVADFAV5b1JGUVH7YiYn6CREyh23bHK4Ab+usrQmM8wZAAJx4r25HJIXeqj7we6sAVkCaG6P1KFgVxh6CSAcBvBmJ/wVOmlZMLtXgajrTF1UwW2+E/3/mvUzzLNMr0kZdrlSIUbZwbfK7stJ+JeuIeuebpBqAL/qpYy6kt3Bd3q12N2RX9ISKQYFr1bjC83W0BD2lKMS14tAd8zwqZrZtPay+R+WDEbsekhucsC9dGsaPclDvV4OqVGc135p3efFJAb0wJFKvom2/vZ9Vz+AAlMcgMYzobaNgN56x8Bdo/K+TFpqBTfBihqrHEB6r8ha6cVG9fmeV7VMsfvRsC/c7aqFWaP/CqOWRA6PzstbfBQXkCyjY92jRHFQhJ1bzDv2HryU0BMS1R0dNG719ZgHxWHXK1q1Z+w4/fva6te8GA1U=
2021-09-02T05:15:36.763 INFO:teuthology.kill:  smithi159.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDivlFothePw/OaGq+DiYfkNdDtgCWpVSGb8mALljuCjoxciiP8/hmEGbjTr9lGJ/ZxZHHcvgFa+ZWuDjW2EbqNNfWBIVnBuYLDIXjRpec2ihuctosDZHSzpqYCTYmkhIr0XL38jhZQZ84A6yafphR5BpdC3BHOaLJ9DzeYlYuksvbYiHn/qG55v/G3oJMc8OhZZty4bPLQNSDsCNvOxqZvJNkn8BG0oI+BF87Q85aiA3TUp3yUA2KaswdK8tjrzRvDbzN+Atfl8cAN5Ker2JU8DwM99jrom/VaNxTy+AjunFjXoc/JuY2FDdTc2CRlzZB0oB80u0D2KLwaoJdkyKgy5KNpjef+9b/FVm5VFaOIilNRLC5dLzTmFjjnfPNXzBgh084Cg9MZDvZm6VLW1/EJmg9g37lfd5Y+q+uXZ/BUXel6kEt6si+Cbk6LKNhzh4itlAA4LtEk1w4/85ezdJYqS+TMfBicW3eZogWPqIB1rfvglK1n7rkCIYz5zUQifTk=
2021-09-02T05:15:36.763 INFO:teuthology.kill:2021-09-02 05:15:36,762.762 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-09-02T05:15:36.766 INFO:teuthology.kill:2021-09-02 05:15:36,765.765 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-09-02T05:15:36.831 INFO:teuthology.kill:2021-09-02 05:15:36,830.830 INFO:teuthology.orchestra.console:Power off smithi154
2021-09-02T05:15:36.843 INFO:teuthology.kill:2021-09-02 05:15:36,843.843 INFO:teuthology.orchestra.console:Power off smithi159
2021-09-02T05:15:45.205 INFO:teuthology.kill:2021-09-02 05:15:45,204.204 INFO:teuthology.orchestra.console:Power off for smithi154 completed
2021-09-02T05:15:49.321 INFO:teuthology.kill:2021-09-02 05:15:49,320.320 INFO:teuthology.orchestra.console:Power off for smithi159 completed
2021-09-02T05:15:49.538 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2021-09-02T05:15:49.538 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2021-09-02T05:15:49.539 INFO:teuthology.misc:Compressing logs...
2021-09-02T05:15:49.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-09-02T05:16:49.543 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_df69d6db9d68f5492f47c1dee57bca3b0a385796/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-09-02T05:16:49.611 INFO:teuthology.kill:No teuthology processes running
2021-09-02T05:16:50.777 INFO:teuthology.kill:Nuking machines: ['smithi154', 'smithi159']
2021-09-02T05:16:51.768 INFO:teuthology.kill:2021-09-02 05:16:51,767.767 INFO:teuthology.nuke:targets:
2021-09-02T05:16:51.769 INFO:teuthology.kill:  smithi154.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMkVpgf0KLPyvfPESV47ryv6o5xjmxmnYE6xxyqsznG0dJKxj9hxe8tWcHBs18tsPc++QpMTHzoPibKp6P+lEZVADFAV5b1JGUVH7YiYn6CREyh23bHK4Ab+usrQmM8wZAAJx4r25HJIXeqj7we6sAVkCaG6P1KFgVxh6CSAcBvBmJ/wVOmlZMLtXgajrTF1UwW2+E/3/mvUzzLNMr0kZdrlSIUbZwbfK7stJ+JeuIeuebpBqAL/qpYy6kt3Bd3q12N2RX9ISKQYFr1bjC83W0BD2lKMS14tAd8zwqZrZtPay+R+WDEbsekhucsC9dGsaPclDvV4OqVGc135p3efFJAb0wJFKvom2/vZ9Vz+AAlMcgMYzobaNgN56x8Bdo/K+TFpqBTfBihqrHEB6r8ha6cVG9fmeV7VMsfvRsC/c7aqFWaP/CqOWRA6PzstbfBQXkCyjY92jRHFQhJ1bzDv2HryU0BMS1R0dNG719ZgHxWHXK1q1Z+w4/fva6te8GA1U=
2021-09-02T05:16:51.769 INFO:teuthology.kill:  smithi159.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDivlFothePw/OaGq+DiYfkNdDtgCWpVSGb8mALljuCjoxciiP8/hmEGbjTr9lGJ/ZxZHHcvgFa+ZWuDjW2EbqNNfWBIVnBuYLDIXjRpec2ihuctosDZHSzpqYCTYmkhIr0XL38jhZQZ84A6yafphR5BpdC3BHOaLJ9DzeYlYuksvbYiHn/qG55v/G3oJMc8OhZZty4bPLQNSDsCNvOxqZvJNkn8BG0oI+BF87Q85aiA3TUp3yUA2KaswdK8tjrzRvDbzN+Atfl8cAN5Ker2JU8DwM99jrom/VaNxTy+AjunFjXoc/JuY2FDdTc2CRlzZB0oB80u0D2KLwaoJdkyKgy5KNpjef+9b/FVm5VFaOIilNRLC5dLzTmFjjnfPNXzBgh084Cg9MZDvZm6VLW1/EJmg9g37lfd5Y+q+uXZ/BUXel6kEt6si+Cbk6LKNhzh4itlAA4LtEk1w4/85ezdJYqS+TMfBicW3eZogWPqIB1rfvglK1n7rkCIYz5zUQifTk=
2021-09-02T05:16:51.790 INFO:teuthology.kill:2021-09-02 05:16:51,790.790 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-09-02T05:16:51.793 INFO:teuthology.kill:2021-09-02 05:16:51,793.793 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-09-02T05:16:51.852 INFO:teuthology.kill:2021-09-02 05:16:51,852.852 INFO:teuthology.orchestra.console:Power off smithi154
2021-09-02T05:16:51.866 INFO:teuthology.kill:2021-09-02 05:16:51,865.865 INFO:teuthology.orchestra.console:Power off smithi159
2021-09-02T05:16:51.994 INFO:teuthology.kill:2021-09-02 05:16:51,994.994 INFO:teuthology.orchestra.console:Power off for smithi154 completed
2021-09-02T05:16:52.004 INFO:teuthology.kill:2021-09-02 05:16:52,004.004 INFO:teuthology.orchestra.console:Power off for smithi159 completed
2021-09-02T05:16:52.136 INFO:teuthology.kill:2021-09-02 05:16:52,135.135 INFO:teuthology.lock.ops:unlocked smithi154.front.sepia.ceph.com
2021-09-02T05:16:52.141 INFO:teuthology.kill:2021-09-02 05:16:52,141.141 INFO:teuthology.lock.ops:unlocked smithi159.front.sepia.ceph.com
2021-09-02T05:18:52.326 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-09-02T05:18:52.415 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-09-02T05:18:52.416 INFO:teuthology.nuke:Checking targets against current locks
2021-09-02T05:18:52.533 INFO:teuthology.nuke:Not nuking smithi154.front.sepia.ceph.com because description doesn't match
2021-09-02T05:18:52.534 INFO:teuthology.nuke:Not nuking smithi159.front.sepia.ceph.com because description doesn't match