2022-04-08T09:04:14.941 INFO:root:teuthology version: 1.1.0-a347b2ac
2022-04-08T09:04:15.068 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging
2022-04-08T09:04:15.069 INFO:teuthology.lock.ops:Updating [ubuntu@smithi036.front.sepia.ceph.com]: reset os type and version on server
2022-04-08T09:04:15.069 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server
2022-04-08T09:04:15.088 INFO:teuthology.lock.ops:Node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging is complete
2022-04-08T09:04:15.088 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi066.front.sepia.ceph.com' reimaging
2022-04-08T09:04:15.088 INFO:teuthology.lock.ops:Updating [ubuntu@smithi066.front.sepia.ceph.com]: reset os type and version on server
2022-04-08T09:04:15.089 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2022-04-08T09:04:15.107 INFO:teuthology.lock.ops:Node 'ubuntu@smithi066.front.sepia.ceph.com' reimaging is complete
2022-04-08T09:04:15.314 INFO:teuthology.provision.fog.smithi036:Scheduling deploy of centos 8.stream
2022-04-08T09:04:15.334 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 8.stream
2022-04-08T09:04:15.658 INFO:teuthology.orchestra.console:Power off smithi066
2022-04-08T09:04:15.672 INFO:teuthology.orchestra.console:Power off smithi036
2022-04-08T09:04:15.807 INFO:teuthology.orchestra.console:Power off for smithi066 completed
2022-04-08T09:04:15.821 INFO:teuthology.orchestra.console:Power off for smithi036 completed
2022-04-08T09:04:15.908 INFO:teuthology.orchestra.console:Power on smithi066
2022-04-08T09:04:15.922 INFO:teuthology.orchestra.console:Power on smithi036
2022-04-08T09:04:20.172 INFO:teuthology.orchestra.console:Power on for smithi036 completed
2022-04-08T09:04:20.274 INFO:teuthology.provision.fog.smithi036:Waiting for deploy to finish
2022-04-08T09:04:24.286 INFO:teuthology.orchestra.console:Power on for smithi066 completed
2022-04-08T09:04:24.387 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish
2022-04-08T09:08:01.883 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-08T09:08:22.206 INFO:teuthology.provision.fog.smithi036:Node is ready
2022-04-08T09:08:22.266 INFO:teuthology.orchestra.run.smithi036.stdout:smithi036.front.sepia.ceph.com
2022-04-08T09:08:22.323 INFO:teuthology.orchestra.run.smithi036.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036
2022-04-08T09:08:22.686 INFO:teuthology.provision.fog.smithi036:Deploy complete!
2022-04-08T09:09:25.066 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-08T09:09:50.523 INFO:teuthology.provision.fog.smithi066:Node is ready
2022-04-08T09:09:50.547 INFO:teuthology.orchestra.run.smithi066.stdout:smithi077
2022-04-08T09:09:50.607 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077
2022-04-08T09:09:51.047 INFO:teuthology.provision.fog.smithi066:Deploy complete!
2022-04-08T09:09:51.200 INFO:teuthology.lock.ops:Checking smithi036.front.sepia.ceph.com
2022-04-08T09:09:51.201 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-08T09:09:51.220 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com
2022-04-08T09:09:51.221 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-08T09:09:51.240 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: set os type and version on server
2022-04-08T09:09:51.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com'
2022-04-08T09:09:51.491 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64
2022-04-08T09:09:51.549 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="CentOS Stream"
2022-04-08T09:09:51.549 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="8"
2022-04-08T09:09:51.549 INFO:teuthology.orchestra.run.smithi036.stdout:ID="centos"
2022-04-08T09:09:51.550 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE="rhel fedora"
2022-04-08T09:09:51.550 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="8"
2022-04-08T09:09:51.550 INFO:teuthology.orchestra.run.smithi036.stdout:PLATFORM_ID="platform:el8"
2022-04-08T09:09:51.550 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="CentOS Stream 8"
2022-04-08T09:09:51.551 INFO:teuthology.orchestra.run.smithi036.stdout:ANSI_COLOR="0;31"
2022-04-08T09:09:51.551 INFO:teuthology.orchestra.run.smithi036.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-04-08T09:09:51.551 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://centos.org/"
2022-04-08T09:09:51.551 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-08T09:09:51.551 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-08T09:09:51.552 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-04-08T09:09:51.553 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server
2022-04-08T09:09:51.571 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server
2022-04-08T09:09:51.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com'
2022-04-08T09:09:51.767 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64
2022-04-08T09:09:51.824 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream"
2022-04-08T09:09:51.824 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8"
2022-04-08T09:09:51.824 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos"
2022-04-08T09:09:51.824 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora"
2022-04-08T09:09:51.825 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8"
2022-04-08T09:09:51.825 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8"
2022-04-08T09:09:51.825 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 8"
2022-04-08T09:09:51.825 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2022-04-08T09:09:51.826 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-04-08T09:09:51.826 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/"
2022-04-08T09:09:51.826 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-08T09:09:51.826 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-08T09:09:51.826 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-04-08T09:09:51.827 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2022-04-08T09:09:51.922 INFO:teuthology.dispatcher.supervisor:Running job 6782642
2022-04-08T09:09:51.923 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-04-08_07:36:22-fs-wip-vshankar-testing-55110-20220407-173953-testing-default-smithi/6782642 --name vshankar-2022-04-08_07:36:22-fs-wip-vshankar-testing-55110-20220407-173953-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/vshankar-2022-04-08_07:36:22-fs-wip-vshankar-testing-55110-20220407-173953-testing-default-smithi/6782642/orig.config.yaml
2022-04-08T09:09:51.926 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-04-08_07:36:22-fs-wip-vshankar-testing-55110-20220407-173953-testing-default-smithi/6782642
2022-04-08T09:09:51.927 INFO:teuthology.dispatcher.supervisor:Job PID: 1378
2022-04-08T09:09:51.927 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-04-08T15:40:19.847 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-04-08T15:40:20.067 INFO:teuthology.kill:Killing Pids: {1378}
2022-04-08T15:40:21.275 INFO:teuthology.task.internal:roles: ubuntu@smithi036.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-04-08T15:40:21.276 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-04-08T15:40:21.276 INFO:teuthology.misc:Compressing logs...
2022-04-08T15:40:21.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com'
2022-04-08T15:40:21.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com'
2022-04-08T15:40:23.147 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/dispatcher/supervisor.py", line 346, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2022-04-08T15:40:23.219 INFO:teuthology.kill:No teuthology processes running
2022-04-08T15:40:24.311 INFO:teuthology.kill:Nuking machines: ['smithi036', 'smithi066']
2022-04-08T15:40:25.291 INFO:teuthology.kill:2022-04-08 15:40:25,290.290 INFO:teuthology.nuke:targets:
2022-04-08T15:40:25.292 INFO:teuthology.kill:  smithi036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfRBcIGthX8yv+rLe64/MCu0WwICEXIvz7e/c3nSAT1YK62+HUq7x3WlHOrorOUnT2LAmeO6AY98D58RduxgyW//K77WvWNLNtOGPbHO112zv4axQufqgdg63Mipd5rZJrCltdYbtXMp9ObzSu1c+erI7lB6vkPA0zpa+ohtWbXagtZLeRrrsbky3sxPBWtEurXk1csgbXGfQGj1N+ifq1Fdz3CUYRuvE1DgiFYvK3sE3vTGUVd9bUpY8jXPtvjetLjBJkESs2omK+PSj5RyWyiGGXV/fDen6R3NdP9rC1tpSVfjgZ3HJB2LdIS4aVVwX7KAsdu+K9mIgPqrrCfJBb8QpCCqV1d1YQPrZrT0AiKGmKRLR9ATqqG6kvrNDgYLTpc77/2SJiwhlJBiYMSDFtW1VM6L8TbSx5UyywnH20vTZhZv1kd4SmBTUJPUacLT3IA9NSYXSNAulKTffraizUP1tpLS5d8Q6rci1rBRfNKGFgMT55ui+BzJ9tIvkZvJc=
2022-04-08T15:40:25.292 INFO:teuthology.kill:  smithi066.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD0T+fpkmdk32Aa+8gqiDGMCUuMBp8qoYSKyIaqRDMvMJcfiR03goutKgaP7MhE5W8uTFoppCBwP8U4fbXkIoBOgREsCOYzUp8e3uwH0yoyjrEhz+hsrSQIv2sJr0JcyVAmC+KVRAtwLhGSCllW12vbzADsHC8yaNbjKaWV9VC021NDaQwRnBYgmOVHk9L2/5058EQ0gg5l+FJHhkYkH5u1Z/35Cu3O3JUaLiq9pLUCHd9z7qIbypbCSaCiGrJ+1qD8rEWASa9Oce80Of0ErCz7qXsBTJZfRimzHjH6YxXEi6XbgyrBrsqAWd+EdE6d3VIjm8hR5V5Cw3P96n6H0oYczHHCyPBtDNAm7AU8VDbU1/cOZ8VcSmVYw8jjFNj4ig5zo5Nidf/Rn5EsQaKU6pSPS+HkYZ/wu8C709AgAtVh4TRivmqlVlhweiVvQnM95L1ZaBk6VpPX8Gcen4rJ1pTxlCVKrmnlXa9OFnM9RmuKnrTX7vvLkfgG5RB5vDidnk=
2022-04-08T15:40:25.318 INFO:teuthology.kill:2022-04-08 15:40:25,317.317 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-08T15:40:25.359 INFO:teuthology.kill:2022-04-08 15:40:25,358.358 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-08T15:40:25.389 INFO:teuthology.kill:2022-04-08 15:40:25,389.389 INFO:teuthology.orchestra.console:Power off smithi036
2022-04-08T15:40:25.447 INFO:teuthology.kill:2022-04-08 15:40:25,447.447 INFO:teuthology.orchestra.console:Power off smithi066
2022-04-08T15:40:33.803 INFO:teuthology.kill:2022-04-08 15:40:33,803.803 INFO:teuthology.orchestra.console:Power off for smithi066 completed
2022-04-08T15:40:33.950 INFO:teuthology.kill:2022-04-08 15:40:33,949.949 INFO:teuthology.lock.ops:unlocked: smithi066.front.sepia.ceph.com
2022-04-08T15:40:37.869 INFO:teuthology.kill:2022-04-08 15:40:37,869.869 INFO:teuthology.orchestra.console:Power off for smithi036 completed
2022-04-08T15:40:38.015 INFO:teuthology.kill:2022-04-08 15:40:38,015.015 INFO:teuthology.lock.ops:unlocked: smithi036.front.sepia.ceph.com
2022-04-08T15:42:38.311 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15