2022-04-11T05:49:15.882 INFO:root:teuthology version: 1.1.0-a347b2ac
2022-04-11T05:49:16.018 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi027.front.sepia.ceph.com' reimaging
2022-04-11T05:49:16.021 INFO:teuthology.lock.ops:Updating [ubuntu@smithi027.front.sepia.ceph.com]: reset os type and version on server
2022-04-11T05:49:16.021 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2022-04-11T05:49:16.042 INFO:teuthology.lock.ops:Node 'ubuntu@smithi027.front.sepia.ceph.com' reimaging is complete
2022-04-11T05:49:16.042 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi146.front.sepia.ceph.com' reimaging
2022-04-11T05:49:16.043 INFO:teuthology.lock.ops:Updating [ubuntu@smithi146.front.sepia.ceph.com]: reset os type and version on server
2022-04-11T05:49:16.043 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server
2022-04-11T05:49:16.064 INFO:teuthology.lock.ops:Node 'ubuntu@smithi146.front.sepia.ceph.com' reimaging is complete
2022-04-11T05:49:16.255 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 8.stream
2022-04-11T05:49:16.268 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 8.stream
2022-04-11T05:49:16.655 INFO:teuthology.orchestra.console:Power off smithi146
2022-04-11T05:49:16.670 INFO:teuthology.orchestra.console:Power off smithi027
2022-04-11T05:49:29.141 INFO:teuthology.orchestra.console:Power off for smithi146 completed
2022-04-11T05:49:29.146 INFO:teuthology.orchestra.console:Power off for smithi027 completed
2022-04-11T05:49:29.243 INFO:teuthology.orchestra.console:Power on smithi146
2022-04-11T05:49:29.253 INFO:teuthology.orchestra.console:Power on smithi027
2022-04-11T05:49:33.498 INFO:teuthology.orchestra.console:Power on for smithi146 completed
2022-04-11T05:49:33.599 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish
2022-04-11T05:49:37.616 INFO:teuthology.orchestra.console:Power on for smithi027 completed
2022-04-11T05:49:37.717 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2022-04-11T05:54:35.925 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-11T05:54:36.162 INFO:teuthology.provision.fog.smithi146:Node is ready
2022-04-11T05:54:36.179 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com
2022-04-11T05:54:36.238 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146
2022-04-11T05:54:36.591 INFO:teuthology.provision.fog.smithi146:Deploy complete!
2022-04-11T05:55:13.269 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-11T05:55:13.587 INFO:teuthology.provision.fog.smithi027:Node is ready
2022-04-11T05:55:13.605 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2022-04-11T05:55:13.663 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2022-04-11T05:55:14.012 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2022-04-11T05:55:14.160 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2022-04-11T05:55:14.161 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-11T05:55:14.180 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com
2022-04-11T05:55:14.180 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-11T05:55:14.200 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2022-04-11T05:55:14.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2022-04-11T05:55:14.391 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2022-04-11T05:55:14.448 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2022-04-11T05:55:14.448 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8"
2022-04-11T05:55:14.448 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2022-04-11T05:55:14.448 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2022-04-11T05:55:14.449 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8"
2022-04-11T05:55:14.449 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2022-04-11T05:55:14.449 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8"
2022-04-11T05:55:14.449 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2022-04-11T05:55:14.450 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-04-11T05:55:14.450 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2022-04-11T05:55:14.450 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-11T05:55:14.450 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-11T05:55:14.450 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-04-11T05:55:14.452 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2022-04-11T05:55:14.471 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server
2022-04-11T05:55:14.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com'
2022-04-11T05:55:14.730 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64
2022-04-11T05:55:14.788 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream"
2022-04-11T05:55:14.788 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8"
2022-04-11T05:55:14.789 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos"
2022-04-11T05:55:14.789 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora"
2022-04-11T05:55:14.789 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8"
2022-04-11T05:55:14.789 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8"
2022-04-11T05:55:14.790 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 8"
2022-04-11T05:55:14.790 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31"
2022-04-11T05:55:14.790 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-04-11T05:55:14.790 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/"
2022-04-11T05:55:14.790 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-11T05:55:14.791 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-11T05:55:14.791 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-04-11T05:55:14.791 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server
2022-04-11T05:55:14.889 INFO:teuthology.dispatcher.supervisor:Running job 6785926
2022-04-11T05:55:14.890 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-04-11_05:34:52-fs-wip-vshankar-testing-55110-20220408-203242-testing-default-smithi/6785926 --name vshankar-2022-04-11_05:34:52-fs-wip-vshankar-testing-55110-20220408-203242-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/vshankar-2022-04-11_05:34:52-fs-wip-vshankar-testing-55110-20220408-203242-testing-default-smithi/6785926/orig.config.yaml
2022-04-11T05:55:14.893 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-04-11_05:34:52-fs-wip-vshankar-testing-55110-20220408-203242-testing-default-smithi/6785926
2022-04-11T05:55:14.894 INFO:teuthology.dispatcher.supervisor:Job PID: 17009
2022-04-11T05:55:14.894 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-04-11T12:25:42.803 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-04-11T12:25:42.991 INFO:teuthology.kill:Killing Pids: {17009}
2022-04-11T12:25:44.264 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-04-11T12:25:44.265 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-04-11T12:25:44.265 INFO:teuthology.misc:Compressing logs...
2022-04-11T12:25:44.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2022-04-11T12:25:44.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com'
2022-04-11T12:25:46.091 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/dispatcher/supervisor.py", line 346, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2022-04-11T12:25:46.163 INFO:teuthology.kill:No teuthology processes running
2022-04-11T12:25:47.245 INFO:teuthology.kill:Nuking machines: ['smithi027', 'smithi146']
2022-04-11T12:25:48.172 INFO:teuthology.kill:2022-04-11 12:25:48,171.171 INFO:teuthology.nuke:targets:
2022-04-11T12:25:48.172 INFO:teuthology.kill:  smithi027.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+Q2kPVHWkDW2xjnsWXProFSVsczKr/LG5b7HoF7sLeRXchNtZ9XXIsHRwCgNTCKOdEk5eSRvN65Oqk6+zGunfrJukRQ9lDF6TILibvXKPqocsalIs/qPlq1HtOVuy7n1omJ3qQaOyKwp+oraxgO22JvbYfRl4Xw9T58z8zL0HTussVwpD/KrYlsA+Zbmgi7PsX72kkof+zI5jddE4nnGG2VSEnlpDBBTr7g79oQqghK4tQJ8E9w/zGAOSDywZyoJjb+Oe5Gcv0xHLq5nppIE+LO9GxmRSWFCrysnCJ0g8XJtVxbWdE4UNW//KWuxvVIB/vLhDRNkrdHZOziOUqP2ygW32IWqGdZyR8MzxR2kkTqlhT6jakOWAGIPrJ2dQqBNuL/hH6sC9cmZTwFhAL6jvlO4S6uVPtTiefmpjEed50Q/3aolw2ql50BvCRiaJpMpCPRvxyStaAuQL+oAny0HJ7Ta++LS5xY5P54zvnkQtS9HVDMQ9IrSCxkCZyilurkE=
2022-04-11T12:25:48.173 INFO:teuthology.kill:  smithi146.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCVyKwArj9b1WKy3BWuOH33m29XAww2AcEU6VXTIkOGYJ8iCw2ibtO2Z0OFw2jDMnAYap1Rzqbo1fM2en8XvhUKLNTHPPdeAkxMLZYW+fo0zRiU6qr07eolBypUDBc62iizJOFBrVDgp+Mnhd1gFte3kq0DCp9WXpQDAjktMgZWPcJ9x34BUmH+kfiXYNdYEjO6sp+BsB12C/B7kuqWfvUacLhnEzcBBunMwg/uAqnzYx8h8+4DYGhPlWDo5zOPeIxNJrXHFgyeBmVJZQ9zrZc8X1Ep2dlbS4RIxHZzAtIzOFN40TtFfZ6IX+5xjKPgpSU928PP3SbVEoJGRHjHEfcZo1kObXxi0zB3a3PnEWC1BENrf3Le6bxBagplApAWLkO8SRVK683Q1xenRFOWJ/HxRHdrO5tuHsmj21/k9AW+8f+13QyD3eELN/K2Thjup5i+fQwgZPtKry4p11UtbTmknKLf0MsMIfd6/psSNvteMNRpQjuwAYQFt+lqdqDh1yU=
2022-04-11T12:25:48.198 INFO:teuthology.kill:2022-04-11 12:25:48,197.197 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-11T12:25:48.200 INFO:teuthology.kill:2022-04-11 12:25:48,200.200 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-11T12:25:48.274 INFO:teuthology.kill:2022-04-11 12:25:48,274.274 INFO:teuthology.orchestra.console:Power off smithi146
2022-04-11T12:25:48.288 INFO:teuthology.kill:2022-04-11 12:25:48,288.288 INFO:teuthology.orchestra.console:Power off smithi027
2022-04-11T12:25:56.641 INFO:teuthology.kill:2022-04-11 12:25:56,640.640 INFO:teuthology.orchestra.console:Power off for smithi146 completed
2022-04-11T12:25:56.787 INFO:teuthology.kill:2022-04-11 12:25:56,785.785 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com
2022-04-11T12:26:00.755 INFO:teuthology.kill:2022-04-11 12:26:00,755.755 INFO:teuthology.orchestra.console:Power off for smithi027 completed
2022-04-11T12:26:00.899 INFO:teuthology.kill:2022-04-11 12:26:00,899.899 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com
2022-04-11T12:28:01.199 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-04-11T12:28:01.339 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi027 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-04-11_12:23:02-smoke-wip-vshankar-testing1-20220411-144044-testing-default-smithi/6786274
2022-04-11T12:28:01.339 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi146 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-04-11_12:23:02-smoke-wip-vshankar-testing1-20220411-144044-testing-default-smithi/6786274