2022-04-12T21:56:11.756 INFO:root:teuthology version: 1.1.0-a347b2ac
2022-04-12T21:56:11.881 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging
2022-04-12T21:56:11.882 INFO:teuthology.lock.ops:Updating [ubuntu@smithi017.front.sepia.ceph.com]: reset os type and version on server
2022-04-12T21:56:11.883 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2022-04-12T21:56:11.903 INFO:teuthology.lock.ops:Node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging is complete
2022-04-12T21:56:11.904 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi137.front.sepia.ceph.com' reimaging
2022-04-12T21:56:11.904 INFO:teuthology.lock.ops:Updating [ubuntu@smithi137.front.sepia.ceph.com]: reset os type and version on server
2022-04-12T21:56:11.905 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2022-04-12T21:56:11.925 INFO:teuthology.lock.ops:Node 'ubuntu@smithi137.front.sepia.ceph.com' reimaging is complete
2022-04-12T21:56:12.118 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 8.stream
2022-04-12T21:56:12.126 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of centos 8.stream
2022-04-12T21:56:12.460 INFO:teuthology.orchestra.console:Power off smithi017
2022-04-12T21:56:12.500 INFO:teuthology.orchestra.console:Power off smithi137
2022-04-12T21:56:20.832 INFO:teuthology.orchestra.console:Power off for smithi017 completed
2022-04-12T21:56:20.881 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2022-04-12T21:56:20.934 INFO:teuthology.orchestra.console:Power on smithi017
2022-04-12T21:56:20.982 INFO:teuthology.orchestra.console:Power on smithi137
2022-04-12T21:56:29.301 INFO:teuthology.orchestra.console:Power on for smithi017 completed
2022-04-12T21:56:29.346 INFO:teuthology.orchestra.console:Power on for smithi137 completed
2022-04-12T21:56:29.403 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish
2022-04-12T21:56:29.448 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish
2022-04-12T22:00:43.382 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-12T22:00:43.662 INFO:teuthology.provision.fog.smithi017:Node is ready
2022-04-12T22:00:43.722 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com
2022-04-12T22:00:43.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017
2022-04-12T22:00:44.156 INFO:teuthology.provision.fog.smithi017:Deploy complete!
2022-04-12T22:01:07.732 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-12T22:01:08.023 INFO:teuthology.provision.fog.smithi137:Node is ready
2022-04-12T22:01:08.041 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com
2022-04-12T22:01:08.099 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137
2022-04-12T22:01:08.466 INFO:teuthology.provision.fog.smithi137:Deploy complete!
2022-04-12T22:01:08.623 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com
2022-04-12T22:01:08.624 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-12T22:01:08.643 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com
2022-04-12T22:01:08.643 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-12T22:01:08.661 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server
2022-04-12T22:01:08.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com'
2022-04-12T22:01:08.924 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64
2022-04-12T22:01:08.983 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2022-04-12T22:01:08.983 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8"
2022-04-12T22:01:08.983 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2022-04-12T22:01:08.983 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2022-04-12T22:01:08.984 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8"
2022-04-12T22:01:08.984 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8"
2022-04-12T22:01:08.984 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8"
2022-04-12T22:01:08.984 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2022-04-12T22:01:08.985 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-04-12T22:01:08.985 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2022-04-12T22:01:08.985 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-12T22:01:08.985 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-12T22:01:08.986 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-04-12T22:01:08.987 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2022-04-12T22:01:09.009 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server
2022-04-12T22:01:09.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com'
2022-04-12T22:01:09.201 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64
2022-04-12T22:01:09.258 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream"
2022-04-12T22:01:09.259 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8"
2022-04-12T22:01:09.259 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos"
2022-04-12T22:01:09.259 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora"
2022-04-12T22:01:09.260 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8"
2022-04-12T22:01:09.260 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8"
2022-04-12T22:01:09.260 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 8"
2022-04-12T22:01:09.260 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31"
2022-04-12T22:01:09.260 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-04-12T22:01:09.261 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/"
2022-04-12T22:01:09.261 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-12T22:01:09.261 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-12T22:01:09.261 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-04-12T22:01:09.262 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2022-04-12T22:01:09.359 INFO:teuthology.dispatcher.supervisor:Running job 6786466
2022-04-12T22:01:09.359 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-04-11_12:24:06-fs-wip-vshankar-testing1-20220411-144044-testing-default-smithi/6786466 --name vshankar-2022-04-11_12:24:06-fs-wip-vshankar-testing1-20220411-144044-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/vshankar-2022-04-11_12:24:06-fs-wip-vshankar-testing1-20220411-144044-testing-default-smithi/6786466/orig.config.yaml
2022-04-12T22:01:09.362 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-04-11_12:24:06-fs-wip-vshankar-testing1-20220411-144044-testing-default-smithi/6786466
2022-04-12T22:01:09.363 INFO:teuthology.dispatcher.supervisor:Job PID: 31065
2022-04-12T22:01:09.363 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-04-13T04:31:37.594 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-04-13T04:31:37.895 INFO:teuthology.kill:Killing Pids: {31065}
2022-04-13T04:31:39.147 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-04-13T04:31:39.148 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-04-13T04:31:39.148 INFO:teuthology.misc:Compressing logs...
2022-04-13T04:31:39.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com'
2022-04-13T04:31:39.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com'
2022-04-13T04:31:40.971 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/dispatcher/supervisor.py", line 346, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2022-04-13T04:31:41.043 INFO:teuthology.kill:No teuthology processes running
2022-04-13T04:31:42.142 INFO:teuthology.kill:Nuking machines: ['smithi017', 'smithi137']
2022-04-13T04:31:43.135 INFO:teuthology.kill:2022-04-13 04:31:43,134.134 INFO:teuthology.nuke:targets:
2022-04-13T04:31:43.136 INFO:teuthology.kill:  smithi017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCe1kPcsw/iea0oQ8aPvbPNREzrzUdF/hQ+hqDTXEfVUPCXsKFJLzPZHiuPp0URJhnoSccln9gG0rNyglctHwG9IAopAjTNTFaYeaN6pD/VPFyPBxCrh+BfB9hEPQYmmuTY5HeaNiBiqjYnFEPs+6n1jwyXtjlBrBTU/EYhO1j/StEXzEnO4Veysv9Vew1uKti6OxZXnRtFKWJYBsNCAz9nIDK4sm1JIPCbkOXekQVq4JzIKzzyZyvWt96i5mdggT1O+UDxdjNg8/dSzXqh6F/NUMRoeONszPXcOx0EZZVaV2UAFjCT6HblrUMa+qlz8JPmJXfZ19XNnkLrvVs/gCHoyEaccV2jbEgiSyQJB7t0JjbuGQqpWI4YtASw/mPddtfNM5GjstuU046OerpaaviQVhnNDYPs7vbPqf6HCAsUbBUtjusFmvRRZLNO6Inaz6925pqlJStCQ+0z2GhXX4YYrtRLb8iM0dL97Q9aa7Zrwf+g0QzPVuIfZf6EwG56ENE=
2022-04-13T04:31:43.136 INFO:teuthology.kill:  smithi137.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCa6a56L3Ayl9pENavC7wdRjIQGZc1/hud7uo7cGQCaRiqT/3/XZ4UtQWS/crvbemIRJMA2N8refQO07/GotFz8RYsOS9Tjxn+dGPoHGBDgVhdYV/mGiK6dPG11RsZP7cfbU3IeBwBhL9WMbRUZQOKUSH4R+WCa81srQSNZISSrhWskDwlrNjtxAHFAYWnoDVim/RSsFoqShiQ8Lsw318RaYmWT7IMH7hVomqZCQSc1tXvYSEZE+x5DoZZ8TWO/Snw/sYwph7YVQxFAgniIRlEhnnDFee8sMWHargzGIH4muAvM++fzldT/BmwI4nTLzLLUeLrLBiZ+93djSL6rpdv3YR3QMVcmAGockSMS8+fa8HXanUP7/Aq9TQgvyylzQHjNou25xA+KLBtIXYK6YbBN32RGeJnGT6YpV+c3VfqGNKijKKxRTV9zB/6+Cc5O+0vqObrgayo8G11XfBL/JPHW1RXwn6e2YtXKiVSab6WRNk0yYUhnGg+wYn9uCP2qXc=
2022-04-13T04:31:43.162 INFO:teuthology.kill:2022-04-13 04:31:43,162.162 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-13T04:31:43.165 INFO:teuthology.kill:2022-04-13 04:31:43,165.165 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-13T04:31:43.243 INFO:teuthology.kill:2022-04-13 04:31:43,243.243 INFO:teuthology.orchestra.console:Power off smithi017
2022-04-13T04:31:43.257 INFO:teuthology.kill:2022-04-13 04:31:43,256.256 INFO:teuthology.orchestra.console:Power off smithi137
2022-04-13T04:31:55.725 INFO:teuthology.kill:2022-04-13 04:31:55,725.725 INFO:teuthology.orchestra.console:Power off for smithi017 completed
2022-04-13T04:31:55.734 INFO:teuthology.kill:2022-04-13 04:31:55,734.734 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2022-04-13T04:31:55.873 INFO:teuthology.kill:2022-04-13 04:31:55,872.872 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com
2022-04-13T04:31:55.876 INFO:teuthology.kill:2022-04-13 04:31:55,876.876 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com
2022-04-13T04:33:56.191 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-04-13T04:33:56.316 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi017 but it was locked by another job: /home/teuthworker/archive/adking-2022-04-13_02:44:37-orch:cephadm:thrash-wip-adk2-testing-2022-04-11-1210-distro-basic-smithi/6789751
2022-04-13T04:33:56.316 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi137 but it was locked by another job: /home/teuthworker/archive/adking-2022-04-13_02:44:37-orch:cephadm:thrash-wip-adk2-testing-2022-04-11-1210-distro-basic-smithi/6789751