2022-03-04T12:17:18.497 INFO:root:teuthology version: 1.1.0-eeaeee38
2022-03-04T12:17:18.615 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi157.front.sepia.ceph.com' reimaging
2022-03-04T12:17:18.617 INFO:teuthology.lock.ops:Updating [ubuntu@smithi157.front.sepia.ceph.com]: reset os type and version on server
2022-03-04T12:17:18.618 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2022-03-04T12:17:18.644 INFO:teuthology.lock.ops:Node 'ubuntu@smithi157.front.sepia.ceph.com' reimaging is complete
2022-03-04T12:17:18.645 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi160.front.sepia.ceph.com' reimaging
2022-03-04T12:17:18.645 INFO:teuthology.lock.ops:Updating [ubuntu@smithi160.front.sepia.ceph.com]: reset os type and version on server
2022-03-04T12:17:18.646 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server
2022-03-04T12:17:18.665 INFO:teuthology.lock.ops:Node 'ubuntu@smithi160.front.sepia.ceph.com' reimaging is complete
2022-03-04T12:17:18.926 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of centos 8.stream
2022-03-04T12:17:18.948 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 8.stream
2022-03-04T12:17:19.374 INFO:teuthology.orchestra.console:Power off smithi160
2022-03-04T12:17:19.429 INFO:teuthology.orchestra.console:Power off smithi157
2022-03-04T12:17:27.771 INFO:teuthology.orchestra.console:Power off for smithi160 completed
2022-03-04T12:17:27.795 INFO:teuthology.orchestra.console:Power off for smithi157 completed
2022-03-04T12:17:27.873 INFO:teuthology.orchestra.console:Power on smithi160
2022-03-04T12:17:27.902 INFO:teuthology.orchestra.console:Power on smithi157
2022-03-04T12:17:36.245 INFO:teuthology.orchestra.console:Power on for smithi160 completed
2022-03-04T12:17:36.308 INFO:teuthology.orchestra.console:Power on for smithi157 completed
2022-03-04T12:17:36.347 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish
2022-03-04T12:17:36.409 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish
2022-03-04T12:22:32.321 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-04T12:22:32.558 INFO:teuthology.provision.fog.smithi160:Node is ready
2022-03-04T12:22:32.576 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com
2022-03-04T12:22:32.634 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160
2022-03-04T12:22:32.989 INFO:teuthology.provision.fog.smithi160:Deploy complete!
2022-03-04T12:22:56.487 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-04T12:22:56.745 INFO:teuthology.provision.fog.smithi157:Node is ready
2022-03-04T12:22:56.764 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com
2022-03-04T12:22:56.823 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157
2022-03-04T12:22:57.171 INFO:teuthology.provision.fog.smithi157:Deploy complete!
2022-03-04T12:22:57.319 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com
2022-03-04T12:22:57.320 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-04T12:22:57.339 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com
2022-03-04T12:22:57.340 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-04T12:22:57.362 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server
2022-03-04T12:22:57.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2022-03-04T12:22:57.546 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64
2022-03-04T12:22:57.603 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream"
2022-03-04T12:22:57.604 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8"
2022-03-04T12:22:57.604 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos"
2022-03-04T12:22:57.604 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora"
2022-03-04T12:22:57.604 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8"
2022-03-04T12:22:57.605 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8"
2022-03-04T12:22:57.605 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-04T12:22:57.605 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2022-03-04T12:22:57.606 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-04T12:22:57.606 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/"
2022-03-04T12:22:57.606 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-04T12:22:57.606 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-04T12:22:57.607 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-04T12:22:57.608 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2022-03-04T12:22:57.628 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server
2022-03-04T12:22:57.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com'
2022-03-04T12:22:57.879 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64
2022-03-04T12:22:57.936 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream"
2022-03-04T12:22:57.937 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8"
2022-03-04T12:22:57.937 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos"
2022-03-04T12:22:57.937 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora"
2022-03-04T12:22:57.937 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8"
2022-03-04T12:22:57.938 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8"
2022-03-04T12:22:57.938 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-04T12:22:57.938 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31"
2022-03-04T12:22:57.938 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-04T12:22:57.939 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/"
2022-03-04T12:22:57.939 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-04T12:22:57.939 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-04T12:22:57.939 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-04T12:22:57.940 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server
2022-03-04T12:22:58.041 INFO:teuthology.dispatcher.supervisor:Running job 6720194
2022-03-04T12:22:58.042 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/virtualenv/bin/teuthology -v --owner scheduled_nshelke@teuthology --archive /home/teuthworker/archive/nshelke-2022-03-04_11:25:21-fs-wip-nshelke-skip-chmod-operation-testing-default-smithi/6720194 --name nshelke-2022-03-04_11:25:21-fs-wip-nshelke-skip-chmod-operation-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/nshelke-2022-03-04_11:25:21-fs-wip-nshelke-skip-chmod-operation-testing-default-smithi/6720194/orig.config.yaml
2022-03-04T12:22:58.045 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nshelke-2022-03-04_11:25:21-fs-wip-nshelke-skip-chmod-operation-testing-default-smithi/6720194
2022-03-04T12:22:58.046 INFO:teuthology.dispatcher.supervisor:Job PID: 6279
2022-03-04T12:22:58.046 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-04T18:53:27.416 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-04T18:53:27.590 INFO:teuthology.kill:Killing Pids: {6279}
2022-03-04T18:53:28.793 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-03-04T18:53:28.794 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-03-04T18:53:28.794 INFO:teuthology.misc:Compressing logs...
2022-03-04T18:53:28.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2022-03-04T18:53:29.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com'
2022-03-04T18:53:30.703 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/dispatcher/supervisor.py", line 287, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/dispatcher/supervisor.py", line 345, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2022-03-04T18:53:30.785 INFO:teuthology.kill:No teuthology processes running
2022-03-04T18:53:31.943 INFO:teuthology.kill:Nuking machines: ['smithi157', 'smithi160']
2022-03-04T18:53:32.913 INFO:teuthology.kill:2022-03-04 18:53:32,913.913 INFO:teuthology.nuke:targets:
2022-03-04T18:53:32.914 INFO:teuthology.kill:  smithi157.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHS3kzPLJoYte2YScx44pwMbYQOj6sSnZJo2+aFK6MNloWtOqhtBH05/IUxM7BksjU55Oye9Bfy/0DMfaPfd7Azg9BFBe5ueOpRfZsRpOlCyuMO6fxjQZ6OrsTsEEQKrthocRAFyJRycT0DPMpkmtEgWZIw6+knSlofZr9UmFvYrfo2Oxl5w7fPAEAPz62+vGP+yNLWYaZTklUSvddWlQrEv5U35Q97PANa0flfgSgHTWytI4SQJQkt/orezYKXMN8YaggAtiddAhQT8/SKtV0lUJ348P+dB2BCaDavhutXT8jWNOSGp9RI6At97lHGHZD3YTcHwhVMmnhgu8xcuS00OTMncRXZrp+Gx6fAfh/8P6JlDqudsySjkF28MxxkAsrYUxJ3N0//mIOie7bvzZ1s54EMYyVQX3aZMXXX1qXYiCFcbrBtVjfoftErNfiGQuv+Dx87G/ccHUY92QREeVX5LbjR+vsNuGUVeaYZPUeIdJVZ0FnVdfWDoznsHVYlnE=
2022-03-04T18:53:32.914 INFO:teuthology.kill:  smithi160.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC++8biBSaEuU+nC4sg4AjyYQUHkh/lpCXv7Zy5++pVd4X6zGlyhGCOwmXhxJPjKEYTwjtYVqOqj8FzUM+4tLr8DpEGrV5T0JoF1SUZKdhpO2N/2kB2+zdjG4n16Fu4/409zHhqlq53sFmd5t7nRyNUBJGJtLuSgIz3eAjRyQxfaWeblm4Jm1n5gCkD2vvPGsFGf08A3Y5BSBEjscD6J3oVChp37h/1XWtad2u5GwWNv+yShuJKq0oXquAz+3NenOhpz4AT4zPy97BXFZl/fVIImC/YTRSDEKzXr6CvTOqs/k4U0MrVk2OoQWQf8We8QYuWtFne8VAjuNUdcBSPliIsHCDpG7VyQcGKEGCrp3avq6VZe5dtCVl3wLw61OiNs2QdSO16OsGWKOUC2XXjdwGwv3AUJMdLmYfqoM8gcNUNyl2PUMKoRCuY8IyqEUfpxJWSR5dsosKzgZmuw/Q9bvPlkosMMM7rLzy8imZk2UmzdjrlckEbCalFoqQczD3+5C8=
2022-03-04T18:53:32.939 INFO:teuthology.kill:2022-03-04 18:53:32,939.939 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-04T18:53:32.942 INFO:teuthology.kill:2022-03-04 18:53:32,942.942 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-04T18:53:33.028 INFO:teuthology.kill:2022-03-04 18:53:33,028.028 INFO:teuthology.orchestra.console:Power off smithi157
2022-03-04T18:53:33.043 INFO:teuthology.kill:2022-03-04 18:53:33,043.043 INFO:teuthology.orchestra.console:Power off smithi160
2022-03-04T18:53:41.402 INFO:teuthology.kill:2022-03-04 18:53:41,401.401 INFO:teuthology.orchestra.console:Power off for smithi157 completed
2022-03-04T18:53:41.406 INFO:teuthology.kill:2022-03-04 18:53:41,406.406 INFO:teuthology.orchestra.console:Power off for smithi160 completed
2022-03-04T18:53:41.559 INFO:teuthology.kill:2022-03-04 18:53:41,558.558 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com
2022-03-04T18:53:41.564 INFO:teuthology.kill:2022-03-04 18:53:41,564.564 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com
2022-03-04T18:55:41.899 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-04T18:55:42.013 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi157 but it was locked by another job: /home/teuthworker/archive/rzarzynski-2022-03-04_18:41:01-rados-master-distro-basic-smithi/6720596
2022-03-04T18:55:42.014 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi160 but it was locked by another job: /home/teuthworker/archive/rzarzynski-2022-03-04_18:41:01-rados-master-distro-basic-smithi/6720596