2021-11-18T18:31:19.667 INFO:root:teuthology version: 1.1.0-6cfddd5e
2021-11-18T18:31:19.791 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging
2021-11-18T18:31:19.792 INFO:teuthology.lock.ops:Updating [ubuntu@smithi156.front.sepia.ceph.com]: reset os type and version on server
2021-11-18T18:31:19.793 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2021-11-18T18:31:19.814 INFO:teuthology.lock.ops:Node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging is complete
2021-11-18T18:31:19.815 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi181.front.sepia.ceph.com' reimaging
2021-11-18T18:31:19.815 INFO:teuthology.lock.ops:Updating [ubuntu@smithi181.front.sepia.ceph.com]: reset os type and version on server
2021-11-18T18:31:19.815 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2021-11-18T18:31:19.834 INFO:teuthology.lock.ops:Node 'ubuntu@smithi181.front.sepia.ceph.com' reimaging is complete
2021-11-18T18:31:20.028 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of ubuntu 20.04
2021-11-18T18:31:20.039 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of ubuntu 20.04
2021-11-18T18:31:20.374 INFO:teuthology.orchestra.console:Power off smithi156
2021-11-18T18:31:20.391 INFO:teuthology.orchestra.console:Power off smithi181
2021-11-18T18:31:20.518 INFO:teuthology.orchestra.console:Power off for smithi156 completed
2021-11-18T18:31:20.530 INFO:teuthology.orchestra.console:Power off for smithi181 completed
2021-11-18T18:31:20.620 INFO:teuthology.orchestra.console:Power on smithi156
2021-11-18T18:31:20.632 INFO:teuthology.orchestra.console:Power on smithi181
2021-11-18T18:31:28.987 INFO:teuthology.orchestra.console:Power on for smithi156 completed
2021-11-18T18:31:28.992 INFO:teuthology.orchestra.console:Power on for smithi181 completed
2021-11-18T18:31:29.089 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2021-11-18T18:31:29.092 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish
2021-11-18T18:34:30.727 ERROR:teuthology.orchestra.connection:Error authenticating with smithi181.front.sepia.ceph.com: Authentication failed.
2021-11-18T18:37:02.449 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-18T18:37:02.987 INFO:teuthology.provision.fog.smithi181:Node is ready
2021-11-18T18:37:02.995 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com
2021-11-18T18:37:03.043 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181
2021-11-18T18:37:03.272 INFO:teuthology.provision.fog.smithi181:Deploy complete!
2021-11-18T18:37:04.132 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-18T18:37:04.672 INFO:teuthology.provision.fog.smithi156:Node is ready
2021-11-18T18:37:04.679 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com
2021-11-18T18:37:04.688 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2021-11-18T18:37:04.900 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2021-11-18T18:37:05.131 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com
2021-11-18T18:37:05.132 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-18T18:37:05.152 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com
2021-11-18T18:37:05.152 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-18T18:37:05.170 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server
2021-11-18T18:37:05.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2021-11-18T18:37:05.361 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64
2021-11-18T18:37:05.368 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Ubuntu"
2021-11-18T18:37:05.368 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-11-18T18:37:05.369 INFO:teuthology.orchestra.run.smithi156.stdout:ID=ubuntu
2021-11-18T18:37:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE=debian
2021-11-18T18:37:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-11-18T18:37:05.370 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="20.04"
2021-11-18T18:37:05.371 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.ubuntu.com/"
2021-11-18T18:37:05.371 INFO:teuthology.orchestra.run.smithi156.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-11-18T18:37:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-11-18T18:37:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-11-18T18:37:05.372 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_CODENAME=focal
2021-11-18T18:37:05.373 INFO:teuthology.orchestra.run.smithi156.stdout:UBUNTU_CODENAME=focal
2021-11-18T18:37:05.374 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2021-11-18T18:37:05.393 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server
2021-11-18T18:37:05.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com'
2021-11-18T18:37:05.573 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64
2021-11-18T18:37:05.580 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Ubuntu"
2021-11-18T18:37:05.580 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-11-18T18:37:05.580 INFO:teuthology.orchestra.run.smithi181.stdout:ID=ubuntu
2021-11-18T18:37:05.581 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE=debian
2021-11-18T18:37:05.581 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-11-18T18:37:05.581 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="20.04"
2021-11-18T18:37:05.581 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.ubuntu.com/"
2021-11-18T18:37:05.581 INFO:teuthology.orchestra.run.smithi181.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-11-18T18:37:05.582 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-11-18T18:37:05.582 INFO:teuthology.orchestra.run.smithi181.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-11-18T18:37:05.582 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_CODENAME=focal
2021-11-18T18:37:05.582 INFO:teuthology.orchestra.run.smithi181.stdout:UBUNTU_CODENAME=focal
2021-11-18T18:37:05.583 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2021-11-18T18:37:05.677 INFO:teuthology.dispatcher.supervisor:Running job 6512161
2021-11-18T18:37:05.678 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology -v --owner scheduled_ivancich@teuthology --archive /home/teuthworker/archive/ivancich-2021-11-18_15:47:34-rgw-wip-53291-pacific-distro-basic-smithi/6512161 --name ivancich-2021-11-18_15:47:34-rgw-wip-53291-pacific-distro-basic-smithi --description rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} -- /home/teuthworker/archive/ivancich-2021-11-18_15:47:34-rgw-wip-53291-pacific-distro-basic-smithi/6512161/orig.config.yaml
2021-11-18T18:37:05.684 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ivancich-2021-11-18_15:47:34-rgw-wip-53291-pacific-distro-basic-smithi/6512161
2021-11-18T18:37:05.685 INFO:teuthology.dispatcher.supervisor:Job PID: 22290
2021-11-18T18:37:05.685 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-19T06:37:26.727 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-19T06:37:26.948 INFO:teuthology.kill:Killing Pids: {22290}
2021-11-19T06:37:28.256 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2021-11-19T06:37:28.257 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2021-11-19T06:37:28.257 INFO:teuthology.misc:Compressing logs...
2021-11-19T06:37:28.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2021-11-19T06:37:28.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com'
2021-11-19T06:37:28.718 INFO:teuthology.misc:Compressing logs...
2021-11-19T06:37:28.834 INFO:teuthology.misc:Compressing logs...
2021-11-19T06:41:06.237 INFO:teuthology.kill:No teuthology processes running
2021-11-19T06:41:07.495 INFO:teuthology.kill:Nuking machines: ['smithi156', 'smithi181']
2021-11-19T06:41:08.513 INFO:teuthology.kill:2021-11-19 06:41:08,513.513 INFO:teuthology.nuke:targets:
2021-11-19T06:41:08.514 INFO:teuthology.kill:  smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDa4REggKpgBaoUAZ8LHXXcZcnzsLFXI0tam8+29h9Xr2p3zit1tKKjQixPugKBl61qgwnZzIRSzaTc6/TJv7ta3CStNUvJZcJPkV+Alw3yXIMw3IZ6TRHderksLRc6YJRGWOl2foJWqUQqIkWy1wB9lpYenDSMBSb/d+pBrrH//Lo+RxJJRpbSWrTetyMooA4A4VGvkmaGtbWMsMRyE36DLXF9c0lsiJtzERnfFbAzac/hkSrcvt8WMMMaS3c16+Wa+XX39cLf7pejZiac0Rj6jS5DKBo9gXNXVGLry/SPPqosnyC71ES+/ZCBMvglpAygqD0Z9MXDz+JGaJtaCo71/Kdl0TSWqzYE1Wz/JAv3i2cmkoPd1SLKQx263Rtf1JxVsV0Ks0E8KuKPiRFW/b8MC0ogZJPIqt4n7/+PjxN4c8jSQKooUr5te446wVP4HjDO/Nmtcr5xSgdXGMPGlxypyCgYnSBNhRo+1vTSzVJg2+MzpADkpkS9EQdkqAxQgik=
2021-11-19T06:41:08.514 INFO:teuthology.kill:  smithi181.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCv8LnM7rMP9ssflRVqzdm3bmWHFPEv7hYIyxOb6AIjtKjxyvH7dBEyaom9SeynZaRHHBPZpheqwxLtooqPxlgE5+bKmU5aRnySM3Q8xCn9lOR0VhWKEpRje+hd0rDBFEiFMkP6OAZUGNkazsuSZrX+yLklNRROzww8ncjLb7wMyMuhx0jqyUuGyUfpx2RgA1lN/itDmDUhoeV+GsZf0iPPyNc3/lYmkCS8noCdt8JY4i0JsJwQGeUXehr+SR7v0u30XUtM4+4p+NUzK//TIFl/uJ00TXgy/gCV0e+TTocBzqivlDVbk5JoRRfqXDBDqzCaJhzLvm3i8Hyct6x+y3HB0/k6dTtG5Th4xLFfo9FSVhyr5vPIa4NxiidOfJmrMyi9swgN09xk0GUDAhj39Uvj9F24az1HudRaVZSIVxPUDgvyTcOlNOmXpiRWRZ+q66Y0XSSJeSA0On36qWjVBLOcOcSWO15FLZd6PNlPqKhZFnpkZMwFN1Cy8Zwb+QutMqE=
2021-11-19T06:41:08.542 INFO:teuthology.kill:2021-11-19 06:41:08,541.541 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-19T06:41:08.548 INFO:teuthology.kill:2021-11-19 06:41:08,548.548 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-19T06:41:08.619 INFO:teuthology.kill:2021-11-19 06:41:08,618.618 INFO:teuthology.orchestra.console:Power off smithi156
2021-11-19T06:41:08.634 INFO:teuthology.kill:2021-11-19 06:41:08,634.634 INFO:teuthology.orchestra.console:Power off smithi181
2021-11-19T06:41:16.997 INFO:teuthology.kill:2021-11-19 06:41:16,997.997 INFO:teuthology.orchestra.console:Power off for smithi156 completed
2021-11-19T06:41:17.002 INFO:teuthology.kill:2021-11-19 06:41:17,002.002 INFO:teuthology.orchestra.console:Power off for smithi181 completed
2021-11-19T06:41:17.159 INFO:teuthology.kill:2021-11-19 06:41:17,159.159 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com
2021-11-19T06:41:17.162 INFO:teuthology.kill:2021-11-19 06:41:17,162.162 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com
2021-11-19T06:43:17.413 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-19T06:43:17.561 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi156 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-11-17_12:17:03-powercycle-pacific-distro-default-smithi/6509406