2022-08-19T00:18:02.739 INFO:root:teuthology version: 1.1.1.dev412+gb1d387f1
2022-08-19T00:18:02.873 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging
2022-08-19T00:18:02.874 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server
2022-08-19T00:18:02.874 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2022-08-19T00:18:02.896 INFO:teuthology.lock.ops:Node 'smithi078.front.sepia.ceph.com' reimaging is complete
2022-08-19T00:18:02.897 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging
2022-08-19T00:18:02.897 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server
2022-08-19T00:18:02.897 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2022-08-19T00:18:02.917 INFO:teuthology.lock.ops:Node 'smithi183.front.sepia.ceph.com' reimaging is complete
2022-08-19T00:18:03.127 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of ubuntu 20.04
2022-08-19T00:18:03.129 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of ubuntu 20.04
2022-08-19T00:18:03.518 INFO:teuthology.orchestra.console:Power off smithi078
2022-08-19T00:18:03.533 INFO:teuthology.orchestra.console:Power off smithi183
2022-08-19T00:18:11.901 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2022-08-19T00:18:12.003 INFO:teuthology.orchestra.console:Power on smithi183
2022-08-19T00:18:16.008 INFO:teuthology.orchestra.console:Power off for smithi078 completed
2022-08-19T00:18:16.111 INFO:teuthology.orchestra.console:Power on smithi078
2022-08-19T00:18:20.370 INFO:teuthology.orchestra.console:Power on for smithi183 completed
2022-08-19T00:18:20.472 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2022-08-19T00:18:24.489 INFO:teuthology.orchestra.console:Power on for smithi078 completed
2022-08-19T00:18:24.590 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish
2022-08-19T00:23:20.831 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-08-19T00:23:21.350 INFO:teuthology.provision.fog.smithi183:Node is ready
2022-08-19T00:23:21.398 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com
2022-08-19T00:23:21.406 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2022-08-19T00:23:21.549 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2022-08-19T00:23:21.852 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-08-19T00:23:22.382 INFO:teuthology.provision.fog.smithi078:Node is ready
2022-08-19T00:23:22.388 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com
2022-08-19T00:23:22.396 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078
2022-08-19T00:23:22.610 INFO:teuthology.provision.fog.smithi078:Deploy complete!
2022-08-19T00:23:22.846 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com
2022-08-19T00:23:22.847 INFO:teuthology.lock.ops:New key found. Updating...
2022-08-19T00:23:22.869 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2022-08-19T00:23:22.869 INFO:teuthology.lock.ops:New key found. Updating...
2022-08-19T00:23:22.889 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server
2022-08-19T00:23:22.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com'
2022-08-19T00:23:23.113 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64
2022-08-19T00:23:23.118 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu"
2022-08-19T00:23:23.119 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-08-19T00:23:23.119 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu
2022-08-19T00:23:23.119 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian
2022-08-19T00:23:23.120 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-08-19T00:23:23.120 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="20.04"
2022-08-19T00:23:23.121 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/"
2022-08-19T00:23:23.121 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-08-19T00:23:23.122 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-08-19T00:23:23.122 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-08-19T00:23:23.122 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=focal
2022-08-19T00:23:23.123 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=focal
2022-08-19T00:23:23.124 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2022-08-19T00:23:23.143 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2022-08-19T00:23:23.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2022-08-19T00:23:23.378 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2022-08-19T00:23:23.385 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu"
2022-08-19T00:23:23.386 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-08-19T00:23:23.386 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu
2022-08-19T00:23:23.387 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian
2022-08-19T00:23:23.387 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-08-19T00:23:23.387 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="20.04"
2022-08-19T00:23:23.388 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/"
2022-08-19T00:23:23.388 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-08-19T00:23:23.388 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-08-19T00:23:23.389 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-08-19T00:23:23.389 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=focal
2022-08-19T00:23:23.390 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=focal
2022-08-19T00:23:23.390 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2022-08-19T00:23:23.488 INFO:teuthology.dispatcher.supervisor:Running job 6979647
2022-08-19T00:23:23.489 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2022-08-18_23:33:15-rgw-wip-cbodley-testing-distro-default-smithi/6979647 --name cbodley-2022-08-18_23:33:15-rgw-wip-cbodley-testing-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2022-08-18_23:33:15-rgw-wip-cbodley-testing-distro-default-smithi/6979647/orig.config.yaml
2022-08-19T00:23:23.494 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2022-08-18_23:33:15-rgw-wip-cbodley-testing-distro-default-smithi/6979647
2022-08-19T00:23:23.495 INFO:teuthology.dispatcher.supervisor:Job PID: 32131
2022-08-19T00:23:23.495 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-08-19T12:24:19.959 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-08-19T12:24:20.128 INFO:teuthology.kill:Killing Pids: {32131}
2022-08-19T12:24:21.650 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2022-08-19T12:24:21.651 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2022-08-19T12:24:21.651 INFO:teuthology.misc:Compressing logs...
2022-08-19T12:24:21.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com'
2022-08-19T12:24:22.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2022-08-19T12:24:22.844 INFO:teuthology.misc:Compressing logs...
2022-08-19T12:24:23.044 INFO:teuthology.misc:Compressing logs...
2022-08-19T12:49:52.639 INFO:teuthology.kill:No teuthology processes running
2022-08-19T12:49:54.116 INFO:teuthology.kill:Nuking machines: ['smithi078', 'smithi183']
2022-08-19T12:49:55.309 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-08-19T12:49:55.310 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-08-19T12:49:55.311 INFO:teuthology.kill:2022-08-19 12:49:55,309.309 INFO:teuthology.nuke:targets:
2022-08-19T12:49:55.311 INFO:teuthology.kill:  smithi078.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGCXHTgFIzPQWYSeuJ3meihWbyE1m9ihaaexTFhhXZXO
2022-08-19T12:49:55.311 INFO:teuthology.kill:  smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCucWYmTO75IC56Z+Aw1F0kMwyxvke6bOC1KgH9FZ366V3FpDysYtxFVf5SIjnkgZ5MNTcELuZdcRgi0LkXOBZG/E5Y25s2d5DLE6LiMk8vS6DsO8g7g1KisgzLoi9MQqgTsWOWQ6NUMgxDuBYxLrWtawjBV+JmEiNp4wQy8BSaQcqRmFEX+kQCz/9C9ihflXgCNRHxFt0zIfhuZfAZCkbnoZNWWQHYTnUwAgW513lTAgkxKlpNHi8CcEN5mnA0an1CfADH83WW4rztSxxYxMMShSN1acJSCh7kycWlpSsss8iPuFmYhEx4ejUxnO+h0mPZwxgfr3npEg4FiCr0ob3sM/+EprfgQMwpQzbqVv4qFBEEEzgMZbyaSmocgcOlErHA0gFgSUgNGriCumGXruj2h0u15KdLZiStE7MXCXT5ObuHhRb9j+BfTVfOL3fWc+ge7Ooe9PaO1tByOJmUd/TFT2JcSVINxGjPEv7xo3WAUWlDXOh6Sno/JLLC6XTd24s=
2022-08-19T12:49:55.312 INFO:teuthology.kill:2022-08-19 12:49:55,310.310 INFO:teuthology.nuke:Checking targets against current locks
2022-08-19T12:49:55.378 INFO:teuthology.kill:2022-08-19 12:49:55,378.378 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-08-19T12:49:55.405 INFO:teuthology.kill:2022-08-19 12:49:55,405.405 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-08-19T12:49:55.479 INFO:teuthology.kill:2022-08-19 12:49:55,478.478 INFO:teuthology.orchestra.console:Power off smithi078
2022-08-19T12:49:55.538 INFO:teuthology.kill:2022-08-19 12:49:55,538.538 INFO:teuthology.orchestra.console:Power off smithi183
2022-08-19T12:50:03.924 INFO:teuthology.kill:2022-08-19 12:50:03,924.924 INFO:teuthology.orchestra.console:Power off for smithi078 completed
2022-08-19T12:50:03.939 INFO:teuthology.kill:2022-08-19 12:50:03,938.938 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2022-08-19T12:50:04.082 INFO:teuthology.kill:2022-08-19 12:50:04,081.081 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com
2022-08-19T12:50:04.087 INFO:teuthology.kill:2022-08-19 12:50:04,087.087 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com
2022-08-19T12:52:04.473 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-08-19T12:52:04.582 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi078 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-08-16_04:17:04-fs-pacific-distro-default-smithi/6974824
2022-08-19T12:52:04.582 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi183 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-08-16_04:17:04-fs-pacific-distro-default-smithi/6974824