2022-03-22T00:00:53.695 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-22T00:00:53.821 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi083.front.sepia.ceph.com' reimaging
2022-03-22T00:00:53.822 INFO:teuthology.lock.ops:Updating [ubuntu@smithi083.front.sepia.ceph.com]: reset os type and version on server
2022-03-22T00:00:53.822 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server
2022-03-22T00:00:53.841 INFO:teuthology.lock.ops:Node 'ubuntu@smithi083.front.sepia.ceph.com' reimaging is complete
2022-03-22T00:00:53.841 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging
2022-03-22T00:00:53.841 INFO:teuthology.lock.ops:Updating [ubuntu@smithi136.front.sepia.ceph.com]: reset os type and version on server
2022-03-22T00:00:53.842 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2022-03-22T00:00:53.861 INFO:teuthology.lock.ops:Node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging is complete
2022-03-22T00:00:54.054 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of ubuntu 20.04
2022-03-22T00:00:54.065 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of ubuntu 20.04
2022-03-22T00:00:54.372 INFO:teuthology.orchestra.console:Power off smithi083
2022-03-22T00:00:54.388 INFO:teuthology.orchestra.console:Power off smithi136
2022-03-22T00:01:06.864 INFO:teuthology.orchestra.console:Power off for smithi083 completed
2022-03-22T00:01:06.870 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2022-03-22T00:01:06.966 INFO:teuthology.orchestra.console:Power on smithi083
2022-03-22T00:01:06.973 INFO:teuthology.orchestra.console:Power on smithi136
2022-03-22T00:01:15.334 INFO:teuthology.orchestra.console:Power on for smithi083 completed
2022-03-22T00:01:15.339 INFO:teuthology.orchestra.console:Power on for smithi136 completed
2022-03-22T00:01:15.436 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish
2022-03-22T00:01:15.441 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2022-03-22T00:06:17.383 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-22T00:06:17.871 INFO:teuthology.provision.fog.smithi083:Node is ready
2022-03-22T00:06:17.879 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com
2022-03-22T00:06:17.926 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083
2022-03-22T00:06:18.106 INFO:teuthology.provision.fog.smithi083:Deploy complete!
2022-03-22T00:06:18.932 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-22T00:06:19.400 INFO:teuthology.provision.fog.smithi136:Node is ready
2022-03-22T00:06:19.407 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2022-03-22T00:06:19.413 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2022-03-22T00:06:19.579 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2022-03-22T00:06:19.773 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com
2022-03-22T00:06:19.774 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-22T00:06:19.794 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2022-03-22T00:06:19.795 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-22T00:06:19.816 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server
2022-03-22T00:06:19.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com'
2022-03-22T00:06:19.996 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64
2022-03-22T00:06:20.004 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu"
2022-03-22T00:06:20.004 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-03-22T00:06:20.005 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu
2022-03-22T00:06:20.005 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian
2022-03-22T00:06:20.005 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-03-22T00:06:20.005 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="20.04"
2022-03-22T00:06:20.006 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/"
2022-03-22T00:06:20.006 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-03-22T00:06:20.006 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-03-22T00:06:20.006 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-03-22T00:06:20.007 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=focal
2022-03-22T00:06:20.007 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=focal
2022-03-22T00:06:20.009 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server
2022-03-22T00:06:20.029 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2022-03-22T00:06:20.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2022-03-22T00:06:20.207 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2022-03-22T00:06:20.215 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu"
2022-03-22T00:06:20.216 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-03-22T00:06:20.216 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu
2022-03-22T00:06:20.217 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian
2022-03-22T00:06:20.217 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-03-22T00:06:20.218 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="20.04"
2022-03-22T00:06:20.218 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/"
2022-03-22T00:06:20.218 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-03-22T00:06:20.218 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-03-22T00:06:20.218 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-03-22T00:06:20.219 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=focal
2022-03-22T00:06:20.219 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=focal
2022-03-22T00:06:20.219 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2022-03-22T00:06:20.333 INFO:teuthology.dispatcher.supervisor:Running job 6750698
2022-03-22T00:06:20.334 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-03-21_23:56:22-rgw-wip-yuri3-testing-2022-03-21-1228-pacific-distro-default-smithi/6750698 --name yuriw-2022-03-21_23:56:22-rgw-wip-yuri3-testing-2022-03-21-1228-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} -- /home/teuthworker/archive/yuriw-2022-03-21_23:56:22-rgw-wip-yuri3-testing-2022-03-21-1228-pacific-distro-default-smithi/6750698/orig.config.yaml
2022-03-22T00:06:20.339 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-03-21_23:56:22-rgw-wip-yuri3-testing-2022-03-21-1228-pacific-distro-default-smithi/6750698
2022-03-22T00:06:20.340 INFO:teuthology.dispatcher.supervisor:Job PID: 25945
2022-03-22T00:06:20.340 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-22T06:36:49.011 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-22T06:36:49.216 INFO:teuthology.kill:Killing Pids: {25945}
2022-03-22T06:36:50.524 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2022-03-22T06:36:50.525 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2022-03-22T06:36:50.525 INFO:teuthology.misc:Compressing logs...
2022-03-22T06:36:50.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com'
2022-03-22T06:36:50.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2022-03-22T06:36:51.049 INFO:teuthology.misc:Compressing logs...
2022-03-22T06:36:51.177 INFO:teuthology.misc:Compressing logs...
2022-03-22T06:38:59.965 INFO:teuthology.kill:No teuthology processes running
2022-03-22T06:39:01.133 INFO:teuthology.kill:Nuking machines: ['smithi083', 'smithi136']
2022-03-22T06:39:02.138 INFO:teuthology.kill:2022-03-22 06:39:02,137.137 INFO:teuthology.nuke:targets:
2022-03-22T06:39:02.139 INFO:teuthology.kill:  smithi083.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkc7S6DjfiM9BQ3oFJkFyH9mGs0mguMt3vtdh0Bsr/DAZLpay1CHqYnC+V0lsqeUYFAm09i1cmjJSHvCglKhoLrZYIrLZaDQnO2ixt7BD1ZprYJnS2ciRAQcIU9p34eu8XPxkxbvQQ1EDVMD+vooeP5vXg649InrrQxlv9si9g3os2PvbpojdcFI+pnnpPWC8VibxoEHXX1WGcu0nLZvTzkCLKUGOhMWAnfCyr5Tx25Z7Vanpgi6Ed0wzksYz3FBxgL2smTyAN+0e2okrcB6LxKtzVt6gPqLxwyLpXDw29Om0g6Lg+zin9xWBNHuiHczDr9Yuj2o41pDxwrfvd4dJPpHnK5f8aMO1UeVo0UJTvEY8XKYW0HU9x/qDZaMz0BJXuazy4hAaObR4j/q3QZ2Ce6U9OrT7rR+eA57VemsS8lk5IK2qgdRW1Io1Y/Yav5QCI7buUZHJXrKAHmGWDM4EhYfk7jsXQeARNk0MFl3KOXIqUUhn1ULeuCKi3WJh5AeM=
2022-03-22T06:39:02.140 INFO:teuthology.kill:  smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDum7ltxCScrjGnHFYvPx9FVT4EPjqkI6SuVHEBzjTo7x1eDTvWWq8KKykGcGNUvAE76AmvCYTXOMj7nEiPRDusxaROj7Vo6v/dZy0u7ifkeALSNfWtAa8WudTXlHsjgPTCtRfCuuvFM4TVIYvUntBp+oVhW19ThD9zWj5XM2DAR61dMXDjQSLmtjteJheYOwqz5B+LmWqRxhoXMe1YcG23yaa1Qv5nWoC/nOf3bBLEdTZJoKnZQEyFzI5SVtQ6sU7MbZeVI3QhGRh1YUM+x6miGv0UBzP+Vm+1fMjW4ERMy22R32PDKXkFKhdZ09trO3Q/ZGNtnaKbYMCJNrlo+JHz4ae29NSvpWHlGaLEGYvSafpvf6G4lFtjUCUzo02+K/HdT1WrxysPOyw5gjSGFQscojtSI1cjEr5A0pzq4prtyVL3vctQBBAYUluyveMHb5ZRlWy5Jqe2ylTsEGE0zufQm2bX7lq9qh784hoshtcgccI+3wG0tCPNz8jwSrfHhhM=
2022-03-22T06:39:02.167 INFO:teuthology.kill:2022-03-22 06:39:02,167.167 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-22T06:39:02.170 INFO:teuthology.kill:2022-03-22 06:39:02,170.170 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-22T06:39:02.259 INFO:teuthology.kill:2022-03-22 06:39:02,258.258 INFO:teuthology.orchestra.console:Power off smithi083
2022-03-22T06:39:02.276 INFO:teuthology.kill:2022-03-22 06:39:02,276.276 INFO:teuthology.orchestra.console:Power off smithi136
2022-03-22T06:39:10.642 INFO:teuthology.kill:2022-03-22 06:39:10,642.642 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2022-03-22T06:39:10.792 INFO:teuthology.kill:2022-03-22 06:39:10,791.791 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com
2022-03-22T06:39:14.747 INFO:teuthology.kill:2022-03-22 06:39:14,747.747 INFO:teuthology.orchestra.console:Power off for smithi083 completed
2022-03-22T06:39:14.892 INFO:teuthology.kill:2022-03-22 06:39:14,892.892 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com
2022-03-22T06:41:15.230 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-22T06:41:15.334 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi083 but it was locked by another job: /home/teuthworker/archive/rfriedma-2022-03-22_06:20:48-rgw-wip-rf-redo-noscrub-distro-basic-smithi/6752150
2022-03-22T06:41:15.334 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi136 but it was locked by another job: /home/teuthworker/archive/rfriedma-2022-03-22_06:20:48-rgw-wip-rf-redo-noscrub-distro-basic-smithi/6752150