2022-07-21T21:25:14.822 INFO:root:teuthology version: 1.1.1.dev389+g8d598431
2022-07-21T21:25:14.968 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging
2022-07-21T21:25:14.969 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server
2022-07-21T21:25:14.970 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2022-07-21T21:25:14.990 INFO:teuthology.lock.ops:Node 'smithi137.front.sepia.ceph.com' reimaging is complete
2022-07-21T21:25:14.990 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging
2022-07-21T21:25:14.991 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server
2022-07-21T21:25:14.991 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2022-07-21T21:25:15.013 INFO:teuthology.lock.ops:Node 'smithi145.front.sepia.ceph.com' reimaging is complete
2022-07-21T21:25:15.206 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of ubuntu 20.04
2022-07-21T21:25:15.225 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of ubuntu 20.04
2022-07-21T21:25:15.508 INFO:teuthology.orchestra.console:Power off smithi137
2022-07-21T21:25:15.525 INFO:teuthology.orchestra.console:Power off smithi145
2022-07-21T21:25:23.881 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2022-07-21T21:25:23.982 INFO:teuthology.orchestra.console:Power on smithi137
2022-07-21T21:25:27.999 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2022-07-21T21:25:28.101 INFO:teuthology.orchestra.console:Power on smithi145
2022-07-21T21:25:32.343 INFO:teuthology.orchestra.console:Power on for smithi137 completed
2022-07-21T21:25:32.352 INFO:teuthology.orchestra.console:Power on for smithi145 completed
2022-07-21T21:25:32.445 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish
2022-07-21T21:25:32.454 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish
2022-07-21T21:30:23.639 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-21T21:30:24.179 INFO:teuthology.provision.fog.smithi137:Node is ready
2022-07-21T21:30:24.186 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com
2022-07-21T21:30:24.192 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137
2022-07-21T21:30:24.364 INFO:teuthology.provision.fog.smithi137:Deploy complete!
2022-07-21T21:30:30.814 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-21T21:30:31.280 INFO:teuthology.provision.fog.smithi145:Node is ready
2022-07-21T21:30:31.287 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com
2022-07-21T21:30:31.294 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145
2022-07-21T21:30:31.520 INFO:teuthology.provision.fog.smithi145:Deploy complete!
2022-07-21T21:30:31.728 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com
2022-07-21T21:30:31.729 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-21T21:30:31.749 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com
2022-07-21T21:30:31.749 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-21T21:30:31.769 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server
2022-07-21T21:30:31.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com'
2022-07-21T21:30:32.036 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64
2022-07-21T21:30:32.044 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Ubuntu"
2022-07-21T21:30:32.044 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-07-21T21:30:32.044 INFO:teuthology.orchestra.run.smithi137.stdout:ID=ubuntu
2022-07-21T21:30:32.045 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE=debian
2022-07-21T21:30:32.045 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-07-21T21:30:32.045 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="20.04"
2022-07-21T21:30:32.046 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.ubuntu.com/"
2022-07-21T21:30:32.046 INFO:teuthology.orchestra.run.smithi137.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-07-21T21:30:32.046 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-07-21T21:30:32.047 INFO:teuthology.orchestra.run.smithi137.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-07-21T21:30:32.047 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_CODENAME=focal
2022-07-21T21:30:32.047 INFO:teuthology.orchestra.run.smithi137.stdout:UBUNTU_CODENAME=focal
2022-07-21T21:30:32.049 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2022-07-21T21:30:32.068 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server
2022-07-21T21:30:32.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com'
2022-07-21T21:30:32.286 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64
2022-07-21T21:30:32.293 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Ubuntu"
2022-07-21T21:30:32.293 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-07-21T21:30:32.293 INFO:teuthology.orchestra.run.smithi145.stdout:ID=ubuntu
2022-07-21T21:30:32.294 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE=debian
2022-07-21T21:30:32.294 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-07-21T21:30:32.294 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="20.04"
2022-07-21T21:30:32.294 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.ubuntu.com/"
2022-07-21T21:30:32.295 INFO:teuthology.orchestra.run.smithi145.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-07-21T21:30:32.295 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-07-21T21:30:32.295 INFO:teuthology.orchestra.run.smithi145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-07-21T21:30:32.295 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_CODENAME=focal
2022-07-21T21:30:32.296 INFO:teuthology.orchestra.run.smithi145.stdout:UBUNTU_CODENAME=focal
2022-07-21T21:30:32.296 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2022-07-21T21:30:32.388 INFO:teuthology.dispatcher.supervisor:Running job 6943116
2022-07-21T21:30:32.389 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_8d598431210977f8caccec83230b4bfec7bd5d3f/virtualenv/bin/teuthology -v --owner scheduled_dgalloway@teuthology --archive /home/teuthworker/archive/dgalloway-2022-07-21_20:58:54-rgw-pacific-distro-default-smithi/6943116 --name dgalloway-2022-07-21_20:58:54-rgw-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} -- /home/teuthworker/archive/dgalloway-2022-07-21_20:58:54-rgw-pacific-distro-default-smithi/6943116/orig.config.yaml
2022-07-21T21:30:32.394 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dgalloway-2022-07-21_20:58:54-rgw-pacific-distro-default-smithi/6943116
2022-07-21T21:30:32.395 INFO:teuthology.dispatcher.supervisor:Job PID: 8654
2022-07-21T21:30:32.395 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-07-22T09:31:39.575 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-07-22T09:31:39.880 INFO:teuthology.kill:Killing Pids: {8654}
2022-07-22T09:31:41.976 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2022-07-22T09:31:41.977 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2022-07-22T09:31:41.978 INFO:teuthology.misc:Compressing logs...
2022-07-22T09:31:41.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com'
2022-07-22T09:31:42.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com'
2022-07-22T09:31:42.693 INFO:teuthology.misc:Compressing logs...
2022-07-22T09:31:42.845 INFO:teuthology.misc:Compressing logs...
2022-07-22T09:31:50.762 INFO:teuthology.kill:No teuthology processes running
2022-07-22T09:31:53.427 INFO:teuthology.kill:Nuking machines: ['smithi137', 'smithi145']
2022-07-22T09:31:55.178 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_8d598431210977f8caccec83230b4bfec7bd5d3f/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-07-22T09:31:55.179 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-07-22T09:31:55.179 INFO:teuthology.kill:2022-07-22 09:31:55,177.177 INFO:teuthology.nuke:targets:
2022-07-22T09:31:55.180 INFO:teuthology.kill:  smithi137.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4wR4TVmnVm7pchOSSekblp4/vkqN+N3eGzvIUZXhwiiU5KF7ojLj/qAlPXc+DdtDDk9KYge9nDgRnDmCzYbCx7YYUZAodsCKhbAfFMybFk+z0qD5EkJjjKaaZ4vIfIw2+P5bPZq5xAhfRVQeTRmABL9z79q744pI8URqo4BucAgX+6WMOxGU8FqcgvfexNtnSYq8VGoC6aWf905C4Zp/W4/PHac/xqMG+dfjMtkgargimOZl/EXHLTaNJi0hq9NZ2oauNbyQ6I7K28O0opFK37FfA7vPeQA9oQ761yP79GZT8Iuiv40nYl7cjm9lAD0KfGlkFWkY6ZrV0JfAKo9VGYMy7vFHyuBPor9WVwU6RcW+EAoJoz7b13Dhc9dxV3C1Ml6csol4QJDJqV+uF6xoqu9j5ICyQ1pkOkFSCa7ySCmnFPbIwZTojUUdUYfofBi6xwnRUJ6egzkeCWtvWfQo/EiW34qeMfcfC5dkiyGYb7nZkJ1r0RJBICh8Iq3TcVe8=
2022-07-22T09:31:55.180 INFO:teuthology.kill:  smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKroEQobqS1lxwr866t2krmj6tOIChrwHOWJVERBPaSJZiaoynDPS6qZQoFC4M6Elnx9b11SUm5rnxV+Z44PgmW/cP1dPEeNiZ8C9+8gJhvDTQiqNe8Y6UetWfSv0xgE9E4zhAGmdk/PNBj1DBF/fBvG111twQZx4nVyzNTV9v5Ijq6EJbYqz3XyTV4QyqfzrRjHdnZLsHJ/X+bEbIJKLjb1NNicuQt5welg9GN10uNxPacwEPRiK9NmA31yPupsavQS/7D0FPsNukZAHjfNEVB8kPelXrY02RfqZpKc3B/55675fgeF3WQOUEFIlAQGT9BBn6MVy0Ur3iHUmRKTLHF3uqv0ck8mPI+ktghS0BSgUpQZt37wWUqzG0Rksj15wja2UtT2Fdr13WYH3VEvr33ME8IP9rj8+fVBnzIuUsHUQgbYx7AFkcBROFxdmTOFkwq8ccHSm5SCaJouQUxrhU6VThfe6GwmUqtoRui/Zy6BcToufhYIpBY3SeM7kUl9M=
2022-07-22T09:31:55.180 INFO:teuthology.kill:2022-07-22 09:31:55,178.178 INFO:teuthology.nuke:Checking targets against current locks
2022-07-22T09:31:55.248 INFO:teuthology.kill:2022-07-22 09:31:55,248.248 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-22T09:31:55.275 INFO:teuthology.kill:2022-07-22 09:31:55,274.274 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-22T09:31:55.339 INFO:teuthology.kill:2022-07-22 09:31:55,339.339 INFO:teuthology.orchestra.console:Power off smithi137
2022-07-22T09:31:55.383 INFO:teuthology.kill:2022-07-22 09:31:55,383.383 INFO:teuthology.orchestra.console:Power off smithi145
2022-07-22T09:32:03.736 INFO:teuthology.kill:2022-07-22 09:32:03,736.736 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2022-07-22T09:32:03.926 INFO:teuthology.kill:2022-07-22 09:32:03,924.924 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com
2022-07-22T09:32:07.895 INFO:teuthology.kill:2022-07-22 09:32:07,894.894 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2022-07-22T09:32:08.064 INFO:teuthology.kill:2022-07-22 09:32:08,064.064 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com
2022-07-22T09:34:08.519 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-07-22T09:34:08.653 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi137 but it was locked by another job: /home/teuthworker/archive/pdonnell-2022-07-22_03:35:24-fs-wip-pdonnell-testing-20220721.235756-distro-default-smithi/6944148
2022-07-22T09:34:08.653 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi145 but it was locked by another job: /home/teuthworker/archive/pdonnell-2022-07-22_03:35:24-fs-wip-pdonnell-testing-20220721.235756-distro-default-smithi/6944148