2022-05-05T02:50:49.154 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-05T02:50:49.321 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging 2022-05-05T02:50:49.322 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server 2022-05-05T02:50:49.322 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2022-05-05T02:50:49.340 INFO:teuthology.lock.ops:Node 'smithi037.front.sepia.ceph.com' reimaging is complete 2022-05-05T02:50:49.341 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging 2022-05-05T02:50:49.341 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server 2022-05-05T02:50:49.341 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2022-05-05T02:50:49.358 INFO:teuthology.lock.ops:Node 'smithi061.front.sepia.ceph.com' reimaging is complete 2022-05-05T02:50:49.615 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of ubuntu 20.04 2022-05-05T02:50:49.651 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of ubuntu 20.04 2022-05-05T02:50:50.024 INFO:teuthology.orchestra.console:Power off smithi037 2022-05-05T02:50:50.115 INFO:teuthology.orchestra.console:Power off smithi061 2022-05-05T02:50:58.397 INFO:teuthology.orchestra.console:Power off for smithi037 completed 2022-05-05T02:50:58.498 INFO:teuthology.orchestra.console:Power on smithi037 2022-05-05T02:51:02.596 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2022-05-05T02:51:02.698 INFO:teuthology.orchestra.console:Power on smithi061 2022-05-05T02:51:06.872 INFO:teuthology.orchestra.console:Power on for smithi037 completed 2022-05-05T02:51:06.944 INFO:teuthology.orchestra.console:Power on for smithi061 completed 2022-05-05T02:51:06.973 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2022-05-05T02:51:07.044 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish 2022-05-05T02:53:38.008 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: Authentication failed. 2022-05-05T02:55:27.552 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-05T02:55:28.040 INFO:teuthology.provision.fog.smithi037:Node is ready 2022-05-05T02:55:28.046 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com 2022-05-05T02:55:28.054 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037 2022-05-05T02:55:28.244 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2022-05-05T02:56:15.033 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-05T02:56:15.591 INFO:teuthology.provision.fog.smithi061:Node is ready 2022-05-05T02:56:15.597 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com 2022-05-05T02:56:15.604 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061 2022-05-05T02:56:15.747 INFO:teuthology.provision.fog.smithi061:Deploy complete! 2022-05-05T02:56:15.931 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2022-05-05T02:56:15.932 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-05T02:56:15.950 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com 2022-05-05T02:56:15.950 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-05T02:56:15.970 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2022-05-05T02:56:15.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2022-05-05T02:56:16.194 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2022-05-05T02:56:16.201 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu" 2022-05-05T02:56:16.201 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-05-05T02:56:16.201 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu 2022-05-05T02:56:16.201 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian 2022-05-05T02:56:16.202 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-05-05T02:56:16.202 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="20.04" 2022-05-05T02:56:16.202 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-05T02:56:16.202 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-05T02:56:16.203 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-05T02:56:16.203 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-05T02:56:16.203 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=focal 2022-05-05T02:56:16.203 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=focal 2022-05-05T02:56:16.204 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2022-05-05T02:56:16.224 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server 2022-05-05T02:56:16.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2022-05-05T02:56:16.490 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2022-05-05T02:56:16.496 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Ubuntu" 2022-05-05T02:56:16.496 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-05-05T02:56:16.497 INFO:teuthology.orchestra.run.smithi061.stdout:ID=ubuntu 2022-05-05T02:56:16.497 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE=debian 2022-05-05T02:56:16.497 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-05-05T02:56:16.497 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="20.04" 2022-05-05T02:56:16.497 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-05T02:56:16.498 INFO:teuthology.orchestra.run.smithi061.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-05T02:56:16.498 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-05T02:56:16.498 INFO:teuthology.orchestra.run.smithi061.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-05T02:56:16.498 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_CODENAME=focal 2022-05-05T02:56:16.499 INFO:teuthology.orchestra.run.smithi061.stdout:UBUNTU_CODENAME=focal 2022-05-05T02:56:16.499 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2022-05-05T02:56:16.590 INFO:teuthology.dispatcher.supervisor:Running job 6821947 2022-05-05T02:56:16.591 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-05-04_21:15:25-rgw-pacific-distro-default-smithi/6821947 --name yuriw-2022-05-04_21:15:25-rgw-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} -- /home/teuthworker/archive/yuriw-2022-05-04_21:15:25-rgw-pacific-distro-default-smithi/6821947/orig.config.yaml 2022-05-05T02:56:16.594 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-05-04_21:15:25-rgw-pacific-distro-default-smithi/6821947 2022-05-05T02:56:16.595 INFO:teuthology.dispatcher.supervisor:Job PID: 32201 2022-05-05T02:56:16.595 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-05T09:26:27.501 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-05T09:26:27.817 INFO:teuthology.kill:Killing Pids: {32201} 2022-05-05T09:26:29.268 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2022-05-05T09:26:29.269 INFO:teuthology.task.internal:roles: ubuntu@smithi061.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2022-05-05T09:26:29.270 INFO:teuthology.misc:Compressing logs... 2022-05-05T09:26:29.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2022-05-05T09:26:29.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2022-05-05T09:26:29.825 INFO:teuthology.misc:Compressing logs... 2022-05-05T09:26:29.948 INFO:teuthology.misc:Compressing logs... 2022-05-05T09:28:40.999 INFO:teuthology.kill:No teuthology processes running 2022-05-05T09:28:42.389 INFO:teuthology.kill:Nuking machines: ['smithi037', 'smithi061'] 2022-05-05T09:28:43.563 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-05T09:28:43.564 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-05T09:28:43.564 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-05T09:28:43.564 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-05T09:28:43.565 INFO:teuthology.kill:2022-05-05 09:28:43,562.562 INFO:teuthology.nuke:targets: 2022-05-05T09:28:43.565 INFO:teuthology.kill: smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSi9RMMP4+sYYfgYjf69xQInDLrOTcYnogolQGOT/5jRkCJ9Xzx/JpX311OOidjnWZv02ApafH3MXktF76WlXuP25To5FrVOSXD79z8DCYMQCEzo8zRo3wFIWOkGZjDgmzAPtB/9eigIbD2hmEWUR0Lta0/RivNiRctU1UpqCSfS2qMkgoYCSoBCIrYk2mOHyn3UEeWueLqiwEJfcTMCHLtJWrWDuod5fr9Z/TFfCUguUsy9FeRcoHta3aWQ3jljJ8AVA5ERSR31e2983hnJpL3RXDe2xJfUos+yALun0T8Y4eZPFXqvrhfMn4KkRIyht+qXr2M9g6iq0vhzGEVjKTp29QNUTTnYaBQDNmVsN9XZtKt4h5+NJt+i/ZL/4qF5tApcxfBH44Mj0ZNjyDudcQQ3hHpuowY9VtEZS0D9rBfO8b1FUBC+T5crUl2h4kcKIrlhcH0AAQQmKzD+PZ7aJLhMzmkM6Rg9YLlg/FcMkoVv31o+3LLx9iw3hRHjqFK/0= 2022-05-05T09:28:43.565 INFO:teuthology.kill: smithi061.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6/Oqk88lnpiMxrDo9gQrhhojqZDys4wRvsQW/2w1z0vs0ymXj8krYaJOd9qV9rVC43jF+o3loNwsuYzqhOWKj2vHzS0cp4lPw+5/QP6SjjEy30UUi9M3kwnbhpJuXj3cDA/kfkc9rzkZVq+Rf2OGMT6dwXlxoiSxvgw0PqR5fKVu4M6AWJgHDhMNOHPvx9b7xouXw4+yblZ2GhQcGynYtc7mgN/S1VZoRWHnWSI/P0A7ifyjkmQagZB3N7HI5/yiSCro8tivdeDYP1BvJqZ0ozk5b/tR21vwKV5iDKAGbSiTGnZ+W7ddeVCNFMa/MLsMd2ZCHk92/TlOHmZ9MG4jCjdToGPNOJagD+H5lnPAjrjPH3X5cFCwoSa3R6IPYtNFL2T5y/iC5299wssLFih7jfp336NCZncvuPPMnwTtB9hN9mXMoUDqMaIXCRFx8XCClmXyYDaVGDUE35YGcz1Wpni/9fLkvyX0bOc8rYEhg3USvFqpwcUzacmEp0DyFesc= 2022-05-05T09:28:43.599 INFO:teuthology.kill:2022-05-05 09:28:43,599.599 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-05T09:28:43.606 INFO:teuthology.kill:2022-05-05 09:28:43,606.606 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-05T09:28:43.716 INFO:teuthology.kill:2022-05-05 09:28:43,716.716 INFO:teuthology.orchestra.console:Power off smithi061 2022-05-05T09:28:43.736 INFO:teuthology.kill:2022-05-05 09:28:43,736.736 INFO:teuthology.orchestra.console:Power off smithi037 2022-05-05T09:28:52.129 INFO:teuthology.kill:2022-05-05 09:28:52,129.129 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2022-05-05T09:28:52.276 INFO:teuthology.kill:2022-05-05 09:28:52,276.276 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com 2022-05-05T09:28:56.245 INFO:teuthology.kill:2022-05-05 09:28:56,244.244 INFO:teuthology.orchestra.console:Power off for smithi037 completed 2022-05-05T09:28:56.391 INFO:teuthology.kill:2022-05-05 09:28:56,391.391 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com 2022-05-05T09:30:56.620 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-05T09:30:56.708 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi037 but it was locked by another job: /home/teuthworker/archive/soumyakoduri-2022-05-05_09:26:28-rgw:cloud-transition-wip-skoduri-dbstore-vstart-distro-basic-smithi/6822869 2022-05-05T09:30:56.709 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi061 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-05-04_21:20:09-rbd-pacific-distro-default-smithi/6822328