2022-05-05T14:19:10.901 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-05T14:19:11.066 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2022-05-05T14:19:11.067 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2022-05-05T14:19:11.068 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2022-05-05T14:19:11.087 INFO:teuthology.lock.ops:Node 'smithi073.front.sepia.ceph.com' reimaging is complete 2022-05-05T14:19:11.088 INFO:teuthology.lock.ops:Start node 'smithi166.front.sepia.ceph.com' reimaging 2022-05-05T14:19:11.088 INFO:teuthology.lock.ops:Updating [smithi166.front.sepia.ceph.com]: reset os type and version on server 2022-05-05T14:19:11.088 INFO:teuthology.lock.ops:Updating smithi166.front.sepia.ceph.com on lock server 2022-05-05T14:19:11.107 INFO:teuthology.lock.ops:Node 'smithi166.front.sepia.ceph.com' reimaging is complete 2022-05-05T14:19:11.360 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of ubuntu 20.04 2022-05-05T14:19:11.383 INFO:teuthology.provision.fog.smithi166:Scheduling deploy of ubuntu 20.04 2022-05-05T14:19:11.982 INFO:teuthology.orchestra.console:Power off smithi166 2022-05-05T14:19:12.103 INFO:teuthology.orchestra.console:Power off smithi073 2022-05-05T14:19:12.120 INFO:teuthology.orchestra.console:Power off for smithi166 completed 2022-05-05T14:19:12.221 INFO:teuthology.orchestra.console:Power on smithi166 2022-05-05T14:19:12.248 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2022-05-05T14:19:12.350 INFO:teuthology.orchestra.console:Power on smithi073 2022-05-05T14:19:16.475 INFO:teuthology.orchestra.console:Power on for smithi166 completed 2022-05-05T14:19:16.577 INFO:teuthology.provision.fog.smithi166:Waiting for deploy to finish 2022-05-05T14:19:16.600 INFO:teuthology.orchestra.console:Power on for smithi073 completed 2022-05-05T14:19:16.701 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2022-05-05T14:24:16.487 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-05T14:24:17.034 INFO:teuthology.provision.fog.smithi166:Node is ready 2022-05-05T14:24:17.041 INFO:teuthology.orchestra.run.smithi166.stdout:smithi166.front.sepia.ceph.com 2022-05-05T14:24:17.048 INFO:teuthology.orchestra.run.smithi166.stdout:172.21.15.166 smithi166.front.sepia.ceph.com smithi166 2022-05-05T14:24:17.261 INFO:teuthology.provision.fog.smithi166:Deploy complete! 2022-05-05T14:24:25.714 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-05T14:24:26.253 INFO:teuthology.provision.fog.smithi073:Node is ready 2022-05-05T14:24:26.261 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com 2022-05-05T14:24:26.317 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2022-05-05T14:24:26.558 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2022-05-05T14:24:26.754 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2022-05-05T14:24:26.755 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-05T14:24:26.781 INFO:teuthology.lock.ops:Checking smithi166.front.sepia.ceph.com 2022-05-05T14:24:26.782 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-05T14:24:26.807 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2022-05-05T14:24:26.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2022-05-05T14:24:27.105 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2022-05-05T14:24:27.113 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu" 2022-05-05T14:24:27.114 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-05-05T14:24:27.115 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu 2022-05-05T14:24:27.115 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian 2022-05-05T14:24:27.116 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-05-05T14:24:27.116 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="20.04" 2022-05-05T14:24:27.116 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-05T14:24:27.117 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-05T14:24:27.117 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-05T14:24:27.118 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-05T14:24:27.118 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=focal 2022-05-05T14:24:27.120 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=focal 2022-05-05T14:24:27.129 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2022-05-05T14:24:27.154 INFO:teuthology.lock.ops:Updating [smithi166.front.sepia.ceph.com]: set os type and version on server 2022-05-05T14:24:27.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi166.front.sepia.ceph.com' 2022-05-05T14:24:27.416 INFO:teuthology.orchestra.run.smithi166.stdout:x86_64 2022-05-05T14:24:27.425 INFO:teuthology.orchestra.run.smithi166.stdout:NAME="Ubuntu" 2022-05-05T14:24:27.428 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-05-05T14:24:27.429 INFO:teuthology.orchestra.run.smithi166.stdout:ID=ubuntu 2022-05-05T14:24:27.434 INFO:teuthology.orchestra.run.smithi166.stdout:ID_LIKE=debian 2022-05-05T14:24:27.434 INFO:teuthology.orchestra.run.smithi166.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-05-05T14:24:27.434 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION_ID="20.04" 2022-05-05T14:24:27.435 INFO:teuthology.orchestra.run.smithi166.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-05T14:24:27.435 INFO:teuthology.orchestra.run.smithi166.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-05T14:24:27.435 INFO:teuthology.orchestra.run.smithi166.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-05T14:24:27.436 INFO:teuthology.orchestra.run.smithi166.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-05T14:24:27.436 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION_CODENAME=focal 2022-05-05T14:24:27.436 INFO:teuthology.orchestra.run.smithi166.stdout:UBUNTU_CODENAME=focal 2022-05-05T14:24:27.437 INFO:teuthology.lock.ops:Updating smithi166.front.sepia.ceph.com on lock server 2022-05-05T14:24:27.588 INFO:teuthology.dispatcher.supervisor:Running job 6823142 2022-05-05T14:24:27.589 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-05-05_14:18:30-rgw-pacific-distro-default-smithi/6823142 --name yuriw-2022-05-05_14:18:30-rgw-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} -- /home/teuthworker/archive/yuriw-2022-05-05_14:18:30-rgw-pacific-distro-default-smithi/6823142/orig.config.yaml 2022-05-05T14:24:27.602 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-05-05_14:18:30-rgw-pacific-distro-default-smithi/6823142 2022-05-05T14:24:27.603 INFO:teuthology.dispatcher.supervisor:Job PID: 30774 2022-05-05T14:24:27.603 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-05T20:54:56.355 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-05T20:54:56.529 INFO:teuthology.kill:Killing Pids: {30774} 2022-05-05T20:54:58.027 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2022-05-05T20:54:58.028 INFO:teuthology.task.internal:roles: ubuntu@smithi166.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2022-05-05T20:54:58.029 INFO:teuthology.misc:Compressing logs... 2022-05-05T20:54:58.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2022-05-05T20:54:58.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi166.front.sepia.ceph.com' 2022-05-05T20:54:58.668 INFO:teuthology.misc:Compressing logs... 2022-05-05T20:54:58.791 INFO:teuthology.misc:Compressing logs... 2022-05-05T20:55:06.442 INFO:teuthology.kill:No teuthology processes running 2022-05-05T20:55:07.775 INFO:teuthology.kill:Nuking machines: ['smithi073', 'smithi166'] 2022-05-05T20:55:09.045 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-05T20:55:09.046 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-05T20:55:09.047 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-05T20:55:09.047 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-05T20:55:09.047 INFO:teuthology.kill:2022-05-05 20:55:09,045.045 INFO:teuthology.nuke:targets: 2022-05-05T20:55:09.048 INFO:teuthology.kill: smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYlrQMovFnI3tCj+EuVzonAgVkAhN7hB2wttRHqfxjL3OxFfIcoSd/kALoKb5XOmsz4GhLLNLVjt6ueNlS7WZmLzjk/LwSfyo1HwPqSzKSIBF084Rk1uAd9Xut0cplQ2HXVYTBirBNV3Rcgr7R/uMtORyKMCcd6PQJzKMVzGXECeuqLo7gnaKNBo/ZW9a5L8OdwkZrbXcI7KhYaV3/HZiQrM6uYalX4UtBDV9mcFZ5ecny0obSZPLC1f/kBJd+mRCYRXgzR8VVsKKDIxbB6Tr+y31Vp5Bh3pbp6fKXG8TmAWkaKj8hZKZt0bdYDjlyZgZPv5Q0at2swOudHVNAWQMCOeLzMRU47nzbHjraUFNl1bWmKmM3WGsEHgVwFeAKEIJUau+Qwvb/PJZBfY4HLAUfCXqd0VTMN7ww3nrc9a5gHiAw2124TBnGmSakkFeEz4N3AJyEWZaLRqkXdTm8COfdAOVOoWNKZQkvppDRZY2xnNyRgiRqVob2XvxCzSLIfPc= 2022-05-05T20:55:09.048 INFO:teuthology.kill: smithi166.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUZJFdauPob3GdffLRuDW5WdsqrkG9h/oGagJ7BdWTS6wAZCP9iVwuAxvQ86Sd2yEBohMCU+hqzGaSnYbUAAFBAHST/SMFNZRTr8wvMqPsv45SLtxbRXhKTK8Ox4ZFRYaeeJ1xe5EwDqjdVVURN4RTzc37BU2gCZKx9m/Gg96QnUes2jc61kx6jqTJSh385DDfpCWLWocrvA3x69jLS6h9rrUnwzFzFskgQPQh4+z4piPbs46mipR4Tadex8Ku/5DeJFJyd0wJjNv4jfJz1SWzY6V0zCN79LAIF0YtmIOg7Jy8nY2mbMyvMF+HoLDLTrsrLp11t6Z4ZZ8PfG8v3cmf5zb4ur1AmLJ24vbDMJyLJ7TlYuj0U5Vn2k1z/37ODu3+bJMjYH7lz2KbDw38hNfwI9w/kGkRRpZmCS6WVnhgE6ip+E+0D+Vlld3q86NMrMe7OvqcWm1UwM7Y67rwizV43SCjkd0GMFAuUUzsvNWDXQ4Qs839UvlFwjqlXQS1z7M= 2022-05-05T20:55:09.076 INFO:teuthology.kill:2022-05-05 20:55:09,075.075 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-05T20:55:09.081 INFO:teuthology.kill:2022-05-05 20:55:09,081.081 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-05T20:55:09.157 INFO:teuthology.kill:2022-05-05 20:55:09,157.157 INFO:teuthology.orchestra.console:Power off smithi073 2022-05-05T20:55:09.172 INFO:teuthology.kill:2022-05-05 20:55:09,171.171 INFO:teuthology.orchestra.console:Power off smithi166 2022-05-05T20:55:17.532 INFO:teuthology.kill:2022-05-05 20:55:17,531.531 INFO:teuthology.orchestra.console:Power off for smithi166 completed 2022-05-05T20:55:17.787 INFO:teuthology.kill:2022-05-05 20:55:17,786.786 INFO:teuthology.lock.ops:unlocked: smithi166.front.sepia.ceph.com 2022-05-05T20:55:21.643 INFO:teuthology.kill:2022-05-05 20:55:21,643.643 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2022-05-05T20:55:21.791 INFO:teuthology.kill:2022-05-05 20:55:21,791.791 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com 2022-05-05T20:57:22.164 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-05T20:57:22.262 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi073 but it was locked by another job: /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822769 2022-05-05T20:57:22.263 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi166 but it was locked by another job: /home/teuthworker/archive/amathuri-2022-05-05_05:14:18-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6822769