2022-06-07T13:53:01.102 INFO:root:teuthology version: 1.1.1.dev362+g93d2b653 2022-06-07T13:53:01.287 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging 2022-06-07T13:53:01.289 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server 2022-06-07T13:53:01.289 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2022-06-07T13:53:01.318 INFO:teuthology.lock.ops:Node 'smithi044.front.sepia.ceph.com' reimaging is complete 2022-06-07T13:53:01.319 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2022-06-07T13:53:01.320 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2022-06-07T13:53:01.320 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2022-06-07T13:53:01.358 INFO:teuthology.lock.ops:Node 'smithi192.front.sepia.ceph.com' reimaging is complete 2022-06-07T13:53:01.588 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of ubuntu 20.04 2022-06-07T13:53:01.631 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of ubuntu 20.04 2022-06-07T13:53:03.008 INFO:teuthology.orchestra.console:Power off smithi192 2022-06-07T13:53:03.057 INFO:teuthology.orchestra.console:Power off smithi044 2022-06-07T13:53:11.409 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2022-06-07T13:53:11.432 INFO:teuthology.orchestra.console:Power off for smithi044 completed 2022-06-07T13:53:11.511 INFO:teuthology.orchestra.console:Power on smithi192 2022-06-07T13:53:11.545 INFO:teuthology.orchestra.console:Power on smithi044 2022-06-07T13:53:19.926 INFO:teuthology.orchestra.console:Power on for smithi044 completed 2022-06-07T13:53:20.014 INFO:teuthology.orchestra.console:Power on for smithi192 completed 2022-06-07T13:53:20.028 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish 2022-06-07T13:53:20.115 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2022-06-07T13:58:11.937 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-06-07T13:58:12.534 INFO:teuthology.provision.fog.smithi044:Node is ready 2022-06-07T13:58:12.541 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com 2022-06-07T13:58:12.589 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044 2022-06-07T13:58:12.762 INFO:teuthology.provision.fog.smithi044:Deploy complete! 2022-06-07T13:59:48.775 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-06-07T13:59:49.320 INFO:teuthology.provision.fog.smithi192:Node is ready 2022-06-07T13:59:49.327 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2022-06-07T13:59:49.378 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2022-06-07T13:59:49.556 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2022-06-07T13:59:49.768 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com 2022-06-07T13:59:49.769 INFO:teuthology.lock.ops:New key found. Updating... 2022-06-07T13:59:49.789 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2022-06-07T13:59:49.789 INFO:teuthology.lock.ops:New key found. Updating... 2022-06-07T13:59:49.810 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server 2022-06-07T13:59:49.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2022-06-07T13:59:50.148 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2022-06-07T13:59:50.208 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Ubuntu" 2022-06-07T13:59:50.208 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-06-07T13:59:50.209 INFO:teuthology.orchestra.run.smithi044.stdout:ID=ubuntu 2022-06-07T13:59:50.209 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE=debian 2022-06-07T13:59:50.209 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-06-07T13:59:50.209 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="20.04" 2022-06-07T13:59:50.209 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.ubuntu.com/" 2022-06-07T13:59:50.210 INFO:teuthology.orchestra.run.smithi044.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-06-07T13:59:50.210 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-06-07T13:59:50.210 INFO:teuthology.orchestra.run.smithi044.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-06-07T13:59:50.210 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_CODENAME=focal 2022-06-07T13:59:50.211 INFO:teuthology.orchestra.run.smithi044.stdout:UBUNTU_CODENAME=focal 2022-06-07T13:59:50.213 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2022-06-07T13:59:50.238 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2022-06-07T13:59:50.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2022-06-07T13:59:50.465 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2022-06-07T13:59:50.475 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu" 2022-06-07T13:59:50.475 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-06-07T13:59:50.475 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu 2022-06-07T13:59:50.476 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian 2022-06-07T13:59:50.476 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-06-07T13:59:50.476 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="20.04" 2022-06-07T13:59:50.476 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/" 2022-06-07T13:59:50.477 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-06-07T13:59:50.477 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-06-07T13:59:50.477 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-06-07T13:59:50.477 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=focal 2022-06-07T13:59:50.478 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=focal 2022-06-07T13:59:50.478 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2022-06-07T13:59:50.590 INFO:teuthology.dispatcher.supervisor:Running job 6865794 2022-06-07T13:59:50.591 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_93d2b653facc0e5a7a532b39d9ff91a044f2c4a9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-06-07_13:51:41-rgw-wip-yuri-testing-2022-06-06-1014-pacific-distro-default-smithi/6865794 --name yuriw-2022-06-07_13:51:41-rgw-wip-yuri-testing-2022-06-06-1014-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} -- /home/teuthworker/archive/yuriw-2022-06-07_13:51:41-rgw-wip-yuri-testing-2022-06-06-1014-pacific-distro-default-smithi/6865794/orig.config.yaml 2022-06-07T13:59:50.598 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-06-07_13:51:41-rgw-wip-yuri-testing-2022-06-06-1014-pacific-distro-default-smithi/6865794 2022-06-07T13:59:50.599 INFO:teuthology.dispatcher.supervisor:Job PID: 23309 2022-06-07T13:59:50.599 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-06-07T20:30:32.209 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-06-07T20:30:32.365 INFO:teuthology.kill:Killing Pids: {23309} 2022-06-07T20:30:33.906 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2022-06-07T20:30:33.907 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2022-06-07T20:30:33.908 INFO:teuthology.misc:Compressing logs... 2022-06-07T20:30:33.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2022-06-07T20:30:34.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2022-06-07T20:30:34.572 INFO:teuthology.misc:Compressing logs... 2022-06-07T20:30:34.685 INFO:teuthology.misc:Compressing logs... 2022-06-07T20:32:30.418 INFO:teuthology.kill:No teuthology processes running 2022-06-07T20:32:31.925 INFO:teuthology.kill:Nuking machines: ['smithi044', 'smithi192'] 2022-06-07T20:32:33.118 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_93d2b653facc0e5a7a532b39d9ff91a044f2c4a9/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-06-07T20:32:33.118 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-06-07T20:32:33.119 INFO:teuthology.kill:2022-06-07 20:32:33,117.117 INFO:teuthology.nuke:targets: 2022-06-07T20:32:33.119 INFO:teuthology.kill: smithi044.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFVRxj6adbPqAYAQz/JhiUxvCCVKa/zpmpdcZiG5TytjALImYPfPv1pCAuOu9uhX/251Z/zbpNpoHEbDKYXXQG+XxoHMkyQRizjNKNu2AX4ZraxnO01j4W0PTf9SpenIwHkxPwwZGI0kjogtnwhbMq1sjp593VV8auIyhDSmtI4D47qaYWNZcXpJLWVdJT4IGEfwQ4k22zN5n+pCA2mtSxINTR52WD1TKt++/hCQha4CvEzIFOm1tL1cvFLaMBSeJoIPlsOK3Oegi4TEfo0I5WpRGjrzC5PPHNRi6l6HOtHOIAKg5Y/EzyXOOldFknqB426QZw/fvKwaeKStP4d5HpO7Mzcwfs/t/2NnhCSYUQF9lOL6YRR4gsmGuJtzg768eeKBQMi2dexdxzDgJAVBQaz9X+0aFvgDAIhapzPVWpnda6+cWAi7wCftqQgGKUmY9P7u0MBlPlQWU3GCeqNjMH34kSFyNKfPKJQOoz3aD/VUF4KqLZYfVzLBNXgq+fQik= 2022-06-07T20:32:33.120 INFO:teuthology.kill: smithi192.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzWrMK2KHGczYYgqoFL9ou34K1B58XUcP0gH+O4t1OES2r9RM1nzgNNitiJoyvi3sIG7ZPvlTfSc/pfrOmikuz+mLG2IXCmLyzWr0wpQFbwCH3qMaxjQbfhcqkuUSfas0RUoC4bhvJEba0dHaN1KwzT5lXU1kM35KRElpmiaNtZPwFBUuNJ3VUn++z/xD4ytHaYrLWTtFioGV7QMdBerhZeJ3vokBw9UcdYxyfXg1c0rNf0E4E/P4NnMsJUNMA/tU6NSGn/fY1/3/4Fao38FztadqpNQK6xfGlXIA5D5GnNlTT1fxagRujHLlIRFLZxc/ccaUdlfpwPXXhHjCCb53lMrxg26sOtqQf7x84Ur2T+DxxDareCmQkL9eu9GiwgxNhRyz2Td3K301DRw00QKtf68OFox848qvDef8r/mJn5L6jPDoaaj7Prrxy/U061Vh5zjqwyYPLjGWUzmoCIaiA1fGryVaU3AXfdaEZ581BO30JURcBbt5fq+Bsah0zals= 2022-06-07T20:32:33.147 INFO:teuthology.kill:2022-06-07 20:32:33,146.146 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-07T20:32:33.150 INFO:teuthology.kill:2022-06-07 20:32:33,150.150 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-07T20:32:33.243 INFO:teuthology.kill:2022-06-07 20:32:33,243.243 INFO:teuthology.orchestra.console:Power off smithi192 2022-06-07T20:32:33.261 INFO:teuthology.kill:2022-06-07 20:32:33,261.261 INFO:teuthology.orchestra.console:Power off smithi044 2022-06-07T20:32:41.653 INFO:teuthology.kill:2022-06-07 20:32:41,653.653 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2022-06-07T20:32:41.807 INFO:teuthology.kill:2022-06-07 20:32:41,806.806 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com 2022-06-07T20:32:45.744 INFO:teuthology.kill:2022-06-07 20:32:45,743.743 INFO:teuthology.orchestra.console:Power off for smithi044 completed 2022-06-07T20:32:45.900 INFO:teuthology.kill:2022-06-07 20:32:45,900.900 INFO:teuthology.lock.ops:unlocked: smithi044.front.sepia.ceph.com 2022-06-07T20:34:46.278 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-06-07T20:34:46.401 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi044 but it was locked by another job: /home/teuthworker/archive/cbodley-2022-06-07_20:15:13-rgw-wip-cbodley-testing-distro-default-smithi/6866948 2022-06-07T20:34:46.402 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi192 but it was locked by another job: /home/teuthworker/archive/cbodley-2022-06-07_20:15:13-rgw-wip-cbodley-testing-distro-default-smithi/6866948