2022-02-09T22:52:14.093 INFO:root:teuthology version: 1.1.0-7cebb3f2 2022-02-09T22:52:14.220 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi080.front.sepia.ceph.com' reimaging 2022-02-09T22:52:14.221 INFO:teuthology.lock.ops:Updating [ubuntu@smithi080.front.sepia.ceph.com]: reset os type and version on server 2022-02-09T22:52:14.222 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2022-02-09T22:52:14.239 INFO:teuthology.lock.ops:Node 'ubuntu@smithi080.front.sepia.ceph.com' reimaging is complete 2022-02-09T22:52:14.239 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi123.front.sepia.ceph.com' reimaging 2022-02-09T22:52:14.240 INFO:teuthology.lock.ops:Updating [ubuntu@smithi123.front.sepia.ceph.com]: reset os type and version on server 2022-02-09T22:52:14.240 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2022-02-09T22:52:14.263 INFO:teuthology.lock.ops:Node 'ubuntu@smithi123.front.sepia.ceph.com' reimaging is complete 2022-02-09T22:52:14.475 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of ubuntu 20.04 2022-02-09T22:52:14.479 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of ubuntu 20.04 2022-02-09T22:52:14.996 INFO:teuthology.orchestra.console:Power off smithi123 2022-02-09T22:52:15.060 INFO:teuthology.orchestra.console:Power off smithi080 2022-02-09T22:52:23.363 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2022-02-09T22:52:23.465 INFO:teuthology.orchestra.console:Power on smithi123 2022-02-09T22:52:27.536 INFO:teuthology.orchestra.console:Power off for smithi080 completed 2022-02-09T22:52:27.639 INFO:teuthology.orchestra.console:Power on smithi080 2022-02-09T22:52:31.890 INFO:teuthology.orchestra.console:Power on for smithi123 completed 2022-02-09T22:52:31.892 INFO:teuthology.orchestra.console:Power on for smithi080 completed 2022-02-09T22:52:31.992 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2022-02-09T22:52:31.996 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish 2022-02-09T22:58:50.999 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-09T22:58:51.472 INFO:teuthology.provision.fog.smithi080:Node is ready 2022-02-09T22:58:51.478 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com 2022-02-09T22:58:51.528 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080 2022-02-09T22:58:51.706 INFO:teuthology.provision.fog.smithi080:Deploy complete! 2022-02-09T22:59:05.025 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-09T22:59:05.569 INFO:teuthology.provision.fog.smithi123:Node is ready 2022-02-09T22:59:05.576 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2022-02-09T22:59:05.584 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2022-02-09T22:59:05.813 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2022-02-09T22:59:05.992 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com 2022-02-09T22:59:05.993 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-09T22:59:06.016 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2022-02-09T22:59:06.017 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-09T22:59:06.038 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server 2022-02-09T22:59:06.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2022-02-09T22:59:06.226 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2022-02-09T22:59:06.274 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Ubuntu" 2022-02-09T22:59:06.274 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-02-09T22:59:06.274 INFO:teuthology.orchestra.run.smithi080.stdout:ID=ubuntu 2022-02-09T22:59:06.275 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE=debian 2022-02-09T22:59:06.275 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-02-09T22:59:06.275 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="20.04" 2022-02-09T22:59:06.275 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.ubuntu.com/" 2022-02-09T22:59:06.276 INFO:teuthology.orchestra.run.smithi080.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-02-09T22:59:06.276 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-02-09T22:59:06.277 INFO:teuthology.orchestra.run.smithi080.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-02-09T22:59:06.277 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_CODENAME=focal 2022-02-09T22:59:06.277 INFO:teuthology.orchestra.run.smithi080.stdout:UBUNTU_CODENAME=focal 2022-02-09T22:59:06.278 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2022-02-09T22:59:06.297 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2022-02-09T22:59:06.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2022-02-09T22:59:06.466 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2022-02-09T22:59:06.473 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2022-02-09T22:59:06.473 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-02-09T22:59:06.473 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2022-02-09T22:59:06.473 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2022-02-09T22:59:06.474 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-02-09T22:59:06.474 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="20.04" 2022-02-09T22:59:06.474 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2022-02-09T22:59:06.474 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-02-09T22:59:06.475 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-02-09T22:59:06.475 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-02-09T22:59:06.475 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=focal 2022-02-09T22:59:06.475 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=focal 2022-02-09T22:59:06.476 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2022-02-09T22:59:06.568 INFO:teuthology.dispatcher.supervisor:Running job 6671832 2022-02-09T22:59:06.569 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7cebb3f2319fd6c8340c0f7cd15a137e747fd32e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-02-09_22:51:05-rgw-wip-yuri5-testing-2022-02-09-1322-pacific-distro-default-smithi/6671832 --name yuriw-2022-02-09_22:51:05-rgw-wip-yuri5-testing-2022-02-09-1322-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} -- /home/teuthworker/archive/yuriw-2022-02-09_22:51:05-rgw-wip-yuri5-testing-2022-02-09-1322-pacific-distro-default-smithi/6671832/orig.config.yaml 2022-02-09T22:59:06.572 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-02-09_22:51:05-rgw-wip-yuri5-testing-2022-02-09-1322-pacific-distro-default-smithi/6671832 2022-02-09T22:59:06.573 INFO:teuthology.dispatcher.supervisor:Job PID: 3881 2022-02-09T22:59:06.573 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-02-10T05:29:36.419 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-02-10T05:29:36.622 INFO:teuthology.kill:Killing Pids: {3881} 2022-02-10T05:29:37.744 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2022-02-10T05:29:37.745 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2022-02-10T05:29:37.745 INFO:teuthology.misc:Compressing logs... 2022-02-10T05:29:37.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2022-02-10T05:29:37.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2022-02-10T05:29:38.236 INFO:teuthology.misc:Compressing logs... 2022-02-10T05:29:38.364 INFO:teuthology.misc:Compressing logs... 2022-02-10T05:31:37.917 INFO:teuthology.kill:No teuthology processes running 2022-02-10T05:31:39.051 INFO:teuthology.kill:Nuking machines: ['smithi080', 'smithi123'] 2022-02-10T05:31:39.997 INFO:teuthology.kill:2022-02-10 05:31:39,997.997 INFO:teuthology.nuke:targets: 2022-02-10T05:31:39.999 INFO:teuthology.kill: smithi080.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDpnpZEWgyJtu4vzRvd74t6JXT5DCinOwq/3Ept/rksl35PckX7uBhLROB4gxL7w747VGJ/d2/F1ZzbqsPGH8JGx4Bp2czT2T4EG55SMCwAu4r0PFdda6oqt62VZCqkXyqTZJ0oZRZ6Q1yU54nmBjtU4zTFyyfwAM8hQ/J0AnI/fZLiuRvoMqsoyiTYWcsc/pa2I3ixb0O55BKztOUjWBLuuABucAl+WZSR8hRbWheaFam4asEpWQFlcB9kEzFlAGiCnXMHNd6tYJQ4J85Y0B0L8moputYFCugxUkTPT3adCAiKDGs2vwChSpkRnAONM0KC5jM1940AA90vZG3J5dNh5eZp0C0utimymzBps1deBvJqzzFHpMD/RGedQnqxfrMuMlDvAJRWRTvYbiAQHukcm8AXMdeiNadi/6l1BJ2kpTajmpHh4UB8+OEgqDV/3NJjbmf5JYZRyPJSZU3R6EQ43LCuX6bz1afGUetsNJk0L4tS/XtLnN8iYAzJbg8zbIU= 2022-02-10T05:31:39.999 INFO:teuthology.kill: smithi123.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCcDMlu8dy1dHiLsqngTANSw0vYxffFoHLICFocjYAcjU7VZ9626BxRqJqU17EXAfOKudsiVLZQXH/CeXwFUZ+F1ObNRZsj6d9OQJwM6Ev633Y+qN4j83C7jM00y/1qVc9eds9e78XcPiUsShzXFMbfUZPanNUKCuVtGqOlvmKCE/SZGxvqwlTlrbgluf3CLGFFIz3Iuh7UgOAXOvrJS8Hup5/p05m+bHbP9YtShyfN4f0zOE+a00IMWb8Rm1eaRzM+goiHPDAHKTRjk5MKZEb4zPYjz8A5mu1uhjBIcf28zufHxhxVN5JBiCPh23lS3GIiMnvAff9+1Jnu8FkWyOAu2OQlNLDPRJTQonrU7vHyCvCEsW408W7MXAl/HWiqP0M2E7U7EczxdDaupVzCLCW8BVt3slSfZdxcPsOJDdm8I8BJg0bNRP0Nt540NKCczO4VRZwI3hDFIzJjkBXnpMzUTeO5d2HCYgRO3Zp1fEfKbJK7dWIdaXPMoSQiN75Io4k= 2022-02-10T05:31:40.024 INFO:teuthology.kill:2022-02-10 05:31:40,024.024 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-10T05:31:40.027 INFO:teuthology.kill:2022-02-10 05:31:40,027.027 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-10T05:31:40.102 INFO:teuthology.kill:2022-02-10 05:31:40,102.102 INFO:teuthology.orchestra.console:Power off smithi080 2022-02-10T05:31:40.116 INFO:teuthology.kill:2022-02-10 05:31:40,116.116 INFO:teuthology.orchestra.console:Power off smithi123 2022-02-10T05:31:48.475 INFO:teuthology.kill:2022-02-10 05:31:48,474.474 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2022-02-10T05:31:48.625 INFO:teuthology.kill:2022-02-10 05:31:48,624.624 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com 2022-02-10T05:31:52.583 INFO:teuthology.kill:2022-02-10 05:31:52,582.582 INFO:teuthology.orchestra.console:Power off for smithi080 completed 2022-02-10T05:31:52.732 INFO:teuthology.kill:2022-02-10 05:31:52,732.732 INFO:teuthology.lock.ops:unlocked: smithi080.front.sepia.ceph.com 2022-02-10T05:33:53.047 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-02-10T05:33:53.157 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi080 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-02-10_05:00:03-smoke-master-distro-default-smithi/6672710 2022-02-10T05:33:53.157 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi123 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-02-10_05:00:03-smoke-master-distro-default-smithi/6672711