2022-04-07T10:49:35.794 INFO:root:teuthology version: 1.1.0-3dd79763 2022-04-07T10:49:35.926 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi067.front.sepia.ceph.com' reimaging 2022-04-07T10:49:35.927 INFO:teuthology.lock.ops:Updating [ubuntu@smithi067.front.sepia.ceph.com]: reset os type and version on server 2022-04-07T10:49:35.928 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2022-04-07T10:49:35.947 INFO:teuthology.lock.ops:Node 'ubuntu@smithi067.front.sepia.ceph.com' reimaging is complete 2022-04-07T10:49:35.948 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi171.front.sepia.ceph.com' reimaging 2022-04-07T10:49:35.948 INFO:teuthology.lock.ops:Updating [ubuntu@smithi171.front.sepia.ceph.com]: reset os type and version on server 2022-04-07T10:49:35.948 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2022-04-07T10:49:35.968 INFO:teuthology.lock.ops:Node 'ubuntu@smithi171.front.sepia.ceph.com' reimaging is complete 2022-04-07T10:49:36.159 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of ubuntu 20.04 2022-04-07T10:49:36.186 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of ubuntu 20.04 2022-04-07T10:49:36.449 INFO:teuthology.orchestra.console:Power off smithi067 2022-04-07T10:49:36.495 INFO:teuthology.orchestra.console:Power off smithi171 2022-04-07T10:49:44.833 INFO:teuthology.orchestra.console:Power off for smithi067 completed 2022-04-07T10:49:44.859 INFO:teuthology.orchestra.console:Power off for smithi171 completed 2022-04-07T10:49:44.934 INFO:teuthology.orchestra.console:Power on smithi067 2022-04-07T10:49:44.964 INFO:teuthology.orchestra.console:Power on smithi171 2022-04-07T10:49:53.308 INFO:teuthology.orchestra.console:Power on for smithi067 completed 2022-04-07T10:49:53.322 INFO:teuthology.orchestra.console:Power on for smithi171 completed 2022-04-07T10:49:53.411 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish 2022-04-07T10:49:53.423 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish 2022-04-07T10:55:03.691 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-07T10:55:04.156 INFO:teuthology.provision.fog.smithi067:Node is ready 2022-04-07T10:55:04.163 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com 2022-04-07T10:55:04.171 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067 2022-04-07T10:55:04.374 INFO:teuthology.provision.fog.smithi067:Deploy complete! 2022-04-07T10:55:07.003 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-07T10:55:07.501 INFO:teuthology.provision.fog.smithi171:Node is ready 2022-04-07T10:55:07.508 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com 2022-04-07T10:55:07.514 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171 2022-04-07T10:55:07.784 INFO:teuthology.provision.fog.smithi171:Deploy complete! 2022-04-07T10:55:10.273 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com 2022-04-07T10:55:10.274 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-07T10:55:10.295 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com 2022-04-07T10:55:10.295 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-07T10:55:10.316 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server 2022-04-07T10:55:10.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2022-04-07T10:55:10.502 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2022-04-07T10:55:10.508 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Ubuntu" 2022-04-07T10:55:10.508 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-04-07T10:55:10.508 INFO:teuthology.orchestra.run.smithi067.stdout:ID=ubuntu 2022-04-07T10:55:10.509 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE=debian 2022-04-07T10:55:10.509 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-04-07T10:55:10.509 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="20.04" 2022-04-07T10:55:10.509 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.ubuntu.com/" 2022-04-07T10:55:10.510 INFO:teuthology.orchestra.run.smithi067.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-04-07T10:55:10.510 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-04-07T10:55:10.510 INFO:teuthology.orchestra.run.smithi067.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-04-07T10:55:10.510 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_CODENAME=focal 2022-04-07T10:55:10.511 INFO:teuthology.orchestra.run.smithi067.stdout:UBUNTU_CODENAME=focal 2022-04-07T10:55:10.512 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2022-04-07T10:55:10.535 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server 2022-04-07T10:55:10.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2022-04-07T10:55:10.711 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2022-04-07T10:55:10.759 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Ubuntu" 2022-04-07T10:55:10.759 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-04-07T10:55:10.760 INFO:teuthology.orchestra.run.smithi171.stdout:ID=ubuntu 2022-04-07T10:55:10.760 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE=debian 2022-04-07T10:55:10.760 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-04-07T10:55:10.760 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="20.04" 2022-04-07T10:55:10.760 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.ubuntu.com/" 2022-04-07T10:55:10.761 INFO:teuthology.orchestra.run.smithi171.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-04-07T10:55:10.761 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-04-07T10:55:10.761 INFO:teuthology.orchestra.run.smithi171.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-04-07T10:55:10.761 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_CODENAME=focal 2022-04-07T10:55:10.762 INFO:teuthology.orchestra.run.smithi171.stdout:UBUNTU_CODENAME=focal 2022-04-07T10:55:10.762 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2022-04-07T10:55:10.884 INFO:teuthology.dispatcher.supervisor:Running job 6780628 2022-04-07T10:55:10.885 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3dd797633f37e2d7e2c4ae3ef9ac35a188c2028d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-04-07_05:07:02-rgw-pacific-distro-default-smithi/6780628 --name teuthology-2022-04-07_05:07:02-rgw-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} -- /home/teuthworker/archive/teuthology-2022-04-07_05:07:02-rgw-pacific-distro-default-smithi/6780628/orig.config.yaml 2022-04-07T10:55:10.888 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-04-07_05:07:02-rgw-pacific-distro-default-smithi/6780628 2022-04-07T10:55:10.889 INFO:teuthology.dispatcher.supervisor:Job PID: 15910 2022-04-07T10:55:10.890 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-04-07T17:25:38.984 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-04-07T17:25:39.167 INFO:teuthology.kill:Killing Pids: {15910} 2022-04-07T17:25:40.329 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2022-04-07T17:25:40.330 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2022-04-07T17:25:40.330 INFO:teuthology.misc:Compressing logs... 2022-04-07T17:25:40.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2022-04-07T17:25:40.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2022-04-07T17:25:40.852 INFO:teuthology.misc:Compressing logs... 2022-04-07T17:25:40.987 INFO:teuthology.misc:Compressing logs... 2022-04-07T17:27:39.045 INFO:teuthology.kill:No teuthology processes running 2022-04-07T17:27:40.178 INFO:teuthology.kill:Nuking machines: ['smithi067', 'smithi171'] 2022-04-07T17:27:41.204 INFO:teuthology.kill:2022-04-07 17:27:41,204.204 INFO:teuthology.nuke:targets: 2022-04-07T17:27:41.205 INFO:teuthology.kill: smithi067.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgWbAl8en7EQDz2LoXluLoFNcYZwhFq9RE6UKuLj2Gjus+0tsdQFcls3zyMvHl63cLRz03c2jlnJeZaq3WCdRjBM+9RTpTfF6UxelS8MoxbY6KPv8AGKQWVREe/HeRLzZNaQymIuUDZZYw2iuyMbVZJ3uWvxChkJlJfOE4REcYWM7k3e7GFw5O89qRfrhgZ3dd0HZNUWk92rgoYSoGblyEesx2DS0cZinLCLrNxzrBZCRNJ6HmdpwVP0SzSu5GKzuRqM12lhszTGtSIiC7+uvghwyyI0VDbJ/Wcuqd1tQBNUiIGXT4ZzzZmp07vDBcxokub6swVzlCr/T2lkqqNixAnOCg2sXiqWXX59AHQRH0TZkQkMKTkyC9A6WIJdg9MMFAYz36m1jqbY/pcNKiCXfLXtqdRA+vlNBrMVJNzy3MYVsyrHUbeupDoXJt9LGMbnAE80B1obINmG7hqwVQ9PiXbMoWz22mbCF+KU/bqK60Q2/wQ/K6Tq0+F1uVHrcpASk= 2022-04-07T17:27:41.205 INFO:teuthology.kill: smithi171.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNaS+3ol2gKpiF6zV1Evg7OhIshdAkf9zU65gYdjr2XJQJ3YUkInyYylYiuMWEDNifdNw5SapwriMcKqboxutKYSuMm0Wgb/7wazhsDq/v3aY2qjQ2EC9gppRJScCP04LunaFS39dnysx5maZ/75Whv2iUGguPaDugxjDEoXTh4og61bf66s96bXoIsJHTfz83KhEDuPK1oRiFptRzvoo752Vqkjy1zbxE0Jt0WkXJjr/oY5JgQXYxePKeYaxzU/WUEFfeya1R8S6m0uDW0vGMqSXO1FeOr4uEIQFd98uzyiCkSjaYwzCvMFnj+Y179XRUHof1cFXvNEPZUj/azlQXjJtrpyxaEZ7WODburJojIrxW2f0zNs2tmGNT2kavv6diFExASeFPe3JD6Iw5I3/x9SKcwQcg+a9i7DTORyG6/SnlK/0nRLNGmjP3fplScCvNrdfBNOOQYj636wEB5y2BVIsOOi2pFYMQCk52zIPho/YNlrffeCOogm8UYsSPoo0= 2022-04-07T17:27:41.232 INFO:teuthology.kill:2022-04-07 17:27:41,232.232 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-07T17:27:41.235 INFO:teuthology.kill:2022-04-07 17:27:41,235.235 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-07T17:27:41.302 INFO:teuthology.kill:2022-04-07 17:27:41,302.302 INFO:teuthology.orchestra.console:Power off smithi067 2022-04-07T17:27:41.315 INFO:teuthology.kill:2022-04-07 17:27:41,314.314 INFO:teuthology.orchestra.console:Power off smithi171 2022-04-07T17:27:49.670 INFO:teuthology.kill:2022-04-07 17:27:49,670.670 INFO:teuthology.orchestra.console:Power off for smithi067 completed 2022-04-07T17:27:49.710 INFO:teuthology.kill:2022-04-07 17:27:49,709.709 INFO:teuthology.orchestra.console:Power off for smithi171 completed 2022-04-07T17:27:49.814 INFO:teuthology.kill:2022-04-07 17:27:49,813.813 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com 2022-04-07T17:27:49.851 INFO:teuthology.kill:2022-04-07 17:27:49,851.851 INFO:teuthology.lock.ops:unlocked: smithi171.front.sepia.ceph.com 2022-04-07T17:29:50.151 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-04-07T17:29:50.248 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi171 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-04-07_06:00:02-rbd-octopus-distro-default-smithi/6780719