2021-11-05T19:58:58.292 INFO:root:teuthology version: 1.1.0-27954452 2021-11-05T19:58:58.413 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi007.front.sepia.ceph.com' reimaging 2021-11-05T19:58:58.415 INFO:teuthology.lock.ops:Updating [ubuntu@smithi007.front.sepia.ceph.com]: reset os type and version on server 2021-11-05T19:58:58.416 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2021-11-05T19:58:58.436 INFO:teuthology.lock.ops:Node 'ubuntu@smithi007.front.sepia.ceph.com' reimaging is complete 2021-11-05T19:58:58.437 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi086.front.sepia.ceph.com' reimaging 2021-11-05T19:58:58.437 INFO:teuthology.lock.ops:Updating [ubuntu@smithi086.front.sepia.ceph.com]: reset os type and version on server 2021-11-05T19:58:58.438 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2021-11-05T19:58:58.457 INFO:teuthology.lock.ops:Node 'ubuntu@smithi086.front.sepia.ceph.com' reimaging is complete 2021-11-05T19:58:58.680 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of ubuntu 20.04 2021-11-05T19:58:58.685 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of ubuntu 20.04 2021-11-05T19:58:59.034 INFO:teuthology.orchestra.console:Power off smithi007 2021-11-05T19:58:59.048 INFO:teuthology.orchestra.console:Power off smithi086 2021-11-05T19:59:07.408 INFO:teuthology.orchestra.console:Power off for smithi007 completed 2021-11-05T19:59:07.413 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2021-11-05T19:59:07.509 INFO:teuthology.orchestra.console:Power on smithi007 2021-11-05T19:59:07.518 INFO:teuthology.orchestra.console:Power on smithi086 2021-11-05T19:59:11.769 INFO:teuthology.orchestra.console:Power on for smithi086 completed 2021-11-05T19:59:11.870 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2021-11-05T19:59:15.891 INFO:teuthology.orchestra.console:Power on for smithi007 completed 2021-11-05T19:59:15.992 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2021-11-05T20:04:48.136 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-05T20:04:48.684 INFO:teuthology.provision.fog.smithi007:Node is ready 2021-11-05T20:04:48.690 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com 2021-11-05T20:04:48.697 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007 2021-11-05T20:04:48.858 INFO:teuthology.provision.fog.smithi007:Deploy complete! 2021-11-05T20:05:00.169 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-05T20:05:00.738 INFO:teuthology.provision.fog.smithi086:Node is ready 2021-11-05T20:05:00.745 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com 2021-11-05T20:05:00.794 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2021-11-05T20:05:00.927 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2021-11-05T20:05:01.106 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com 2021-11-05T20:05:01.107 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-05T20:05:01.126 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2021-11-05T20:05:01.127 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-05T20:05:01.144 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server 2021-11-05T20:05:01.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2021-11-05T20:05:01.410 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2021-11-05T20:05:01.417 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Ubuntu" 2021-11-05T20:05:01.417 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-05T20:05:01.417 INFO:teuthology.orchestra.run.smithi007.stdout:ID=ubuntu 2021-11-05T20:05:01.418 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE=debian 2021-11-05T20:05:01.418 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-05T20:05:01.418 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="20.04" 2021-11-05T20:05:01.418 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-05T20:05:01.418 INFO:teuthology.orchestra.run.smithi007.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-05T20:05:01.419 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-05T20:05:01.419 INFO:teuthology.orchestra.run.smithi007.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-05T20:05:01.419 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_CODENAME=focal 2021-11-05T20:05:01.419 INFO:teuthology.orchestra.run.smithi007.stdout:UBUNTU_CODENAME=focal 2021-11-05T20:05:01.420 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2021-11-05T20:05:01.441 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2021-11-05T20:05:01.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2021-11-05T20:05:01.613 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2021-11-05T20:05:01.619 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Ubuntu" 2021-11-05T20:05:01.620 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-05T20:05:01.620 INFO:teuthology.orchestra.run.smithi086.stdout:ID=ubuntu 2021-11-05T20:05:01.620 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE=debian 2021-11-05T20:05:01.620 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-05T20:05:01.621 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="20.04" 2021-11-05T20:05:01.621 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-05T20:05:01.621 INFO:teuthology.orchestra.run.smithi086.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-05T20:05:01.621 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-05T20:05:01.622 INFO:teuthology.orchestra.run.smithi086.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-05T20:05:01.622 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_CODENAME=focal 2021-11-05T20:05:01.622 INFO:teuthology.orchestra.run.smithi086.stdout:UBUNTU_CODENAME=focal 2021-11-05T20:05:01.622 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2021-11-05T20:05:01.709 INFO:teuthology.dispatcher.supervisor:Running job 6488040 2021-11-05T20:05:01.710 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology -v --owner scheduled_aemerson@teuthology --archive /home/teuthworker/archive/aemerson-2021-11-05_19:23:25-rgw-wip-53160-pacific-distro-basic-smithi/6488040 --name aemerson-2021-11-05_19:23:25-rgw-wip-53160-pacific-distro-basic-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} -- /home/teuthworker/archive/aemerson-2021-11-05_19:23:25-rgw-wip-53160-pacific-distro-basic-smithi/6488040/orig.config.yaml 2021-11-05T20:05:01.712 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/aemerson-2021-11-05_19:23:25-rgw-wip-53160-pacific-distro-basic-smithi/6488040 2021-11-05T20:05:01.713 INFO:teuthology.dispatcher.supervisor:Job PID: 29980 2021-11-05T20:05:01.714 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-11-06T08:05:53.120 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-11-06T08:05:53.343 INFO:teuthology.kill:Killing Pids: {29980} 2021-11-06T08:05:54.405 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2021-11-06T08:05:54.406 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2021-11-06T08:05:54.406 INFO:teuthology.misc:Compressing logs... 2021-11-06T08:05:54.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2021-11-06T08:05:54.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2021-11-06T08:05:54.922 INFO:teuthology.misc:Compressing logs... 2021-11-06T08:05:55.049 INFO:teuthology.misc:Compressing logs... 2021-11-06T08:09:38.044 INFO:teuthology.kill:No teuthology processes running 2021-11-06T08:09:39.153 INFO:teuthology.kill:Nuking machines: ['smithi007', 'smithi086'] 2021-11-06T08:09:40.127 INFO:teuthology.kill:2021-11-06 08:09:40,127.127 INFO:teuthology.nuke:targets: 2021-11-06T08:09:40.128 INFO:teuthology.kill: smithi007.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuH7MqU6RMYo1YasgjJenkYEtY4JaHXsmc9WOG/B2vfEqjTGkEGHNig800p0eK5VZZ/QED+gClrXrFNfWz27oBJxPl1AH0Jg2HoXYQHdhy53bQQWNJ4TvFsKEBgXAHae0M9KI+xMnGyr22JMsmt17AJ69Lu48J8SU8/cIBYBf+uIExkGE3DwoMMp4UHYQdDIcbXi2MSkRzF9W8zQ4203fy4PxiQaTSTjyjgzdvqqvisMSPwtA6ML83zMnFprz+T3w0ex7unDsqtt5xLPzHtF66RJ32vRDnoXO7xC3a88YYl2J19BBQslFxQK3yfhV2FHFhbsJQodWfdAWKzBVido6+apxTSDQyK96ht+i1zgm7heLP0po1aIlTR3BXV5Q+ORw7Lv1zug2YGPCaBpDxjSQuShKME/D5ne5B7qja3ia51gpnOayb+4WW31+1APGreeITBEf+Mb0CaHeMrUihpThEtekDpDzajsfS5L3Hzmp77i7XKQf634sFyOvKdj1C8d8= 2021-11-06T08:09:40.128 INFO:teuthology.kill: smithi086.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFZJlSJPsgB3r/YmFS7dU1dE/JeKmJOnJbH1rrPl1Op/NHjm5bWBVZ7fP4MKtdDHBftnLEuxGZDYj3A4u0T4NxVrnBnS9WBnrx/zSL86qoLRviLtUC5C2Co5ZKPxWtuKci4q48wUPQyPf92dzwbZvuLYKtX5knA/4p6osI5Wl7t8/bbgXrn5TKSdWuYDU+B6vd3PQAHRW9lnl9ydQ9Z0OjYJ8tfaNUGPWdW3wHxssgo0PUQA51uZ1kt05YF/JKcCaKaLNLLDJvGxSqr7lPtD2O0z7WTuSFGp4mZS3LSHLU/ILzwbeAO8bY+gUXOZAZ9sqpEFlKXhqhzVNMRVpZNPcsT3QgXCIakUu06NlRruTVQeV5wXVC/JDzkRy8jxvYQvcxTmW6VodlHtxigC2BciuzlvjRYfD8QVV5BwfXO0zFyMBJ/7uiHH7qknky7y1+Qij9nRunUIszY9w+3WbIgOANuhSTrqAWKIKVauhNKXpOOxyHrWfEdFuPxt7F+wJUxT0= 2021-11-06T08:09:40.155 INFO:teuthology.kill:2021-11-06 08:09:40,154.154 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-06T08:09:40.158 INFO:teuthology.kill:2021-11-06 08:09:40,158.158 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-06T08:09:40.232 INFO:teuthology.kill:2021-11-06 08:09:40,232.232 INFO:teuthology.orchestra.console:Power off smithi086 2021-11-06T08:09:40.245 INFO:teuthology.kill:2021-11-06 08:09:40,244.244 INFO:teuthology.orchestra.console:Power off smithi007 2021-11-06T08:09:52.714 INFO:teuthology.kill:2021-11-06 08:09:52,714.714 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2021-11-06T08:09:52.720 INFO:teuthology.kill:2021-11-06 08:09:52,719.719 INFO:teuthology.orchestra.console:Power off for smithi007 completed 2021-11-06T08:09:52.862 INFO:teuthology.kill:2021-11-06 08:09:52,861.861 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com 2021-11-06T08:09:52.865 INFO:teuthology.kill:2021-11-06 08:09:52,865.865 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com 2021-11-06T08:11:53.176 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-11-06T08:11:53.266 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi007 but it was locked by another job: /home/teuthworker/archive/ozeneva-2021-11-04_23:53:22-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi/6485796 2021-11-06T08:11:53.266 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi086 but it was locked by another job: /home/teuthworker/archive/ozeneva-2021-11-04_23:53:22-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi/6485796