2022-03-03T10:48:01.235 INFO:root:teuthology version: 1.1.0-eeaeee38 2022-03-03T10:48:01.359 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi014.front.sepia.ceph.com' reimaging 2022-03-03T10:48:01.360 INFO:teuthology.lock.ops:Updating [ubuntu@smithi014.front.sepia.ceph.com]: reset os type and version on server 2022-03-03T10:48:01.361 INFO:teuthology.lock.ops:Updating smithi014.front.sepia.ceph.com on lock server 2022-03-03T10:48:01.380 INFO:teuthology.lock.ops:Node 'ubuntu@smithi014.front.sepia.ceph.com' reimaging is complete 2022-03-03T10:48:01.381 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging 2022-03-03T10:48:01.381 INFO:teuthology.lock.ops:Updating [ubuntu@smithi142.front.sepia.ceph.com]: reset os type and version on server 2022-03-03T10:48:01.381 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2022-03-03T10:48:01.400 INFO:teuthology.lock.ops:Node 'ubuntu@smithi142.front.sepia.ceph.com' reimaging is complete 2022-03-03T10:48:01.607 INFO:teuthology.provision.fog.smithi014:Scheduling deploy of ubuntu 20.04 2022-03-03T10:48:01.626 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of ubuntu 20.04 2022-03-03T10:48:01.993 INFO:teuthology.orchestra.console:Power off smithi142 2022-03-03T10:48:02.008 INFO:teuthology.orchestra.console:Power off smithi014 2022-03-03T10:48:10.371 INFO:teuthology.orchestra.console:Power off for smithi014 completed 2022-03-03T10:48:10.473 INFO:teuthology.orchestra.console:Power on smithi014 2022-03-03T10:48:14.478 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2022-03-03T10:48:14.580 INFO:teuthology.orchestra.console:Power on smithi142 2022-03-03T10:48:18.840 INFO:teuthology.orchestra.console:Power on for smithi014 completed 2022-03-03T10:48:18.846 INFO:teuthology.orchestra.console:Power on for smithi142 completed 2022-03-03T10:48:18.942 INFO:teuthology.provision.fog.smithi014:Waiting for deploy to finish 2022-03-03T10:48:18.948 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2022-03-03T10:52:56.748 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-03T10:52:57.269 INFO:teuthology.provision.fog.smithi014:Node is ready 2022-03-03T10:52:57.275 INFO:teuthology.orchestra.run.smithi014.stdout:smithi014.front.sepia.ceph.com 2022-03-03T10:52:57.282 INFO:teuthology.orchestra.run.smithi014.stdout:172.21.15.14 smithi014.front.sepia.ceph.com smithi014 2022-03-03T10:52:57.499 INFO:teuthology.provision.fog.smithi014:Deploy complete! 2022-03-03T10:53:13.448 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-03T10:53:13.960 INFO:teuthology.provision.fog.smithi142:Node is ready 2022-03-03T10:53:13.967 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2022-03-03T10:53:13.974 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2022-03-03T10:53:14.131 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2022-03-03T10:53:14.303 INFO:teuthology.lock.ops:Checking smithi014.front.sepia.ceph.com 2022-03-03T10:53:14.304 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-03T10:53:14.324 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2022-03-03T10:53:14.326 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-03T10:53:14.343 INFO:teuthology.lock.ops:Updating [smithi014.front.sepia.ceph.com]: set os type and version on server 2022-03-03T10:53:14.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi014.front.sepia.ceph.com' 2022-03-03T10:53:14.610 INFO:teuthology.orchestra.run.smithi014.stdout:x86_64 2022-03-03T10:53:14.619 INFO:teuthology.orchestra.run.smithi014.stdout:NAME="Ubuntu" 2022-03-03T10:53:14.620 INFO:teuthology.orchestra.run.smithi014.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-03-03T10:53:14.620 INFO:teuthology.orchestra.run.smithi014.stdout:ID=ubuntu 2022-03-03T10:53:14.620 INFO:teuthology.orchestra.run.smithi014.stdout:ID_LIKE=debian 2022-03-03T10:53:14.621 INFO:teuthology.orchestra.run.smithi014.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-03-03T10:53:14.621 INFO:teuthology.orchestra.run.smithi014.stdout:VERSION_ID="20.04" 2022-03-03T10:53:14.621 INFO:teuthology.orchestra.run.smithi014.stdout:HOME_URL="https://www.ubuntu.com/" 2022-03-03T10:53:14.621 INFO:teuthology.orchestra.run.smithi014.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-03-03T10:53:14.622 INFO:teuthology.orchestra.run.smithi014.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-03-03T10:53:14.622 INFO:teuthology.orchestra.run.smithi014.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-03-03T10:53:14.622 INFO:teuthology.orchestra.run.smithi014.stdout:VERSION_CODENAME=focal 2022-03-03T10:53:14.622 INFO:teuthology.orchestra.run.smithi014.stdout:UBUNTU_CODENAME=focal 2022-03-03T10:53:14.624 INFO:teuthology.lock.ops:Updating smithi014.front.sepia.ceph.com on lock server 2022-03-03T10:53:14.650 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2022-03-03T10:53:14.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2022-03-03T10:53:14.823 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2022-03-03T10:53:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu" 2022-03-03T10:53:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-03-03T10:53:14.873 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu 2022-03-03T10:53:14.873 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian 2022-03-03T10:53:14.873 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-03-03T10:53:14.873 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="20.04" 2022-03-03T10:53:14.873 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/" 2022-03-03T10:53:14.874 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-03-03T10:53:14.874 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-03-03T10:53:14.874 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-03-03T10:53:14.874 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=focal 2022-03-03T10:53:14.875 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=focal 2022-03-03T10:53:14.875 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2022-03-03T10:53:14.968 INFO:teuthology.dispatcher.supervisor:Running job 6717472 2022-03-03T10:53:14.969 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-03-03_05:07:02-rgw-pacific-distro-default-smithi/6717472 --name teuthology-2022-03-03_05:07:02-rgw-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} -- /home/teuthworker/archive/teuthology-2022-03-03_05:07:02-rgw-pacific-distro-default-smithi/6717472/orig.config.yaml 2022-03-03T10:53:14.974 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-03-03_05:07:02-rgw-pacific-distro-default-smithi/6717472 2022-03-03T10:53:14.976 INFO:teuthology.dispatcher.supervisor:Job PID: 13666 2022-03-03T10:53:14.976 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-03-03T17:23:43.973 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-03-03T17:23:44.169 INFO:teuthology.kill:Killing Pids: {13666} 2022-03-03T17:23:45.402 INFO:teuthology.task.internal:roles: ubuntu@smithi014.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2022-03-03T17:23:45.403 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2022-03-03T17:23:45.404 INFO:teuthology.misc:Compressing logs... 2022-03-03T17:23:45.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi014.front.sepia.ceph.com' 2022-03-03T17:23:45.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2022-03-03T17:23:45.933 INFO:teuthology.misc:Compressing logs... 2022-03-03T17:23:46.064 INFO:teuthology.misc:Compressing logs... 2022-03-03T17:25:54.256 INFO:teuthology.kill:No teuthology processes running 2022-03-03T17:25:55.497 INFO:teuthology.kill:Nuking machines: ['smithi014', 'smithi142'] 2022-03-03T17:25:56.605 INFO:teuthology.kill:2022-03-03 17:25:56,604.604 INFO:teuthology.nuke:targets: 2022-03-03T17:25:56.606 INFO:teuthology.kill: smithi014.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLD5sS01wrArbZDamtkYWTx+vpwxLAt8KbIXPSd/ErOxsfrjHmnfB2zA1kmF86WTQwUeTAyOW/Vfmdb8XxPsLICscM56jZNp63LJPM2Cmp31kvykwz8Ed0SJ4XEIydhmXzwiaJM+v2gSVKjzLg2b4rrZklRNeuLUcXdV3BujMvskcuh/NsZPr7JAuBPjp4mu7CaPPixJB5z5UPM4xkB86kAs1crkOdZtk/h9Z9yBKkZWeSdf6EogVL7nGfYpu75GwQ3Rvrg0nXqQh1Qadm8rBlD4bfoOLMCViKRI5kJEa0bj2GWyPSn2cMdGQDpDQjgo9L9bRfGsgE5VIW41kU6xJWhHKulXGXQHbe2BgI1uBfvxZ1migJJ3M1xQFxJyUhQ/kZl7bz7ksYHKlgI+RIsiMEe1UBKNC5EohPAHOyXYxsSNGRrRJx5Kzby1Bv/ZNC6ntvem7cb9RUNVBCrCrHHfXMApPzYyQ5dbuSg3E5wSgzCmnn3QC9VRUclhbW+iOonYU= 2022-03-03T17:25:56.606 INFO:teuthology.kill: smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwITRXjG/CmjSSuT1CYkXsBple5JHQ7/zs0M9+pJ9yGRPuPkvGA4ldVQrog0xSQsykWKpR+kbQ80ODU32IMiO03IXLqxUuVhLjzseKqOyKPgVbobLN9OIqB1Tm38+4RlLsrX8TltUlVXnbzu9cMUahbTLg2Fmg/m4nVVxmL2m0zNs1MulSgJg8IyBOJmOls2MHvuQcqAOuJ/W0jD4PvbBZM5vTMOPPG9SlwzA7ZayVTRjXwwrofQ9yc9OEHEzoJPKvZHxhcvParzEI+TxGfPdgAjVykAVB1isVfLlsiBFbdBxWoHWkHr+bTOL+vr8SaPKwu/H11kfnpN8NGv+OJzBF2ql29UbtxbUDau6DrPpYrczlh8l29DMZEV2aAlTlEjNLV/x8I7dmqJRrEGh6XmKyfoZcvjHYnGCbIEs//pK46ATMJH3eNcdAmuklV/XyosxDoyIu5kueebs9FljsutVs+w3XNp1jNU2S43wPEV+dGU56FRcj1dEStUGqGDwzVcc= 2022-03-03T17:25:56.634 INFO:teuthology.kill:2022-03-03 17:25:56,633.633 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-03T17:25:56.638 INFO:teuthology.kill:2022-03-03 17:25:56,638.638 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-03T17:25:56.716 INFO:teuthology.kill:2022-03-03 17:25:56,716.716 INFO:teuthology.orchestra.console:Power off smithi014 2022-03-03T17:25:56.729 INFO:teuthology.kill:2022-03-03 17:25:56,729.729 INFO:teuthology.orchestra.console:Power off smithi142 2022-03-03T17:26:05.098 INFO:teuthology.kill:2022-03-03 17:26:05,097.097 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2022-03-03T17:26:05.245 INFO:teuthology.kill:2022-03-03 17:26:05,244.244 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com 2022-03-03T17:26:09.202 INFO:teuthology.kill:2022-03-03 17:26:09,202.202 INFO:teuthology.orchestra.console:Power off for smithi014 completed 2022-03-03T17:26:09.348 INFO:teuthology.kill:2022-03-03 17:26:09,348.348 INFO:teuthology.lock.ops:unlocked: smithi014.front.sepia.ceph.com 2022-03-03T17:28:09.688 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-03-03T17:28:09.785 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi014 but it was locked by another job: /home/teuthworker/archive/mrfreezeex-2022-03-03_16:08:47-rbd-wip-mrfreezeex-multipeer-2-distro-default-smithi/6718600 2022-03-03T17:28:09.786 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi142 but it was locked by another job: /home/teuthworker/archive/mrfreezeex-2022-03-03_16:08:47-rbd-wip-mrfreezeex-multipeer-2-distro-default-smithi/6718600