2021-12-16T07:57:29.641 INFO:root:teuthology version: 1.1.0-95a7d479 2021-12-16T07:57:29.766 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi005.front.sepia.ceph.com' reimaging 2021-12-16T07:57:29.767 INFO:teuthology.lock.ops:Updating [ubuntu@smithi005.front.sepia.ceph.com]: reset os type and version on server 2021-12-16T07:57:29.767 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2021-12-16T07:57:29.786 INFO:teuthology.lock.ops:Node 'ubuntu@smithi005.front.sepia.ceph.com' reimaging is complete 2021-12-16T07:57:29.786 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging 2021-12-16T07:57:29.787 INFO:teuthology.lock.ops:Updating [ubuntu@smithi036.front.sepia.ceph.com]: reset os type and version on server 2021-12-16T07:57:29.787 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2021-12-16T07:57:29.804 INFO:teuthology.lock.ops:Node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging is complete 2021-12-16T07:57:29.999 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of ubuntu 20.04 2021-12-16T07:57:30.008 INFO:teuthology.provision.fog.smithi036:Scheduling deploy of ubuntu 20.04 2021-12-16T07:57:30.312 INFO:teuthology.orchestra.console:Power off smithi005 2021-12-16T07:57:30.326 INFO:teuthology.orchestra.console:Power off smithi036 2021-12-16T07:57:38.684 INFO:teuthology.orchestra.console:Power off for smithi005 completed 2021-12-16T07:57:38.786 INFO:teuthology.orchestra.console:Power on smithi005 2021-12-16T07:57:42.808 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2021-12-16T07:57:42.910 INFO:teuthology.orchestra.console:Power on smithi036 2021-12-16T07:57:47.158 INFO:teuthology.orchestra.console:Power on for smithi005 completed 2021-12-16T07:57:47.259 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2021-12-16T07:57:51.271 INFO:teuthology.orchestra.console:Power on for smithi036 completed 2021-12-16T07:57:51.372 INFO:teuthology.provision.fog.smithi036:Waiting for deploy to finish 2021-12-16T08:03:11.441 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-16T08:03:11.969 INFO:teuthology.provision.fog.smithi036:Node is ready 2021-12-16T08:03:11.976 INFO:teuthology.orchestra.run.smithi036.stdout:smithi036.front.sepia.ceph.com 2021-12-16T08:03:11.984 INFO:teuthology.orchestra.run.smithi036.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2021-12-16T08:03:12.228 INFO:teuthology.provision.fog.smithi036:Deploy complete! 2021-12-16T08:03:36.939 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-16T08:03:37.496 INFO:teuthology.provision.fog.smithi005:Node is ready 2021-12-16T08:03:37.543 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2021-12-16T08:03:37.550 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2021-12-16T08:03:37.735 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2021-12-16T08:03:37.958 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2021-12-16T08:03:37.959 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-16T08:03:37.979 INFO:teuthology.lock.ops:Checking smithi036.front.sepia.ceph.com 2021-12-16T08:03:37.979 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-16T08:03:38.002 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2021-12-16T08:03:38.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2021-12-16T08:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2021-12-16T08:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Ubuntu" 2021-12-16T08:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-16T08:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout:ID=ubuntu 2021-12-16T08:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE=debian 2021-12-16T08:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-16T08:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="20.04" 2021-12-16T08:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-16T08:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-16T08:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-16T08:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-16T08:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_CODENAME=focal 2021-12-16T08:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout:UBUNTU_CODENAME=focal 2021-12-16T08:03:38.192 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2021-12-16T08:03:38.209 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: set os type and version on server 2021-12-16T08:03:38.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com' 2021-12-16T08:03:38.478 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64 2021-12-16T08:03:38.483 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="Ubuntu" 2021-12-16T08:03:38.484 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-16T08:03:38.484 INFO:teuthology.orchestra.run.smithi036.stdout:ID=ubuntu 2021-12-16T08:03:38.484 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE=debian 2021-12-16T08:03:38.485 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-16T08:03:38.485 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="20.04" 2021-12-16T08:03:38.485 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-16T08:03:38.485 INFO:teuthology.orchestra.run.smithi036.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-16T08:03:38.485 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-16T08:03:38.486 INFO:teuthology.orchestra.run.smithi036.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-16T08:03:38.486 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_CODENAME=focal 2021-12-16T08:03:38.486 INFO:teuthology.orchestra.run.smithi036.stdout:UBUNTU_CODENAME=focal 2021-12-16T08:03:38.487 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2021-12-16T08:03:38.578 INFO:teuthology.dispatcher.supervisor:Running job 6566054 2021-12-16T08:03:38.759 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-12-16_05:07:02-rgw-pacific-distro-default-smithi/6566054 --name teuthology-2021-12-16_05:07:02-rgw-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} -- /home/teuthworker/archive/teuthology-2021-12-16_05:07:02-rgw-pacific-distro-default-smithi/6566054/orig.config.yaml 2021-12-16T08:03:38.763 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-12-16_05:07:02-rgw-pacific-distro-default-smithi/6566054 2021-12-16T08:03:38.764 INFO:teuthology.dispatcher.supervisor:Job PID: 10936 2021-12-16T08:03:38.764 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-12-16T20:04:32.535 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-12-16T20:04:32.697 INFO:teuthology.kill:Killing Pids: {10936} 2021-12-16T20:04:33.852 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2021-12-16T20:04:33.853 INFO:teuthology.task.internal:roles: ubuntu@smithi036.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2021-12-16T20:04:33.853 INFO:teuthology.misc:Compressing logs... 2021-12-16T20:04:33.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2021-12-16T20:04:34.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com' 2021-12-16T20:04:34.335 INFO:teuthology.misc:Compressing logs... 2021-12-16T20:04:34.469 INFO:teuthology.misc:Compressing logs... 2021-12-16T20:08:28.680 INFO:teuthology.kill:No teuthology processes running 2021-12-16T20:08:29.900 INFO:teuthology.kill:Nuking machines: ['smithi005', 'smithi036'] 2021-12-16T20:08:30.863 INFO:teuthology.kill:2021-12-16 20:08:30,862.862 INFO:teuthology.nuke:targets: 2021-12-16T20:08:30.864 INFO:teuthology.kill: smithi005.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7Brj1zHozidSZ6arTtwYUErDqjCWmydnTuzjn75QXLNliGfsvDITq2ouaDLHgtmCBoFq9y4L3q5N/sV8iT6kVZNaFlWMwqWoNBxcDjRyfUoE1U5UbPhsoSi+WhQXnThJ992OnFjy85xTYHzUCPVjjfkDpSaegVEHprRFGdgGReC4Pk8uljeABH5t8PM9cqHE6gPQ9HEAkwjr24CccXsTHtcq7v96+i2Nq6b8wPoWwghrT5iDM7mvRnqz7U4CBImMN5nQ4IWJ0rjuax80cQ1MurUPKnSVL8mNFR/Lj4ZF+3uNpj7uW1swRsO2rEAbqBRScZ3IOBCA8IN5C5sLrIrWYa1Ux47dQJAyC8/yGPpjvpi1BDW30o4m4EjrSwM1H8Y6PXs2LThTeE+j3yCDN7hL32VCtm7+CLPPPCbYWf1z5o7HCoLMfCYEMLt8XAudPHybpFDEKg4EULOzgUvK3raeYzcefww0E25pznAQ6h6JKqsxtMtl5wVqBopsOeLv5S7s= 2021-12-16T20:08:30.864 INFO:teuthology.kill: smithi036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLd8X6Thg9LKrMfNxv73vZGbrZhBfHu/OSLV11lpXIBEF/bUf/E6Q1UyBERrC13mRZ4CXBGdTvN7aKjJ1JgbIXHKNLP3U4vPPv7cd5y7FvsSfMRwGzH+UOy8tHJkHKcgR1jqreYh4LTMfg8c3S92WS7QLKnq42jmxZkt3meOfK/SoCnQVZqSVpHGjNiBjFe6HR8uVnCUeHeMEEVZS04KrkcT1/q0zX3e9P5Qfq0G8L//a3Um2/8I+zjZZwKwexpSMT1UZBoDlo2Cq6LASHyj2B8pTNHqJyFaN5jQND2Y0ap/VxJ1S+arWkN55DjepB11Cwq/RS3RT60Lg5jsKusiIxlm4k/lDTrJCXC4OYvxGnZhny+fBfJnykSLWleDNw+zjshlY9alOY+TuThYog8YMZuJHKUsBrfjP+o/72JB81t4C/d1t/Q0/HpQk980lyAWGZGofo/6xfsmHbBg744HLc4S7wrW66W/gvuI6+Jc5G1AlXVYX0Yqovagw6MB4/ASE= 2021-12-16T20:08:30.890 INFO:teuthology.kill:2021-12-16 20:08:30,890.890 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-16T20:08:30.894 INFO:teuthology.kill:2021-12-16 20:08:30,894.894 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-16T20:08:30.971 INFO:teuthology.kill:2021-12-16 20:08:30,971.971 INFO:teuthology.orchestra.console:Power off smithi036 2021-12-16T20:08:30.985 INFO:teuthology.kill:2021-12-16 20:08:30,984.984 INFO:teuthology.orchestra.console:Power off smithi005 2021-12-16T20:08:39.343 INFO:teuthology.kill:2021-12-16 20:08:39,342.342 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2021-12-16T20:08:39.501 INFO:teuthology.kill:2021-12-16 20:08:39,500.500 INFO:teuthology.lock.ops:unlocked: smithi036.front.sepia.ceph.com 2021-12-16T20:08:43.463 INFO:teuthology.kill:2021-12-16 20:08:43,462.462 INFO:teuthology.orchestra.console:Power off for smithi005 completed 2021-12-16T20:08:43.611 INFO:teuthology.kill:2021-12-16 20:08:43,611.611 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com 2021-12-16T20:10:43.924 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-12-16T20:10:44.033 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi005 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-16_06:00:02-rbd-octopus-distro-default-smithi/6566140