2021-11-05T21:05:12.090 INFO:root:teuthology version: 1.1.0-27954452 2021-11-05T21:05:12.237 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi080.front.sepia.ceph.com' reimaging 2021-11-05T21:05:12.238 INFO:teuthology.lock.ops:Updating [ubuntu@smithi080.front.sepia.ceph.com]: reset os type and version on server 2021-11-05T21:05:12.239 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2021-11-05T21:05:12.256 INFO:teuthology.lock.ops:Node 'ubuntu@smithi080.front.sepia.ceph.com' reimaging is complete 2021-11-05T21:05:12.256 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi089.front.sepia.ceph.com' reimaging 2021-11-05T21:05:12.257 INFO:teuthology.lock.ops:Updating [ubuntu@smithi089.front.sepia.ceph.com]: reset os type and version on server 2021-11-05T21:05:12.257 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2021-11-05T21:05:12.275 INFO:teuthology.lock.ops:Node 'ubuntu@smithi089.front.sepia.ceph.com' reimaging is complete 2021-11-05T21:05:12.481 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of ubuntu 20.04 2021-11-05T21:05:12.494 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of ubuntu 20.04 2021-11-05T21:05:12.826 INFO:teuthology.orchestra.console:Power off smithi080 2021-11-05T21:05:12.877 INFO:teuthology.orchestra.console:Power off smithi089 2021-11-05T21:05:21.234 INFO:teuthology.orchestra.console:Power off for smithi089 completed 2021-11-05T21:05:21.335 INFO:teuthology.orchestra.console:Power on smithi089 2021-11-05T21:05:25.303 INFO:teuthology.orchestra.console:Power off for smithi080 completed 2021-11-05T21:05:25.405 INFO:teuthology.orchestra.console:Power on smithi080 2021-11-05T21:05:29.663 INFO:teuthology.orchestra.console:Power on for smithi080 completed 2021-11-05T21:05:29.689 INFO:teuthology.orchestra.console:Power on for smithi089 completed 2021-11-05T21:05:29.765 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish 2021-11-05T21:05:29.791 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2021-11-05T21:11:17.196 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-05T21:11:17.212 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-05T21:11:17.733 INFO:teuthology.provision.fog.smithi089:Node is ready 2021-11-05T21:11:17.740 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com 2021-11-05T21:11:17.754 INFO:teuthology.provision.fog.smithi080:Node is ready 2021-11-05T21:11:17.791 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089 2021-11-05T21:11:17.802 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com 2021-11-05T21:11:17.809 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080 2021-11-05T21:11:17.959 INFO:teuthology.provision.fog.smithi080:Deploy complete! 2021-11-05T21:11:17.964 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2021-11-05T21:11:18.140 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com 2021-11-05T21:11:18.141 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-05T21:11:18.159 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2021-11-05T21:11:18.159 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-05T21:11:18.176 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server 2021-11-05T21:11:18.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2021-11-05T21:11:18.355 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2021-11-05T21:11:18.360 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Ubuntu" 2021-11-05T21:11:18.361 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-05T21:11:18.361 INFO:teuthology.orchestra.run.smithi080.stdout:ID=ubuntu 2021-11-05T21:11:18.361 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE=debian 2021-11-05T21:11:18.362 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-05T21:11:18.362 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="20.04" 2021-11-05T21:11:18.362 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-05T21:11:18.362 INFO:teuthology.orchestra.run.smithi080.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-05T21:11:18.362 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-05T21:11:18.363 INFO:teuthology.orchestra.run.smithi080.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-05T21:11:18.363 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_CODENAME=focal 2021-11-05T21:11:18.363 INFO:teuthology.orchestra.run.smithi080.stdout:UBUNTU_CODENAME=focal 2021-11-05T21:11:18.364 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2021-11-05T21:11:18.382 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2021-11-05T21:11:18.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2021-11-05T21:11:18.554 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2021-11-05T21:11:18.560 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2021-11-05T21:11:18.560 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-05T21:11:18.560 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2021-11-05T21:11:18.561 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2021-11-05T21:11:18.561 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-05T21:11:18.561 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="20.04" 2021-11-05T21:11:18.561 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-05T21:11:18.562 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-05T21:11:18.562 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-05T21:11:18.562 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-05T21:11:18.562 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=focal 2021-11-05T21:11:18.562 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=focal 2021-11-05T21:11:18.563 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2021-11-05T21:11:18.652 INFO:teuthology.dispatcher.supervisor:Running job 6488089 2021-11-05T21:11:18.652 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology -v --owner scheduled_dang@sidious.arb.redhat.com --archive /home/teuthworker/archive/dang-2021-11-05_15:25:42-rgw-wip-dang-zipper-doc-distro-basic-smithi/6488089 --name dang-2021-11-05_15:25:42-rgw-wip-dang-zipper-doc-distro-basic-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/dang-2021-11-05_15:25:42-rgw-wip-dang-zipper-doc-distro-basic-smithi/6488089/orig.config.yaml 2021-11-05T21:11:18.655 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dang-2021-11-05_15:25:42-rgw-wip-dang-zipper-doc-distro-basic-smithi/6488089 2021-11-05T21:11:18.656 INFO:teuthology.dispatcher.supervisor:Job PID: 18951 2021-11-05T21:11:18.656 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-11-06T09:12:09.828 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-11-06T09:12:10.012 INFO:teuthology.kill:Killing Pids: {18951} 2021-11-06T09:12:11.176 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2021-11-06T09:12:11.176 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2021-11-06T09:12:11.177 INFO:teuthology.misc:Compressing logs... 2021-11-06T09:12:11.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2021-11-06T09:12:11.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2021-11-06T09:12:11.854 INFO:teuthology.misc:Compressing logs... 2021-11-06T09:12:11.958 INFO:teuthology.misc:Compressing logs... 2021-11-06T09:19:04.024 INFO:teuthology.kill:No teuthology processes running 2021-11-06T09:19:05.135 INFO:teuthology.kill:Nuking machines: ['smithi080', 'smithi089'] 2021-11-06T09:19:06.077 INFO:teuthology.kill:2021-11-06 09:19:06,076.076 INFO:teuthology.nuke:targets: 2021-11-06T09:19:06.079 INFO:teuthology.kill: smithi080.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkF1EcniWIbpIZjLw1haPDUtqkFYfWmCIgupIV6zJXMcUFHPJOrsLulPNxtRCyyPUssTCbYlDZkFYKW9h+Hz4K79HdBekcRT6PmaiR3hYoQQt1g3hzUWPwFxpGeMM+4lsT9cz83GkniJYIA7gVRXdHSMrC/5I0NXL6zUobpGZm2bwy8QEKkpgroFUKK+M8GQRB+o53s/WWsfzkd1UJZiZ9gnC5resrDhJbPl92iuS+UngNH0ETn07KzZNCaZeiF2CAx1qea429i0jS6ULg9NZ55s29QBCKpcMm6fNRNcoTJrXwPj2f3aaTRCgdRkf2JqenYc6ZpRJL7iJ4/NYfFPs/DOuGxPGvWqKlZgNGKaRaHWgVt1FEkkGjr/V2+940VjkE0J/ptFWFfpCgZz88i7Fpzlpo81XAdW53izDZIpplUD/3JhAR7KM6p38Cpiv1yOQ1B+2/bIIVQIb63gJkkfQ4M9/Hm9I5jxAmw8fyS+4M8k5MijtuG0TnbRYTSZoYWl8= 2021-11-06T09:19:06.079 INFO:teuthology.kill: smithi089.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu2EIJ7MT0RxlOjBb5HOPeMEgak6Koe4/cUi0b8UKVkqnQ/tRujBD4x5sCBiLmy6nxVmPpGhEhBFhIjV+qmy1j4C2It0KFCH0+qDxMFXfnneAwDVvkVitgclNu8+swZKsbL/fF4AofAexJY7ujMXkkNno8y2FnJy0w1KBgQs89hvybE3719+tZetvDrjkuHePW4b+no/YU0K8jSZCn85DznXdggAd+XCpxOxGlonSGfC8GriJQVG5d90TbCY96DpX6u/NmD1aQUeof0J/tcY9fTnx/gst9/3l5XJcGvwVeaL+2OU++FiIMnyC4ahsONQreSBuN/uQynXE72UGkW6MmCoQQtv7Df3c5ypuRxuO2l2Yr0wwT4EWMnCJoSAG9hNrjSZRVmzSh1J0JUKBglkXTLce+4Bl4go76Zt1B6qeSyPevs803KlkiDou3brpPIi9GkqRJAP0Bh76WuLgxS5WLAcydB2RLw/ChWrjLDzOH8lGyuQufefyyKDqQt11RcXk= 2021-11-06T09:19:06.103 INFO:teuthology.kill:2021-11-06 09:19:06,103.103 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-06T09:19:06.106 INFO:teuthology.kill:2021-11-06 09:19:06,106.106 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-06T09:19:06.181 INFO:teuthology.kill:2021-11-06 09:19:06,181.181 INFO:teuthology.orchestra.console:Power off smithi080 2021-11-06T09:19:06.195 INFO:teuthology.kill:2021-11-06 09:19:06,194.194 INFO:teuthology.orchestra.console:Power off smithi089 2021-11-06T09:19:14.560 INFO:teuthology.kill:2021-11-06 09:19:14,559.559 INFO:teuthology.orchestra.console:Power off for smithi089 completed 2021-11-06T09:19:14.707 INFO:teuthology.kill:2021-11-06 09:19:14,706.706 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com 2021-11-06T09:19:18.666 INFO:teuthology.kill:2021-11-06 09:19:18,666.666 INFO:teuthology.orchestra.console:Power off for smithi080 completed 2021-11-06T09:19:18.810 INFO:teuthology.kill:2021-11-06 09:19:18,810.810 INFO:teuthology.lock.ops:unlocked: smithi080.front.sepia.ceph.com 2021-11-06T09:21:19.059 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-11-06T09:21:19.155 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi080 but it was locked by another job: /home/teuthworker/archive/ozeneva-2021-11-04_23:53:22-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi/6485834 2021-11-06T09:21:19.156 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi089 but it was locked by another job: /home/teuthworker/archive/ozeneva-2021-11-04_23:53:22-rados-wip-omri-tracer-opentelemetry-distro-basic-smithi/6485834