2021-12-08T04:10:26.067 INFO:root:teuthology version: 1.1.0-844d1377 2021-12-08T04:10:26.193 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi037.front.sepia.ceph.com' reimaging 2021-12-08T04:10:26.195 INFO:teuthology.lock.ops:Updating [ubuntu@smithi037.front.sepia.ceph.com]: reset os type and version on server 2021-12-08T04:10:26.195 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2021-12-08T04:10:26.214 INFO:teuthology.lock.ops:Node 'ubuntu@smithi037.front.sepia.ceph.com' reimaging is complete 2021-12-08T04:10:26.214 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi115.front.sepia.ceph.com' reimaging 2021-12-08T04:10:26.214 INFO:teuthology.lock.ops:Updating [ubuntu@smithi115.front.sepia.ceph.com]: reset os type and version on server 2021-12-08T04:10:26.215 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2021-12-08T04:10:26.233 INFO:teuthology.lock.ops:Node 'ubuntu@smithi115.front.sepia.ceph.com' reimaging is complete 2021-12-08T04:10:26.420 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of ubuntu 20.04 2021-12-08T04:10:26.448 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of ubuntu 20.04 2021-12-08T04:10:26.814 INFO:teuthology.orchestra.console:Power off smithi037 2021-12-08T04:10:26.892 INFO:teuthology.orchestra.console:Power off smithi115 2021-12-08T04:10:35.260 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2021-12-08T04:10:35.362 INFO:teuthology.orchestra.console:Power on smithi115 2021-12-08T04:10:39.305 INFO:teuthology.orchestra.console:Power off for smithi037 completed 2021-12-08T04:10:39.412 INFO:teuthology.orchestra.console:Power on smithi037 2021-12-08T04:10:43.726 INFO:teuthology.orchestra.console:Power on for smithi115 completed 2021-12-08T04:10:43.828 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2021-12-08T04:10:47.779 INFO:teuthology.orchestra.console:Power on for smithi037 completed 2021-12-08T04:10:47.880 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2021-12-08T04:15:52.887 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-08T04:15:53.413 INFO:teuthology.provision.fog.smithi037:Node is ready 2021-12-08T04:15:53.420 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com 2021-12-08T04:15:53.427 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037 2021-12-08T04:15:53.654 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2021-12-08T04:16:19.104 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-08T04:16:19.644 INFO:teuthology.provision.fog.smithi115:Node is ready 2021-12-08T04:16:19.650 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2021-12-08T04:16:19.698 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2021-12-08T04:16:19.877 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2021-12-08T04:16:20.063 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2021-12-08T04:16:20.064 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-08T04:16:20.082 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2021-12-08T04:16:20.083 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-08T04:16:20.101 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2021-12-08T04:16:20.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2021-12-08T04:16:20.363 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2021-12-08T04:16:20.368 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu" 2021-12-08T04:16:20.369 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-08T04:16:20.369 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu 2021-12-08T04:16:20.369 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian 2021-12-08T04:16:20.369 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-08T04:16:20.369 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="20.04" 2021-12-08T04:16:20.370 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-08T04:16:20.370 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-08T04:16:20.370 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-08T04:16:20.370 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-08T04:16:20.371 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=focal 2021-12-08T04:16:20.371 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=focal 2021-12-08T04:16:20.372 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2021-12-08T04:16:20.390 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2021-12-08T04:16:20.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2021-12-08T04:16:20.603 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2021-12-08T04:16:20.610 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Ubuntu" 2021-12-08T04:16:20.610 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-08T04:16:20.610 INFO:teuthology.orchestra.run.smithi115.stdout:ID=ubuntu 2021-12-08T04:16:20.611 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE=debian 2021-12-08T04:16:20.611 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-08T04:16:20.611 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="20.04" 2021-12-08T04:16:20.611 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-08T04:16:20.612 INFO:teuthology.orchestra.run.smithi115.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-08T04:16:20.612 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-08T04:16:20.612 INFO:teuthology.orchestra.run.smithi115.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-08T04:16:20.612 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_CODENAME=focal 2021-12-08T04:16:20.612 INFO:teuthology.orchestra.run.smithi115.stdout:UBUNTU_CODENAME=focal 2021-12-08T04:16:20.613 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2021-12-08T04:16:20.704 INFO:teuthology.dispatcher.supervisor:Running job 6552253 2021-12-08T04:16:20.704 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_prsrivas@teuthology --archive /home/teuthworker/archive/prsrivas-2021-12-08_04:08:08-rgw-wip-rgw-abort-multipart-bypass-gc-distro-default-smithi/6552253 --name prsrivas-2021-12-08_04:08:08-rgw-wip-rgw-abort-multipart-bypass-gc-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/prsrivas-2021-12-08_04:08:08-rgw-wip-rgw-abort-multipart-bypass-gc-distro-default-smithi/6552253/orig.config.yaml 2021-12-08T04:16:20.707 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/prsrivas-2021-12-08_04:08:08-rgw-wip-rgw-abort-multipart-bypass-gc-distro-default-smithi/6552253 2021-12-08T04:16:20.708 INFO:teuthology.dispatcher.supervisor:Job PID: 16973 2021-12-08T04:16:20.708 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-12-08T16:17:15.567 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-12-08T16:17:15.796 INFO:teuthology.kill:Killing Pids: {16973} 2021-12-08T16:17:17.067 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2021-12-08T16:17:17.068 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2021-12-08T16:17:17.068 INFO:teuthology.misc:Compressing logs... 2021-12-08T16:17:17.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2021-12-08T16:17:17.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2021-12-08T16:17:17.839 INFO:teuthology.misc:Compressing logs... 2021-12-08T16:17:17.995 INFO:teuthology.misc:Compressing logs... 2021-12-08T16:24:10.689 INFO:teuthology.kill:No teuthology processes running 2021-12-08T16:24:11.981 INFO:teuthology.kill:Nuking machines: ['smithi037', 'smithi115'] 2021-12-08T16:24:13.008 INFO:teuthology.kill:2021-12-08 16:24:13,007.007 INFO:teuthology.nuke:targets: 2021-12-08T16:24:13.008 INFO:teuthology.kill: smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDvlqRiZPdlpDhF9RMWPa0I+Q7VhhiyZqPaN4wc2Y1Fh6P6DNh055fNWUhyKwNS8RjZSzpMsWVls8BhG6WCpZD7kklCDlTW3UGz08jWYY0UxMgrx5FZXxg/4ErXvg19ob5HlJQ3ar1OQQEeL0w8f3kzh6hA/Q/4D91WXTkRCk+U+RNKzs6KpximLiG8Yxud3xEVTw3OUhM6HKANBLgQJd8DJZ5gTuRoF0Nj+QJeUNounypZSviPrzHuumJ6lPk+siPjyPra7Qxpb6V7TqdsqDNO8TqtSbqdD+tAZHmTFBQV1Kgh/49OcBugc59hxBEmWWYyaNIRKGyJIj/ZV824I878bxBDkUhbkBdkY0hJKUS5Q7tKuM8ESdcStQhDGjCkK5astIvWQLQtvlfkgiAIUq0K+v1u8+hQTAUXVkT+Eh6uLPJZuEXgNOr57QoM3sRWDfcodbGSDvFChT7ufCOnrNIW4FRM01duiW/LsmP+IlQSg+ffnxGKfPuRBjvwINaEYaM= 2021-12-08T16:24:13.009 INFO:teuthology.kill: smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyuAhwEBHzA2dIXVZsZdd0jdD41sutFgT6OP7E9dLvQIcWxA2vlE0LFCFJGuP1JGyeFGYWgny5t/oGuoiwgDaGAgQHqEMhTYw2KfiNO9kJy7+d0Txvu5QRkO/NIKZgwonw9OzX0O+zvIGcZCVn5sUcSXvgfejgDJRpK9sz+pBbMsuSjWzWjdH17nNIyepE0m2eNIGrcdWE1yIgltB1ym3om7KLGX1mVnUSSwvHos0gdjzbwJEGk3doRME2a+knEH1lSVr74ZSgK16mS404erqklFS4jnzXsLdJqPI9a83L/ouG7yJxvlQ2xQpHXfcWjZr7hNOdUvt2CN4UhSC/eOYPUntG2Cwc0bhcrjI4i+6sbSlOczFMCviHpr+VwHKYrHwUOAbgNWvGHrpUpg2FQ1Ks5DCspfcS90U3oQ+4lhJd0okcPWQXfPNqUwIJ7G2Sb1zFqCbJqMdJqnzz0/JwqKPNUk97gd3V4q1Hzks8r5m6iv3DIt+6wZ+8dGbIZKJD0u0= 2021-12-08T16:24:13.042 INFO:teuthology.kill:2021-12-08 16:24:13,041.041 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-08T16:24:13.045 INFO:teuthology.kill:2021-12-08 16:24:13,044.044 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-08T16:24:13.132 INFO:teuthology.kill:2021-12-08 16:24:13,132.132 INFO:teuthology.orchestra.console:Power off smithi037 2021-12-08T16:24:13.149 INFO:teuthology.kill:2021-12-08 16:24:13,148.148 INFO:teuthology.orchestra.console:Power off smithi115 2021-12-08T16:24:25.627 INFO:teuthology.kill:2021-12-08 16:24:25,626.626 INFO:teuthology.orchestra.console:Power off for smithi037 completed 2021-12-08T16:24:25.640 INFO:teuthology.kill:2021-12-08 16:24:25,640.640 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2021-12-08T16:24:25.784 INFO:teuthology.kill:2021-12-08 16:24:25,783.783 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com 2021-12-08T16:24:25.787 INFO:teuthology.kill:2021-12-08 16:24:25,787.787 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2021-12-08T16:26:26.161 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-12-08T16:26:26.256 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi037 but it was locked by another job: /home/teuthworker/archive/ifed01-2021-12-07_17:17:06-rados-wip-ifed-daemonhistogram-distro-default-smithi/6551297 2021-12-08T16:26:26.257 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi115 but it was locked by another job: /home/teuthworker/archive/ifed01-2021-12-07_17:17:06-rados-wip-ifed-daemonhistogram-distro-default-smithi/6551297