2021-11-26T10:11:36.914 INFO:root:teuthology version: 1.1.0-a0bc3188
2021-11-26T10:11:37.033 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi072.front.sepia.ceph.com' reimaging
2021-11-26T10:11:37.034 INFO:teuthology.lock.ops:Updating [ubuntu@smithi072.front.sepia.ceph.com]: reset os type and version on server
2021-11-26T10:11:37.034 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2021-11-26T10:11:37.054 INFO:teuthology.lock.ops:Node 'ubuntu@smithi072.front.sepia.ceph.com' reimaging is complete
2021-11-26T10:11:37.054 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi111.front.sepia.ceph.com' reimaging
2021-11-26T10:11:37.055 INFO:teuthology.lock.ops:Updating [ubuntu@smithi111.front.sepia.ceph.com]: reset os type and version on server
2021-11-26T10:11:37.055 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2021-11-26T10:11:37.089 INFO:teuthology.lock.ops:Node 'ubuntu@smithi111.front.sepia.ceph.com' reimaging is complete
2021-11-26T10:11:37.254 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of rhel 8.4
2021-11-26T10:11:37.300 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of rhel 8.4
2021-11-26T10:11:37.554 INFO:teuthology.orchestra.console:Power off smithi072
2021-11-26T10:11:37.623 INFO:teuthology.orchestra.console:Power off smithi111
2021-11-26T10:11:37.694 INFO:teuthology.orchestra.console:Power off for smithi072 completed
2021-11-26T10:11:37.765 INFO:teuthology.orchestra.console:Power off for smithi111 completed
2021-11-26T10:11:37.796 INFO:teuthology.orchestra.console:Power on smithi072
2021-11-26T10:11:37.866 INFO:teuthology.orchestra.console:Power on smithi111
2021-11-26T10:11:46.187 INFO:teuthology.orchestra.console:Power on for smithi072 completed
2021-11-26T10:11:46.227 INFO:teuthology.orchestra.console:Power on for smithi111 completed
2021-11-26T10:11:46.289 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish
2021-11-26T10:11:46.328 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2021-11-26T10:16:48.029 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-26T10:16:48.270 INFO:teuthology.provision.fog.smithi111:Node is ready
2021-11-26T10:16:48.291 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2021-11-26T10:16:48.352 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2021-11-26T10:16:48.687 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2021-11-26T10:17:06.142 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-26T10:17:06.377 INFO:teuthology.provision.fog.smithi072:Node is ready
2021-11-26T10:17:06.392 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com
2021-11-26T10:17:06.448 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072
2021-11-26T10:17:06.806 INFO:teuthology.provision.fog.smithi072:Deploy complete!
2021-11-26T10:17:06.963 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com
2021-11-26T10:17:06.964 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-26T10:17:06.983 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2021-11-26T10:17:06.984 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-26T10:17:07.008 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server
2021-11-26T10:17:07.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com'
2021-11-26T10:17:07.194 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64
2021-11-26T10:17:07.248 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux"
2021-11-26T10:17:07.248 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.4 (Ootpa)"
2021-11-26T10:17:07.249 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel"
2021-11-26T10:17:07.249 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora"
2021-11-26T10:17:07.249 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.4"
2021-11-26T10:17:07.250 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8"
2021-11-26T10:17:07.250 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-11-26T10:17:07.250 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31"
2021-11-26T10:17:07.250 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-11-26T10:17:07.250 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/"
2021-11-26T10:17:07.251 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-11-26T10:17:07.251 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-26T10:17:07.251 INFO:teuthology.orchestra.run.smithi072.stdout:
2021-11-26T10:17:07.251 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-26T10:17:07.252 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-11-26T10:17:07.252 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-11-26T10:17:07.252 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-11-26T10:17:07.253 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2021-11-26T10:17:07.278 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2021-11-26T10:17:07.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2021-11-26T10:17:07.509 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2021-11-26T10:17:07.564 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux"
2021-11-26T10:17:07.564 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.4 (Ootpa)"
2021-11-26T10:17:07.565 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel"
2021-11-26T10:17:07.565 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora"
2021-11-26T10:17:07.565 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.4"
2021-11-26T10:17:07.565 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2021-11-26T10:17:07.566 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-11-26T10:17:07.566 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2021-11-26T10:17:07.566 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-11-26T10:17:07.566 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/"
2021-11-26T10:17:07.566 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-11-26T10:17:07.567 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-26T10:17:07.567 INFO:teuthology.orchestra.run.smithi111.stdout:
2021-11-26T10:17:07.567 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-26T10:17:07.567 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-11-26T10:17:07.568 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-11-26T10:17:07.568 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-11-26T10:17:07.568 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2021-11-26T10:17:07.670 INFO:teuthology.dispatcher.supervisor:Running job 6526233
2021-11-26T10:17:07.671 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a0bc318848afe71da1fbf34e1e1b44738d8e3d6d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-11-25_15:23:03-rgw-wip-yuriw-master-11.24.21-distro-basic-smithi/6526233 --name yuriw-2021-11-25_15:23:03-rgw-wip-yuriw-master-11.24.21-distro-basic-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{rhel_8} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2021-11-25_15:23:03-rgw-wip-yuriw-master-11.24.21-distro-basic-smithi/6526233/orig.config.yaml
2021-11-26T10:17:07.675 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-11-25_15:23:03-rgw-wip-yuriw-master-11.24.21-distro-basic-smithi/6526233
2021-11-26T10:17:07.676 INFO:teuthology.dispatcher.supervisor:Job PID: 11811
2021-11-26T10:17:07.676 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-26T22:17:28.683 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-26T22:17:29.114 INFO:teuthology.kill:Killing Pids: {11811}
2021-11-26T22:17:30.372 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2021-11-26T22:17:30.373 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2021-11-26T22:17:30.374 INFO:teuthology.misc:Compressing logs...
2021-11-26T22:17:30.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com'
2021-11-26T22:17:30.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2021-11-26T22:17:31.060 INFO:teuthology.misc:Compressing logs...
2021-11-26T22:17:31.221 INFO:teuthology.misc:Compressing logs...
2021-11-26T22:24:03.693 INFO:teuthology.kill:No teuthology processes running
2021-11-26T22:24:04.852 INFO:teuthology.kill:Nuking machines: ['smithi072', 'smithi111']
2021-11-26T22:24:05.955 INFO:teuthology.kill:2021-11-26 22:24:05,954.954 INFO:teuthology.nuke:targets:
2021-11-26T22:24:05.956 INFO:teuthology.kill:  smithi072.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqhkLw5RXNDtScb4UMH+FwTIyUVtGECH5GVGjBslAXzdpDKLnOHNVkauttCb/lj8wMNn4p5pAEmgnWoNmCH8+IwzrFi91xxzLbkLGbs1i7bXUK9b+45gWGGFbQgbzTRLBPjRp3tKEXqk/U/NcWl+KtICFElGTSgbY4EpAEn+iegNQWZ36KDx6y71MyVkcRNRpGApNXOQzjl25LRUWvmJfUlps+urlV0s/3a+HxWivS2isxALshALC5ZMyNnjqfDsXR8BbfIOELuMNmjAZOBSPfS6p1vtl/HGPoDLRadMy4WQLP9R3efgiW5Qche5Jjhr+MlIuBh+SGjW++HrXF86fQSRST/cP/hem3XC4NVCJ2azu8A8eqE5S0Rw2MHuvAHHG+yZL5Ze6+WQ8HgUH8F7iI4Ax/band0uJZDooGqixwGnhIAcWYQX0VI0Jssm4s8IVVEldkzD3t6nPYIyZgiD7T+i4/EPEog50Xs66hClnwx7uKobowicXrCkBKjIp5yOs=
2021-11-26T22:24:05.956 INFO:teuthology.kill:  smithi111.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwaZdVix6aB4sXPgpqQXCT2OQCMtwOT3pCq/CTB9pCfRHKWOHwHSykgGsX+VzD6jj7QITHRDy9HqiT7e1WHgPrQvzgcOpKNRwW1BNvHJxDReApQSD197HPAoLU2XMzVKhTIS2d/n0Z81f30CIrB6oUCqbkyc0njyckFaTKH4vJ5N501kQcvfxEAGlB/XgJWIMmCqNBbL4PFnaz8DIyhzdnGQBwI7uJQbTAAa+g6FzFzr1gD55F6BOQJEfnZXHTQWQsjELKmd0w1ZS0zM8LowVxu5L6qJlLwpHXFd39/kFnwDbUHDrKWX7C3oxaYRsmH9uXhNjirKO0mmClLzDzLoz0kex1rxgOrrXPKVBIOyoCCByFMULZABzBLn5RXtd/e3agHnUxr8AKSTPdbg0RHC3wFn9tLAt///0NhfaFOf4X5ZNFbYpN+VN/SmYeNW2wKzAp//w5dSnfLvws0S+ptRz7wta52J6WMmFhYDuLYoNIiOf2mWyGZiYRaGL6tbmsaeM=
2021-11-26T22:24:05.982 INFO:teuthology.kill:2021-11-26 22:24:05,982.982 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-26T22:24:05.986 INFO:teuthology.kill:2021-11-26 22:24:05,985.985 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-26T22:24:06.068 INFO:teuthology.kill:2021-11-26 22:24:06,067.067 INFO:teuthology.orchestra.console:Power off smithi111
2021-11-26T22:24:06.082 INFO:teuthology.kill:2021-11-26 22:24:06,081.081 INFO:teuthology.orchestra.console:Power off smithi072
2021-11-26T22:24:14.444 INFO:teuthology.kill:2021-11-26 22:24:14,444.444 INFO:teuthology.orchestra.console:Power off for smithi111 completed
2021-11-26T22:24:14.451 INFO:teuthology.kill:2021-11-26 22:24:14,451.451 INFO:teuthology.orchestra.console:Power off for smithi072 completed
2021-11-26T22:24:14.591 INFO:teuthology.kill:2021-11-26 22:24:14,590.590 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com
2021-11-26T22:24:14.595 INFO:teuthology.kill:2021-11-26 22:24:14,595.595 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com
2021-11-26T22:26:14.926 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-26T22:26:15.039 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi072 but it was locked by another job: /home/teuthworker/archive/sage-2021-11-26_15:35:27-rados-wip-sage4-testing-2021-11-25-1626-distro-basic-smithi/6528873
2021-11-26T22:26:15.039 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi111 but it was locked by another job: /home/teuthworker/archive/sage-2021-11-26_15:35:27-rados-wip-sage4-testing-2021-11-25-1626-distro-basic-smithi/6528873