2022-01-29T00:00:06.935 INFO:root:teuthology version: 1.1.0-7c0cb867
2022-01-29T00:00:07.082 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi110.front.sepia.ceph.com' reimaging
2022-01-29T00:00:07.083 INFO:teuthology.lock.ops:Updating [ubuntu@smithi110.front.sepia.ceph.com]: reset os type and version on server
2022-01-29T00:00:07.083 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2022-01-29T00:00:07.116 INFO:teuthology.lock.ops:Node 'ubuntu@smithi110.front.sepia.ceph.com' reimaging is complete
2022-01-29T00:00:07.116 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi188.front.sepia.ceph.com' reimaging
2022-01-29T00:00:07.116 INFO:teuthology.lock.ops:Updating [ubuntu@smithi188.front.sepia.ceph.com]: reset os type and version on server
2022-01-29T00:00:07.117 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2022-01-29T00:00:07.144 INFO:teuthology.lock.ops:Node 'ubuntu@smithi188.front.sepia.ceph.com' reimaging is complete
2022-01-29T00:00:07.324 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of rhel 8.4
2022-01-29T00:00:07.346 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of rhel 8.4
2022-01-29T00:00:07.711 INFO:teuthology.orchestra.console:Power off smithi110
2022-01-29T00:00:07.728 INFO:teuthology.orchestra.console:Power off smithi188
2022-01-29T00:00:16.101 INFO:teuthology.orchestra.console:Power off for smithi110 completed
2022-01-29T00:00:16.107 INFO:teuthology.orchestra.console:Power off for smithi188 completed
2022-01-29T00:00:16.203 INFO:teuthology.orchestra.console:Power on smithi110
2022-01-29T00:00:16.210 INFO:teuthology.orchestra.console:Power on smithi188
2022-01-29T00:00:24.579 INFO:teuthology.orchestra.console:Power on for smithi188 completed
2022-01-29T00:00:24.585 INFO:teuthology.orchestra.console:Power on for smithi110 completed
2022-01-29T00:00:24.681 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish
2022-01-29T00:00:24.685 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish
2022-01-29T00:04:56.645 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-29T00:04:56.893 INFO:teuthology.provision.fog.smithi188:Node is ready
2022-01-29T00:04:56.908 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com
2022-01-29T00:04:56.963 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188
2022-01-29T00:04:57.320 INFO:teuthology.provision.fog.smithi188:Deploy complete!
2022-01-29T00:05:05.632 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-29T00:05:05.833 INFO:teuthology.provision.fog.smithi110:Node is ready
2022-01-29T00:05:05.847 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com
2022-01-29T00:05:05.903 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110
2022-01-29T00:05:06.218 INFO:teuthology.provision.fog.smithi110:Deploy complete!
2022-01-29T00:05:06.366 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com
2022-01-29T00:05:06.367 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-29T00:05:06.387 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com
2022-01-29T00:05:06.388 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-29T00:05:06.407 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server
2022-01-29T00:05:06.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com'
2022-01-29T00:05:06.631 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64
2022-01-29T00:05:06.685 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux"
2022-01-29T00:05:06.686 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.4 (Ootpa)"
2022-01-29T00:05:06.686 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel"
2022-01-29T00:05:06.686 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora"
2022-01-29T00:05:06.687 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.4"
2022-01-29T00:05:06.687 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8"
2022-01-29T00:05:06.687 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-01-29T00:05:06.687 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2022-01-29T00:05:06.688 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-01-29T00:05:06.688 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/"
2022-01-29T00:05:06.688 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-01-29T00:05:06.688 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-29T00:05:06.688 INFO:teuthology.orchestra.run.smithi110.stdout:
2022-01-29T00:05:06.689 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-29T00:05:06.689 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-01-29T00:05:06.689 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-01-29T00:05:06.689 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-01-29T00:05:06.691 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2022-01-29T00:05:06.710 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server
2022-01-29T00:05:06.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com'
2022-01-29T00:05:06.945 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64
2022-01-29T00:05:07.000 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux"
2022-01-29T00:05:07.000 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.4 (Ootpa)"
2022-01-29T00:05:07.000 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel"
2022-01-29T00:05:07.001 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora"
2022-01-29T00:05:07.001 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.4"
2022-01-29T00:05:07.001 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8"
2022-01-29T00:05:07.001 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-01-29T00:05:07.002 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2022-01-29T00:05:07.002 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-01-29T00:05:07.002 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/"
2022-01-29T00:05:07.002 INFO:teuthology.orchestra.run.smithi188.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-01-29T00:05:07.003 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-29T00:05:07.003 INFO:teuthology.orchestra.run.smithi188.stdout:
2022-01-29T00:05:07.003 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-29T00:05:07.003 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-01-29T00:05:07.003 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-01-29T00:05:07.004 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-01-29T00:05:07.004 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2022-01-29T00:05:07.107 INFO:teuthology.dispatcher.supervisor:Running job 6646932
2022-01-29T00:05:07.107 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-28_16:15:58-rgw-wip-master-1.27.22-distro-default-smithi/6646932 --name yuriw-2022-01-28_16:15:58-rgw-wip-master-1.27.22-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{rhel_8} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2022-01-28_16:15:58-rgw-wip-master-1.27.22-distro-default-smithi/6646932/orig.config.yaml
2022-01-29T00:05:07.111 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-28_16:15:58-rgw-wip-master-1.27.22-distro-default-smithi/6646932
2022-01-29T00:05:07.112 INFO:teuthology.dispatcher.supervisor:Job PID: 16704
2022-01-29T00:05:07.112 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-29T06:35:35.350 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-29T06:35:35.535 INFO:teuthology.kill:Killing Pids: {16704}
2022-01-29T06:35:36.797 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2022-01-29T06:35:36.798 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2022-01-29T06:35:36.798 INFO:teuthology.misc:Compressing logs...
2022-01-29T06:35:36.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com'
2022-01-29T06:35:37.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com'
2022-01-29T06:35:37.474 INFO:teuthology.misc:Compressing logs...
2022-01-29T06:35:37.626 INFO:teuthology.misc:Compressing logs...
2022-01-29T06:39:38.244 INFO:teuthology.kill:No teuthology processes running
2022-01-29T06:39:39.489 INFO:teuthology.kill:Nuking machines: ['smithi110', 'smithi188']
2022-01-29T06:39:40.508 INFO:teuthology.kill:2022-01-29 06:39:40,508.508 INFO:teuthology.nuke:targets:
2022-01-29T06:39:40.509 INFO:teuthology.kill:  smithi110.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCw0ynoqkU/r9Dwp+kTRM5Pz/NutIktTfarZsM1cm8Ia8p+kBdwHAxRmOEHB/iRRqfBORtOBPkzH3Eq88BYbpz0liwLKFBrn/4eL/mLu09cwRiP1VkvE3iFv0PcyGRpafykmOD5O2vK2tIrWx+CvB83W6bL5yIXelaC5j2kgWnW3ifmt1p1ncCZgceUCNBXg63de9f5vMz57tOlk/0ErP4F949E0ui5O6LlK41TcQO31tmT2Y6m8Td2ncDm8FdfRW2kaNYMuflu6UilVxUocI89COPMiovzBk20H48nqGnsKNVW/t4RMEsCeNk7OQSk/ugt7JEAgq/r2IjmgGnLMEqVDt/Ezbok6Aq1nvByO74Zeal6BLLlF6JgVVrgd+pNN+OuB8Y2TiROYknInXjILZc/DvVCzpYZ/0i40xMei6vxcEZXlJtlc9aCBOSrN9hiO1lks0W4aeHGfl8uy46ellCRIVSh5EbX31Nc1dpl59zsJzTbomSWvvdYhhBnbx21aI0=
2022-01-29T06:39:40.510 INFO:teuthology.kill:  smithi188.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBv0KvgsNVVSvWl1g6ajaDIEaFz+lStKtAvBaoBqrrAbyHeZfscw215uq7bdFUMkpIYY4YHapJ5fXDMEdyk7CuLVmVKRQ/pLfFf758Qkb2egUnWUGmiWyhNoKNzUM+kGSpLXHee0/ZKPCTlpuJ2f/YSrjiyTZUoF7tGX5H/1EVHjMf0QwYCIReBRpRnKGK/hf9KUji88aNc290s3APDQMYJmraRqOXQA23/DsLBLuXMS6EkQmHFX4ht51Oh1u96V+LykHGzXkT/NCxXYCHWO80MxWkZZOGSngsaNoJY+7DzIpjsq5hlnH2Ruuzu+7c3/LQks3k63FYVPFgbnHmWuefb4uVB07GiLi5yA246Y3qQyNaRhUNyhmHvRqJtwVfmfMgYQeXCe1pvTQ88Tr67rU0BvheAB+Gq77+VjrmT+A7QVpzmHXbkbrqMb4waaIcRMSFUOllI4FvA6vo2GLmYqqYL0x3pIX9+jiZQiLXb93WSQYRumfUriHUjgvvuOd/ZSE=
2022-01-29T06:39:40.536 INFO:teuthology.kill:2022-01-29 06:39:40,535.535 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-29T06:39:40.539 INFO:teuthology.kill:2022-01-29 06:39:40,539.539 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-29T06:39:40.617 INFO:teuthology.kill:2022-01-29 06:39:40,617.617 INFO:teuthology.orchestra.console:Power off smithi188
2022-01-29T06:39:40.632 INFO:teuthology.kill:2022-01-29 06:39:40,631.631 INFO:teuthology.orchestra.console:Power off smithi110
2022-01-29T06:39:48.989 INFO:teuthology.kill:2022-01-29 06:39:48,988.988 INFO:teuthology.orchestra.console:Power off for smithi188 completed
2022-01-29T06:39:48.994 INFO:teuthology.kill:2022-01-29 06:39:48,994.994 INFO:teuthology.orchestra.console:Power off for smithi110 completed
2022-01-29T06:39:49.141 INFO:teuthology.kill:2022-01-29 06:39:49,140.140 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com
2022-01-29T06:39:49.144 INFO:teuthology.kill:2022-01-29 06:39:49,144.144 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com
2022-01-29T06:41:49.464 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15