2021-09-17T01:08:39.123 INFO:root:teuthology version: 1.1.0-63133ca9
2021-09-17T01:08:39.227 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi060.front.sepia.ceph.com' reimaging
2021-09-17T01:08:39.228 INFO:teuthology.lock.ops:Updating [ubuntu@smithi060.front.sepia.ceph.com]: reset os type and version on server
2021-09-17T01:08:39.228 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2021-09-17T01:08:39.244 INFO:teuthology.lock.ops:Node 'ubuntu@smithi060.front.sepia.ceph.com' reimaging is complete
2021-09-17T01:08:39.244 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi160.front.sepia.ceph.com' reimaging
2021-09-17T01:08:39.245 INFO:teuthology.lock.ops:Updating [ubuntu@smithi160.front.sepia.ceph.com]: reset os type and version on server
2021-09-17T01:08:39.245 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server
2021-09-17T01:08:39.265 INFO:teuthology.lock.ops:Node 'ubuntu@smithi160.front.sepia.ceph.com' reimaging is complete
2021-09-17T01:08:39.452 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of rhel 8.4
2021-09-17T01:08:39.462 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of rhel 8.4
2021-09-17T01:08:39.822 INFO:teuthology.orchestra.console:Power off smithi160
2021-09-17T01:08:39.841 INFO:teuthology.orchestra.console:Power off smithi060
2021-09-17T01:08:48.208 INFO:teuthology.orchestra.console:Power off for smithi060 completed
2021-09-17T01:08:48.309 INFO:teuthology.orchestra.console:Power on smithi060
2021-09-17T01:08:52.313 INFO:teuthology.orchestra.console:Power off for smithi160 completed
2021-09-17T01:08:52.415 INFO:teuthology.orchestra.console:Power on smithi160
2021-09-17T01:08:56.670 INFO:teuthology.orchestra.console:Power on for smithi060 completed
2021-09-17T01:08:56.771 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish
2021-09-17T01:09:00.788 INFO:teuthology.orchestra.console:Power on for smithi160 completed
2021-09-17T01:09:00.889 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish
2021-09-17T01:13:04.717 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-09-17T01:13:04.925 INFO:teuthology.provision.fog.smithi060:Node is ready
2021-09-17T01:13:04.940 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com
2021-09-17T01:13:04.996 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060
2021-09-17T01:13:05.329 INFO:teuthology.provision.fog.smithi060:Deploy complete!
2021-09-17T01:13:42.058 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-09-17T01:13:42.264 INFO:teuthology.provision.fog.smithi160:Node is ready
2021-09-17T01:13:42.279 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com
2021-09-17T01:13:42.335 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160
2021-09-17T01:13:42.658 INFO:teuthology.provision.fog.smithi160:Deploy complete!
2021-09-17T01:13:42.792 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com
2021-09-17T01:13:42.792 INFO:teuthology.lock.ops:New key found. Updating...
2021-09-17T01:13:42.809 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com
2021-09-17T01:13:42.809 INFO:teuthology.lock.ops:New key found. Updating...
2021-09-17T01:13:42.826 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server
2021-09-17T01:13:42.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com'
2021-09-17T01:13:43.076 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64
2021-09-17T01:13:43.133 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux"
2021-09-17T01:13:43.133 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.4 (Ootpa)"
2021-09-17T01:13:43.134 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel"
2021-09-17T01:13:43.134 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora"
2021-09-17T01:13:43.135 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.4"
2021-09-17T01:13:43.135 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8"
2021-09-17T01:13:43.135 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-09-17T01:13:43.136 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31"
2021-09-17T01:13:43.136 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-09-17T01:13:43.137 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/"
2021-09-17T01:13:43.137 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-09-17T01:13:43.137 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-09-17T01:13:43.138 INFO:teuthology.orchestra.run.smithi060.stdout:
2021-09-17T01:13:43.138 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-09-17T01:13:43.138 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-09-17T01:13:43.139 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-09-17T01:13:43.139 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-09-17T01:13:43.140 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2021-09-17T01:13:43.155 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server
2021-09-17T01:13:43.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com'
2021-09-17T01:13:43.373 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64
2021-09-17T01:13:43.427 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Red Hat Enterprise Linux"
2021-09-17T01:13:43.427 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8.4 (Ootpa)"
2021-09-17T01:13:43.428 INFO:teuthology.orchestra.run.smithi160.stdout:ID="rhel"
2021-09-17T01:13:43.428 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="fedora"
2021-09-17T01:13:43.428 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8.4"
2021-09-17T01:13:43.428 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8"
2021-09-17T01:13:43.429 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-09-17T01:13:43.429 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31"
2021-09-17T01:13:43.429 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-09-17T01:13:43.429 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.redhat.com/"
2021-09-17T01:13:43.430 INFO:teuthology.orchestra.run.smithi160.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-09-17T01:13:43.430 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-09-17T01:13:43.430 INFO:teuthology.orchestra.run.smithi160.stdout:
2021-09-17T01:13:43.430 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-09-17T01:13:43.430 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-09-17T01:13:43.431 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-09-17T01:13:43.431 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-09-17T01:13:43.431 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server
2021-09-17T01:13:43.504 INFO:teuthology.dispatcher.supervisor:Running job 6392829
2021-09-17T01:13:43.505 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_63133ca92c299bd23f40f94d370cf5381b0b1313/virtualenv/bin/teuthology -v --owner scheduled_ivancich@teuthology --archive /home/teuthworker/archive/ivancich-2021-09-16_17:02:02-rgw-wip-eric-testing-1-distro-basic-smithi/6392829 --name ivancich-2021-09-16_17:02:02-rgw-wip-eric-testing-1-distro-basic-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{rhel_8} tasks/test_multi} -- /home/teuthworker/archive/ivancich-2021-09-16_17:02:02-rgw-wip-eric-testing-1-distro-basic-smithi/6392829/orig.config.yaml
2021-09-17T01:13:43.508 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ivancich-2021-09-16_17:02:02-rgw-wip-eric-testing-1-distro-basic-smithi/6392829
2021-09-17T01:13:43.508 INFO:teuthology.dispatcher.supervisor:Job PID: 13435
2021-09-17T01:13:43.509 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-09-17T13:14:35.619 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-09-17T13:14:35.798 INFO:teuthology.kill:Killing Pids: {13435}
2021-09-17T13:14:37.677 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2021-09-17T13:14:37.680 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2021-09-17T13:14:37.680 INFO:teuthology.misc:Compressing logs...
2021-09-17T13:14:37.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com'
2021-09-17T13:14:37.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com'
2021-09-17T13:14:38.455 INFO:teuthology.misc:Compressing logs...
2021-09-17T13:14:38.583 INFO:teuthology.misc:Compressing logs...
2021-09-17T13:39:33.842 INFO:teuthology.kill:No teuthology processes running
2021-09-17T13:39:35.048 INFO:teuthology.kill:Nuking machines: ['smithi060', 'smithi160']
2021-09-17T13:39:36.000 INFO:teuthology.kill:2021-09-17 13:39:35,999.999 INFO:teuthology.nuke:targets:
2021-09-17T13:39:36.001 INFO:teuthology.kill:  smithi060.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA0kBfYKd1zmP2NsTjy/RAx30BXH0XyaCXK8nTHTC2Lc38Lb1xvWYGdf16JZ97HpC1vIMKwnjnf6zkL1kmXTGnaIpzeM8lhzmKdcdKMpXlAxXi6xb/9nuhpVTOfpdVeYgYrmmlWgIPmS66BLneKarwBzfy58OqQ3aH7aeq4G6a71ZjeKHKhYnvBO2ufLc7sJf65J06gbep4K9q8+YxJ6iXeNucGniePEIWD4bNNkCgS1+pLHk7LlfjncX0AvwXDVoG+G0k88NBNq3m2oBgsPk9YyTMclUaYqaBSe43PpLNcpXm2ACvwHMvjXB8gd6GGjZcdSTde88yvnYbEfAMGdaGD9q8QIgLwU2IQfhh7jqe0gbgrgvocplWG1kiKu5dCI7gqypZlsPDBWBQsJTh3Ng9MTP+gSjkPnk2pTsf8QBzj0LkRZOP+XxWWuYLvXGPE396YdOwZT+XQQLReLRwk0dby+4yZpQ9AjCK8LHk8tllHGVNI0djNFtF2fMJfQywDE0=
2021-09-17T13:39:36.001 INFO:teuthology.kill:  smithi160.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1OpS0JiVhDu0hHnzjvxJmXMwf57Q9lDYTofypU3SDF56ugKDi16cGpxQBJaMkUfEjzg4RFx7+sDAiI77PgtAtyvZpshEmQ71QIem9av2g1M8fHhK/IY9+ezSdehVl0DrvBgkCRjRk7r6Hbavr8HbfEzLPN58LtLtKnJL5YrtaoFquIcIw4KwQmuVQ4aIUabMq+0TXu1eneP1OnicvHQyMoS+6KyiD7QXDinoTmmHmOjuZiyaoweLNSGRjFi1Fbli9aeW9oPsOrI0TvldsLNXqOIHAZqhTWu1SXFYl9pESx5o0gxbjHIi0NP6oMBWOGX6xAHe//zCSi4lZMF0pUS/y3ckBB7lRytc44UVYAFTZBmku1zaNjFln5H9sq2pLkXwZpA2HUUkDAVs14k5BAQl8v4mSk6zhhP+4UByznmw03fFmwmDGHKfF+37lPKzMy856k94PtVJL5Q8dVkU+poqF/S/WgmCQn7vKn/BlPj43iD0RoxDZ2egbf+mdysWVc48=
2021-09-17T13:39:36.023 INFO:teuthology.kill:2021-09-17 13:39:36,022.022 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-09-17T13:39:36.029 INFO:teuthology.kill:2021-09-17 13:39:36,028.028 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-09-17T13:39:36.087 INFO:teuthology.kill:2021-09-17 13:39:36,087.087 INFO:teuthology.orchestra.console:Power off smithi060
2021-09-17T13:39:36.103 INFO:teuthology.kill:2021-09-17 13:39:36,103.103 INFO:teuthology.orchestra.console:Power off smithi160
2021-09-17T13:39:44.457 INFO:teuthology.kill:2021-09-17 13:39:44,457.457 INFO:teuthology.orchestra.console:Power off for smithi060 completed
2021-09-17T13:39:44.599 INFO:teuthology.kill:2021-09-17 13:39:44,599.599 INFO:teuthology.lock.ops:unlocked smithi060.front.sepia.ceph.com
2021-09-17T13:39:48.576 INFO:teuthology.kill:2021-09-17 13:39:48,575.575 INFO:teuthology.orchestra.console:Power off for smithi160 completed
2021-09-17T13:39:48.716 INFO:teuthology.kill:2021-09-17 13:39:48,716.716 INFO:teuthology.lock.ops:unlocked smithi160.front.sepia.ceph.com
2021-09-17T13:41:49.020 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15