2021-12-26T11:14:14.462 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-26T11:14:14.585 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging
2021-12-26T11:14:14.587 INFO:teuthology.lock.ops:Updating [ubuntu@smithi134.front.sepia.ceph.com]: reset os type and version on server
2021-12-26T11:14:14.587 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2021-12-26T11:14:14.607 INFO:teuthology.lock.ops:Node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging is complete
2021-12-26T11:14:14.608 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi164.front.sepia.ceph.com' reimaging
2021-12-26T11:14:14.608 INFO:teuthology.lock.ops:Updating [ubuntu@smithi164.front.sepia.ceph.com]: reset os type and version on server
2021-12-26T11:14:14.608 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2021-12-26T11:14:14.628 INFO:teuthology.lock.ops:Node 'ubuntu@smithi164.front.sepia.ceph.com' reimaging is complete
2021-12-26T11:14:14.812 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of rhel 8.4
2021-12-26T11:14:14.826 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of rhel 8.4
2021-12-26T11:14:15.117 INFO:teuthology.orchestra.console:Power off smithi134
2021-12-26T11:14:15.132 INFO:teuthology.orchestra.console:Power off smithi164
2021-12-26T11:14:23.496 INFO:teuthology.orchestra.console:Power off for smithi164 completed
2021-12-26T11:14:23.597 INFO:teuthology.orchestra.console:Power on smithi164
2021-12-26T11:14:27.599 INFO:teuthology.orchestra.console:Power off for smithi134 completed
2021-12-26T11:14:27.701 INFO:teuthology.orchestra.console:Power on smithi134
2021-12-26T11:14:31.960 INFO:teuthology.orchestra.console:Power on for smithi164 completed
2021-12-26T11:14:32.061 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish
2021-12-26T11:14:36.067 INFO:teuthology.orchestra.console:Power on for smithi134 completed
2021-12-26T11:14:36.168 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish
2021-12-26T11:18:39.139 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-26T11:18:58.246 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-26T11:18:59.390 INFO:teuthology.provision.fog.smithi134:Node is ready
2021-12-26T11:18:59.448 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com
2021-12-26T11:18:59.504 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134
2021-12-26T11:18:59.830 INFO:teuthology.provision.fog.smithi134:Deploy complete!
2021-12-26T11:19:13.257 INFO:teuthology.provision.fog.smithi164:Node is ready
2021-12-26T11:19:13.276 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com
2021-12-26T11:19:13.332 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164
2021-12-26T11:19:13.663 INFO:teuthology.provision.fog.smithi164:Deploy complete!
2021-12-26T11:19:13.842 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com
2021-12-26T11:19:13.843 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-26T11:19:13.861 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com
2021-12-26T11:19:13.861 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-26T11:19:13.879 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server
2021-12-26T11:19:13.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2021-12-26T11:19:14.112 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64
2021-12-26T11:19:14.167 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux"
2021-12-26T11:19:14.167 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.4 (Ootpa)"
2021-12-26T11:19:14.167 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel"
2021-12-26T11:19:14.168 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora"
2021-12-26T11:19:14.168 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.4"
2021-12-26T11:19:14.168 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8"
2021-12-26T11:19:14.168 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-12-26T11:19:14.169 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2021-12-26T11:19:14.169 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-12-26T11:19:14.169 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/"
2021-12-26T11:19:14.169 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-12-26T11:19:14.170 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-26T11:19:14.170 INFO:teuthology.orchestra.run.smithi134.stdout:
2021-12-26T11:19:14.170 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-26T11:19:14.170 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-12-26T11:19:14.171 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-12-26T11:19:14.171 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-12-26T11:19:14.172 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2021-12-26T11:19:14.196 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server
2021-12-26T11:19:14.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com'
2021-12-26T11:19:14.421 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64
2021-12-26T11:19:14.475 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux"
2021-12-26T11:19:14.476 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.4 (Ootpa)"
2021-12-26T11:19:14.476 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel"
2021-12-26T11:19:14.476 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora"
2021-12-26T11:19:14.476 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.4"
2021-12-26T11:19:14.477 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8"
2021-12-26T11:19:14.477 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-12-26T11:19:14.477 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2021-12-26T11:19:14.477 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-12-26T11:19:14.478 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/"
2021-12-26T11:19:14.478 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-12-26T11:19:14.478 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-26T11:19:14.478 INFO:teuthology.orchestra.run.smithi164.stdout:
2021-12-26T11:19:14.479 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-26T11:19:14.479 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-12-26T11:19:14.479 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-12-26T11:19:14.479 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-12-26T11:19:14.480 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2021-12-26T11:19:14.569 INFO:teuthology.dispatcher.supervisor:Running job 6580945
2021-12-26T11:19:14.570 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-12-23_03:05:02-rgw-master-distro-default-smithi/6580945 --name teuthology-2021-12-23_03:05:02-rgw-master-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{rhel_8} tasks/test_multi} -- /home/teuthworker/archive/teuthology-2021-12-23_03:05:02-rgw-master-distro-default-smithi/6580945/orig.config.yaml
2021-12-26T11:19:14.573 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-12-23_03:05:02-rgw-master-distro-default-smithi/6580945
2021-12-26T11:19:14.574 INFO:teuthology.dispatcher.supervisor:Job PID: 9330
2021-12-26T11:19:14.574 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-26T23:20:07.442 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-26T23:20:07.723 INFO:teuthology.kill:Killing Pids: {9330}
2021-12-26T23:20:08.978 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2021-12-26T23:20:08.979 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2021-12-26T23:20:08.979 INFO:teuthology.misc:Compressing logs...
2021-12-26T23:20:08.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2021-12-26T23:20:09.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com'
2021-12-26T23:20:09.873 INFO:teuthology.misc:Compressing logs...
2021-12-26T23:20:09.993 INFO:teuthology.misc:Compressing logs...
2021-12-26T23:26:42.903 INFO:teuthology.kill:No teuthology processes running
2021-12-26T23:26:44.063 INFO:teuthology.kill:Nuking machines: ['smithi134', 'smithi164']
2021-12-26T23:26:45.027 INFO:teuthology.kill:2021-12-26 23:26:45,027.027 INFO:teuthology.nuke:targets:
2021-12-26T23:26:45.028 INFO:teuthology.kill:  smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9bOfd5Fl4PtmzRtirO49rrYwghlZE/3npG3hnww9zv1OiQZAPhEjWGwQfe2ptNB8u+QjYBEuyC1MkkRuFeB6x4sqyU5cS/dzUikmWtlDtaA7MDJ4vVjwdvCc7PV4KDWXzHl1d0iSSQ19gwh+Q6bi8DShxZicUV/39S5NbAQm0goCYFXwFJZ8Q6D56Y81UfE2RtZ2ZQsEMMKt7wE4qVtQHXYhj53Yg01gjp8vvt/dfU/7Pae5jeMIJwi0tI4sRlvYEPdOkhNIbLY10Mo7C/ZuIIAtbe7VCBKrgl4kiXMWeHsc3xaOSg04dBaGACUsvYmiVBt47fmgI1GKHLCfz9r67W/xHqrh/1MO88o+wfDOMucAIPmaGuh5Mx7TxchkMsqb7Ds473ssrE7a9EJAc/s4wrygtBj+Vqs6bGssFYSsgGEm4e6M+iUR8zUobEWbzWGGFCcEKupOXgKj9G4jaQy5UUEfNqP4zc1tB5ayo4OIzoKETxue0soaqOganqr+uyrE=
2021-12-26T23:26:45.029 INFO:teuthology.kill:  smithi164.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyIpDo3mxbfvgOszX+fV71DRRt332Uk5pd4uzQxjXugCm2Vy+OBVuQGBZls7qZCpewMGMuKcjUruYRdP9znF/ukcZ7yMDJQ32159qjPiPW/OY13I+x9pQs1X6nsstSyLY8E4jMyEGrOkPefG4c1FkOf3Ci9c94d5E8bSQXqjcBgtZRnJdQyoav1WSz3oK2LoTb3BWwRz7fjjHrjsMU4jPcSLMshOgaTAv3Ep+PkvzO2gXJ3aKeivcSFcDzflg9i7WiQOTIdGp08cYmHAPyjjKEzvD5AkA/4AeAO5Qz98jeDCikCEeMPLONOGObobYmyDPamKAPF1zSLijOn2633qrBssQD0rii0UqQ2GNl+hjd4MzZ0QgaMktQDNHfNt3dDKY5G4jx0Em7qMVfimxkbl8MrhBiSXFYB3DU7KLWWEv5HvHv2YSl9dSI2cKT+UmcaefcwQG9cqdGiFWXnyYXvXPoW/OhOAw1iBvHZic4eaT7qH7lgDMavkNonWDibRC/FUU=
2021-12-26T23:26:45.053 INFO:teuthology.kill:2021-12-26 23:26:45,053.053 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-26T23:26:45.057 INFO:teuthology.kill:2021-12-26 23:26:45,057.057 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-26T23:26:45.131 INFO:teuthology.kill:2021-12-26 23:26:45,130.130 INFO:teuthology.orchestra.console:Power off smithi134
2021-12-26T23:26:45.144 INFO:teuthology.kill:2021-12-26 23:26:45,143.143 INFO:teuthology.orchestra.console:Power off smithi164
2021-12-26T23:26:57.616 INFO:teuthology.kill:2021-12-26 23:26:57,616.616 INFO:teuthology.orchestra.console:Power off for smithi134 completed
2021-12-26T23:26:57.623 INFO:teuthology.kill:2021-12-26 23:26:57,623.623 INFO:teuthology.orchestra.console:Power off for smithi164 completed
2021-12-26T23:26:57.766 INFO:teuthology.kill:2021-12-26 23:26:57,765.765 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com
2021-12-26T23:26:57.769 INFO:teuthology.kill:2021-12-26 23:26:57,768.768 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com
2021-12-26T23:28:58.082 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-26T23:28:58.175 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi134 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-24_13:25:02-kcephfs-nautilus-testing-default-smithi/6583566
2021-12-26T23:28:58.176 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi164 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-24_13:25:02-kcephfs-nautilus-testing-default-smithi/6583566