2022-09-04T18:58:56.931 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-09-04T18:58:57.065 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging
2022-09-04T18:58:57.067 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server
2022-09-04T18:58:57.067 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2022-09-04T18:58:57.087 INFO:teuthology.lock.ops:Node 'smithi006.front.sepia.ceph.com' reimaging is complete
2022-09-04T18:58:57.088 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging
2022-09-04T18:58:57.088 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server
2022-09-04T18:58:57.088 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2022-09-04T18:58:57.109 INFO:teuthology.lock.ops:Node 'smithi175.front.sepia.ceph.com' reimaging is complete
2022-09-04T18:58:57.304 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of rhel 8.6
2022-09-04T18:58:57.344 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of rhel 8.6
2022-09-04T18:58:57.639 INFO:teuthology.orchestra.console:Power off smithi006
2022-09-04T18:58:57.684 INFO:teuthology.orchestra.console:Power off smithi175
2022-09-04T18:58:57.796 INFO:teuthology.orchestra.console:Power off for smithi006 completed
2022-09-04T18:58:57.829 INFO:teuthology.orchestra.console:Power off for smithi175 completed
2022-09-04T18:58:57.898 INFO:teuthology.orchestra.console:Power on smithi006
2022-09-04T18:58:57.931 INFO:teuthology.orchestra.console:Power on smithi175
2022-09-04T18:59:02.156 INFO:teuthology.orchestra.console:Power on for smithi006 completed
2022-09-04T18:59:02.257 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish
2022-09-04T18:59:06.295 INFO:teuthology.orchestra.console:Power on for smithi175 completed
2022-09-04T18:59:06.396 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish
2022-09-04T19:03:18.785 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-04T19:03:19.045 INFO:teuthology.provision.fog.smithi006:Node is ready
2022-09-04T19:03:19.064 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com
2022-09-04T19:03:19.123 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006
2022-09-04T19:03:19.473 INFO:teuthology.provision.fog.smithi006:Deploy complete!
2022-09-04T19:03:37.922 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-04T19:03:38.183 INFO:teuthology.provision.fog.smithi175:Node is ready
2022-09-04T19:03:38.201 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com
2022-09-04T19:03:38.261 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175
2022-09-04T19:03:38.617 INFO:teuthology.provision.fog.smithi175:Deploy complete!
2022-09-04T19:03:38.818 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com
2022-09-04T19:03:38.819 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-04T19:03:38.840 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com
2022-09-04T19:03:38.840 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-04T19:03:38.860 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server
2022-09-04T19:03:38.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com'
2022-09-04T19:03:39.130 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64
2022-09-04T19:03:39.188 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux"
2022-09-04T19:03:39.188 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)"
2022-09-04T19:03:39.189 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel"
2022-09-04T19:03:39.189 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora"
2022-09-04T19:03:39.190 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6"
2022-09-04T19:03:39.190 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8"
2022-09-04T19:03:39.190 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-09-04T19:03:39.191 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31"
2022-09-04T19:03:39.191 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-09-04T19:03:39.191 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/"
2022-09-04T19:03:39.192 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-09-04T19:03:39.192 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-04T19:03:39.192 INFO:teuthology.orchestra.run.smithi006.stdout:
2022-09-04T19:03:39.193 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-04T19:03:39.193 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-09-04T19:03:39.193 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-09-04T19:03:39.194 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-09-04T19:03:39.195 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2022-09-04T19:03:39.216 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server
2022-09-04T19:03:39.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com'
2022-09-04T19:03:39.418 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64
2022-09-04T19:03:39.475 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux"
2022-09-04T19:03:39.475 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)"
2022-09-04T19:03:39.475 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel"
2022-09-04T19:03:39.475 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora"
2022-09-04T19:03:39.476 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6"
2022-09-04T19:03:39.476 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8"
2022-09-04T19:03:39.476 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-09-04T19:03:39.476 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31"
2022-09-04T19:03:39.477 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-09-04T19:03:39.477 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/"
2022-09-04T19:03:39.477 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-09-04T19:03:39.477 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-04T19:03:39.477 INFO:teuthology.orchestra.run.smithi175.stdout:
2022-09-04T19:03:39.478 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-04T19:03:39.478 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-09-04T19:03:39.478 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-09-04T19:03:39.478 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-09-04T19:03:39.479 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2022-09-04T19:03:39.578 INFO:teuthology.dispatcher.supervisor:Running job 7010799
2022-09-04T19:03:39.579 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2022-09-04_17:54:41-rgw-wip-cbodley-testing-distro-default-smithi/7010799 --name cbodley-2022-09-04_17:54:41-rgw-wip-cbodley-testing-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{rhel_8} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2022-09-04_17:54:41-rgw-wip-cbodley-testing-distro-default-smithi/7010799/orig.config.yaml
2022-09-04T19:03:39.583 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2022-09-04_17:54:41-rgw-wip-cbodley-testing-distro-default-smithi/7010799
2022-09-04T19:03:39.584 INFO:teuthology.dispatcher.supervisor:Job PID: 10935
2022-09-04T19:03:39.584 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-09-05T07:04:37.811 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-09-05T07:04:38.012 INFO:teuthology.kill:Killing Pids: {10935}
2022-09-05T07:04:39.543 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2022-09-05T07:04:39.544 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2022-09-05T07:04:39.545 INFO:teuthology.misc:Compressing logs...
2022-09-05T07:04:39.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com'
2022-09-05T07:04:39.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com'
2022-09-05T07:04:40.205 INFO:teuthology.misc:Compressing logs...
2022-09-05T07:04:40.333 INFO:teuthology.misc:Compressing logs...
2022-09-05T07:06:46.547 INFO:teuthology.kill:No teuthology processes running
2022-09-05T07:06:48.212 INFO:teuthology.kill:Nuking machines: ['smithi006', 'smithi175']
2022-09-05T07:06:49.704 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-09-05T07:06:49.705 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-09-05T07:06:49.705 INFO:teuthology.kill:2022-09-05 07:06:49,703.703 INFO:teuthology.nuke:targets:
2022-09-05T07:06:49.705 INFO:teuthology.kill:  smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGVEcd1TB98JVsmbED9crrFeeBr2iAHpDGh4zu9fEvRcEmrWYGmJdTnykdVxX1XbFhtFC/KXQHxtqww7724/8XY=
2022-09-05T07:06:49.706 INFO:teuthology.kill:  smithi175.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSyQ2a63tO6DEpX8FugcIrJOPT3EjpypC2OHIOqP1Cg3wEWaGd9YjBfo+N1zXZKGKLs9K02EhnqOjlDBYk2+F0lbFUon9ggiDGt4WCdIVHbNIBtcNy64ztZ8mzV/wo8Rth3ycnwDZVKvwqpHUMMwPweAKDLsVb12cOIeooiXsWzyEBH1GMFv/GqPysJ8iQUNwx/psIa2xNh3eXJTU2bAcVWX0ltZEkVbY9zgd0u8323MPnWJnzU6OI8gcjvsi3cDCkWM+LKynILFLWjLsQ0D6L6jfNy0yE4AkwgZi2wFrKNg9d8R20A3wPHr7iPJjMPNO+JvGedQ1eYrtc2BCFBFQRlfInWL2kjIYcYxICCwd6YhvdStWlKnXxYHTGRa/sp6DGujCNL/8Vf9RBr7PxQCbr/Kpm51eCefLhmaV0Js/FSfCql3+xS9LEEc8w524nM7Mr/K3lHQ3RoYqRSJexcs4BzSGzY8idpAfBpkRr5OeUgqFuWgSJq2/vWH6ElRTvX50=
2022-09-05T07:06:49.706 INFO:teuthology.kill:2022-09-05 07:06:49,704.704 INFO:teuthology.nuke:Checking targets against current locks
2022-09-05T07:06:49.767 INFO:teuthology.kill:2022-09-05 07:06:49,766.766 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-05T07:06:49.799 INFO:teuthology.kill:2022-09-05 07:06:49,799.799 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-05T07:06:49.872 INFO:teuthology.kill:2022-09-05 07:06:49,871.871 INFO:teuthology.orchestra.console:Power off smithi006
2022-09-05T07:06:49.919 INFO:teuthology.kill:2022-09-05 07:06:49,919.919 INFO:teuthology.orchestra.console:Power off smithi175
2022-09-05T07:07:02.381 INFO:teuthology.kill:2022-09-05 07:07:02,380.380 INFO:teuthology.orchestra.console:Power off for smithi006 completed
2022-09-05T07:07:02.409 INFO:teuthology.kill:2022-09-05 07:07:02,409.409 INFO:teuthology.orchestra.console:Power off for smithi175 completed
2022-09-05T07:07:02.543 INFO:teuthology.kill:2022-09-05 07:07:02,542.542 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com
2022-09-05T07:07:02.570 INFO:teuthology.kill:2022-09-05 07:07:02,570.570 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com
2022-09-05T07:09:03.014 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-09-05T07:09:03.167 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi006 but it was locked by another job: /home/teuthworker/archive/khiremat-2022-09-02_09:35:13-fs-wip-khiremat-47893-test-mgr-finisher-thread-0-distro-default-smithi/7007397
2022-09-05T07:09:03.168 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi175 but it was locked by another job: /home/teuthworker/archive/khiremat-2022-09-02_09:35:13-fs-wip-khiremat-47893-test-mgr-finisher-thread-0-distro-default-smithi/7007397