2022-09-01T14:06:38.956 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-01T14:06:39.105 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging 2022-09-01T14:06:39.106 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server 2022-09-01T14:06:39.107 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2022-09-01T14:06:39.131 INFO:teuthology.lock.ops:Node 'smithi037.front.sepia.ceph.com' reimaging is complete 2022-09-01T14:06:39.132 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2022-09-01T14:06:39.132 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2022-09-01T14:06:39.132 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-09-01T14:06:39.152 INFO:teuthology.lock.ops:Node 'smithi163.front.sepia.ceph.com' reimaging is complete 2022-09-01T14:06:39.343 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 8.stream 2022-09-01T14:06:39.364 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 8.stream 2022-09-01T14:06:39.646 INFO:teuthology.orchestra.console:Power off smithi037 2022-09-01T14:06:39.688 INFO:teuthology.orchestra.console:Power off smithi163 2022-09-01T14:06:39.797 INFO:teuthology.orchestra.console:Power off for smithi037 completed 2022-09-01T14:06:39.829 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-09-01T14:06:39.899 INFO:teuthology.orchestra.console:Power on smithi037 2022-09-01T14:06:39.930 INFO:teuthology.orchestra.console:Power on smithi163 2022-09-01T14:06:44.174 INFO:teuthology.orchestra.console:Power on for smithi037 completed 2022-09-01T14:06:44.275 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2022-09-01T14:06:48.412 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2022-09-01T14:06:48.513 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2022-09-01T14:10:57.740 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-01T14:10:58.045 INFO:teuthology.provision.fog.smithi037:Node is ready 2022-09-01T14:10:58.066 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com 2022-09-01T14:10:58.126 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037 2022-09-01T14:10:58.478 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2022-09-01T14:12:17.443 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-01T14:12:17.776 INFO:teuthology.provision.fog.smithi163:Node is ready 2022-09-01T14:12:17.795 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2022-09-01T14:12:17.854 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2022-09-01T14:12:18.211 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2022-09-01T14:12:18.467 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2022-09-01T14:12:18.468 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-01T14:12:18.489 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2022-09-01T14:12:18.490 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-01T14:12:18.512 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2022-09-01T14:12:18.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2022-09-01T14:12:18.790 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2022-09-01T14:12:18.850 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2022-09-01T14:12:18.851 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8" 2022-09-01T14:12:18.851 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2022-09-01T14:12:18.851 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2022-09-01T14:12:18.852 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8" 2022-09-01T14:12:18.852 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2022-09-01T14:12:18.852 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8" 2022-09-01T14:12:18.852 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2022-09-01T14:12:18.853 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-09-01T14:12:18.853 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2022-09-01T14:12:18.853 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-01T14:12:18.853 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-01T14:12:18.854 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-09-01T14:12:18.856 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2022-09-01T14:12:18.878 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2022-09-01T14:12:18.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-09-01T14:12:19.083 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2022-09-01T14:12:19.141 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2022-09-01T14:12:19.142 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8" 2022-09-01T14:12:19.142 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2022-09-01T14:12:19.142 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2022-09-01T14:12:19.143 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8" 2022-09-01T14:12:19.143 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2022-09-01T14:12:19.143 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8" 2022-09-01T14:12:19.143 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2022-09-01T14:12:19.144 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-09-01T14:12:19.144 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2022-09-01T14:12:19.144 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-01T14:12:19.144 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-01T14:12:19.145 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-09-01T14:12:19.145 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-09-01T14:12:19.266 INFO:teuthology.dispatcher.supervisor:Running job 7005270 2022-09-01T14:12:19.266 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_dang@sidious.arb.redhat.com --archive /home/teuthworker/archive/dang-2022-09-01_10:01:07-rgw-wip-dang-zipper-invalidate-distro-default-smithi/7005270 --name dang-2022-09-01_10:01:07-rgw-wip-dang-zipper-invalidate-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{centos_8} tasks/test_multi} -- /home/teuthworker/archive/dang-2022-09-01_10:01:07-rgw-wip-dang-zipper-invalidate-distro-default-smithi/7005270/orig.config.yaml 2022-09-01T14:12:19.271 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dang-2022-09-01_10:01:07-rgw-wip-dang-zipper-invalidate-distro-default-smithi/7005270 2022-09-01T14:12:19.272 INFO:teuthology.dispatcher.supervisor:Job PID: 14877 2022-09-01T14:12:19.272 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-09-02T02:13:20.567 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-09-02T02:13:20.777 INFO:teuthology.kill:Killing Pids: {14877} 2022-09-02T02:13:22.915 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2022-09-02T02:13:22.916 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2022-09-02T02:13:22.916 INFO:teuthology.misc:Compressing logs... 2022-09-02T02:13:22.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2022-09-02T02:13:23.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-09-02T02:13:23.772 INFO:teuthology.misc:Compressing logs... 2022-09-02T02:13:52.348 INFO:teuthology.misc:Compressing logs... 2022-09-02T02:37:31.136 INFO:teuthology.kill:No teuthology processes running 2022-09-02T02:37:32.960 INFO:teuthology.kill:Nuking machines: ['smithi037', 'smithi163'] 2022-09-02T02:37:34.498 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-09-02T02:37:34.499 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-09-02T02:37:34.499 INFO:teuthology.kill:2022-09-02 02:37:34,497.497 INFO:teuthology.nuke:targets: 2022-09-02T02:37:34.499 INFO:teuthology.kill: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLQD3eSuGGmxfDrxScs2Jo11vqzXdtgJt8K/y5ml4a87j3svpf7fcZ21hddTNN4Jf0ObgaIxNnRTfmTHxac9dvY= 2022-09-02T02:37:34.500 INFO:teuthology.kill: smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCluO/FJru8+yTS71TxWICt2RfG2kGoSenVjzk4oCetCWHI08ekSnZSwxg6I4MJiYKy2uZLxUXHh0eTyr5A+vgGoRcZAAvpx66AJRBbp58Aothv47heInThnI51MxSk0lOI1xGGaxRUO8ALw44Gb7kSOOWPK0Agjj0CajGlSHcJaVRCEdxcLYpL5RB9ssGhfXb6dM28nfD6kaYV5dQfEXGEGgSH4NdU8JfHcCignimfSSQhhoFIbXiL5oXskp5NLmxqDPflIDDMPYcleWn7oTKwDsPdqDWsN4K2NbuNIWNRzVRJD5T22+OY3bDmtR6GXeJ+AtsQMK6hvB7lGNYewpEbG1qVYjEGjlCvSHGYm74W+uNjhkYgogPU6a1XkDmABxU5Td2WoKcMhDTkozCv4fyjZG1pFTiR72+UTBxdCpJQ2RbtvnSDRiLPUt0ttpiEPbPQDcgMoJYpIXDutBX2YH2vRiUvwHLp+C7FR2ZU8O712NXGaHsosnTw08YYr3Rt2sU= 2022-09-02T02:37:34.500 INFO:teuthology.kill:2022-09-02 02:37:34,500.500 INFO:teuthology.nuke:Checking targets against current locks 2022-09-02T02:37:34.565 INFO:teuthology.kill:2022-09-02 02:37:34,565.565 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-02T02:37:34.587 INFO:teuthology.kill:2022-09-02 02:37:34,587.587 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-02T02:37:34.652 INFO:teuthology.kill:2022-09-02 02:37:34,652.652 INFO:teuthology.orchestra.console:Power off smithi037 2022-09-02T02:37:34.707 INFO:teuthology.kill:2022-09-02 02:37:34,706.706 INFO:teuthology.orchestra.console:Power off smithi163 2022-09-02T02:37:43.055 INFO:teuthology.kill:2022-09-02 02:37:43,054.054 INFO:teuthology.orchestra.console:Power off for smithi037 completed 2022-09-02T02:37:43.224 INFO:teuthology.kill:2022-09-02 02:37:43,223.223 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com 2022-09-02T02:37:47.207 INFO:teuthology.kill:2022-09-02 02:37:47,206.206 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-09-02T02:37:47.363 INFO:teuthology.kill:2022-09-02 02:37:47,363.363 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2022-09-02T02:39:47.816 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-09-02T02:39:48.015 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi037 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-09-01_20:41:37-orch-wip-yuri6-testing-2022-09-01-1034-quincy-distro-default-smithi/7006245 2022-09-02T02:39:48.016 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-09-01_20:41:37-orch-wip-yuri6-testing-2022-09-01-1034-quincy-distro-default-smithi/7006244