2022-05-08T19:32:38.900 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-08T19:32:39.043 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2022-05-08T19:32:39.045 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2022-05-08T19:32:39.046 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2022-05-08T19:32:39.072 INFO:teuthology.lock.ops:Node 'smithi078.front.sepia.ceph.com' reimaging is complete 2022-05-08T19:32:39.073 INFO:teuthology.lock.ops:Start node 'smithi189.front.sepia.ceph.com' reimaging 2022-05-08T19:32:39.074 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: reset os type and version on server 2022-05-08T19:32:39.075 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2022-05-08T19:32:39.100 INFO:teuthology.lock.ops:Node 'smithi189.front.sepia.ceph.com' reimaging is complete 2022-05-08T19:32:39.298 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of centos 8.stream 2022-05-08T19:32:39.307 INFO:teuthology.provision.fog.smithi189:Scheduling deploy of centos 8.stream 2022-05-08T19:32:39.685 INFO:teuthology.orchestra.console:Power off smithi078 2022-05-08T19:32:39.707 INFO:teuthology.orchestra.console:Power off smithi189 2022-05-08T19:32:39.840 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2022-05-08T19:32:39.854 INFO:teuthology.orchestra.console:Power off for smithi189 completed 2022-05-08T19:32:39.947 INFO:teuthology.orchestra.console:Power on smithi078 2022-05-08T19:32:39.962 INFO:teuthology.orchestra.console:Power on smithi189 2022-05-08T19:32:44.212 INFO:teuthology.orchestra.console:Power on for smithi078 completed 2022-05-08T19:32:44.313 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2022-05-08T19:32:48.331 INFO:teuthology.orchestra.console:Power on for smithi189 completed 2022-05-08T19:32:48.432 INFO:teuthology.provision.fog.smithi189:Waiting for deploy to finish 2022-05-08T19:35:15.665 ERROR:teuthology.orchestra.connection:Error authenticating with smithi078.front.sepia.ceph.com: Authentication failed. 2022-05-08T19:36:56.535 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-08T19:37:21.915 INFO:teuthology.provision.fog.smithi078:Node is ready 2022-05-08T19:37:21.979 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078 2022-05-08T19:37:22.039 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2022-05-08T19:37:22.431 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2022-05-08T19:37:44.680 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-08T19:37:44.949 INFO:teuthology.provision.fog.smithi189:Node is ready 2022-05-08T19:37:44.968 INFO:teuthology.orchestra.run.smithi189.stdout:smithi189.front.sepia.ceph.com 2022-05-08T19:37:45.026 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.15.189 smithi189.front.sepia.ceph.com smithi189 2022-05-08T19:37:45.371 INFO:teuthology.provision.fog.smithi189:Deploy complete! 2022-05-08T19:37:45.537 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2022-05-08T19:37:45.538 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-08T19:37:45.563 INFO:teuthology.lock.ops:Checking smithi189.front.sepia.ceph.com 2022-05-08T19:37:45.564 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-08T19:37:45.582 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2022-05-08T19:37:45.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2022-05-08T19:37:45.891 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2022-05-08T19:37:45.948 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2022-05-08T19:37:45.948 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8" 2022-05-08T19:37:45.949 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2022-05-08T19:37:45.949 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2022-05-08T19:37:45.949 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8" 2022-05-08T19:37:45.949 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2022-05-08T19:37:45.950 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-08T19:37:45.950 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2022-05-08T19:37:45.950 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-08T19:37:45.950 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2022-05-08T19:37:45.951 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-08T19:37:45.951 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-08T19:37:45.951 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-08T19:37:45.952 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2022-05-08T19:37:45.971 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: set os type and version on server 2022-05-08T19:37:45.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2022-05-08T19:37:46.176 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2022-05-08T19:37:46.234 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2022-05-08T19:37:46.234 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="8" 2022-05-08T19:37:46.234 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2022-05-08T19:37:46.234 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2022-05-08T19:37:46.235 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="8" 2022-05-08T19:37:46.235 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el8" 2022-05-08T19:37:46.235 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-08T19:37:46.235 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2022-05-08T19:37:46.236 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-08T19:37:46.236 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2022-05-08T19:37:46.236 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-08T19:37:46.236 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-08T19:37:46.237 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-08T19:37:46.237 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2022-05-08T19:37:46.336 INFO:teuthology.dispatcher.supervisor:Running job 6827385 2022-05-08T19:37:46.337 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2022-05-08_19:31:03-rgw-wip-yuval-lua-map1-distro-basic-smithi/6827385 --name yuvalif-2022-05-08_19:31:03-rgw-wip-yuval-lua-map1-distro-basic-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{centos_8} tasks/test_multi} -- /home/teuthworker/archive/yuvalif-2022-05-08_19:31:03-rgw-wip-yuval-lua-map1-distro-basic-smithi/6827385/orig.config.yaml 2022-05-08T19:37:46.342 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2022-05-08_19:31:03-rgw-wip-yuval-lua-map1-distro-basic-smithi/6827385 2022-05-08T19:37:46.343 INFO:teuthology.dispatcher.supervisor:Job PID: 1151 2022-05-08T19:37:46.343 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-09T02:07:57.035 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-09T02:07:57.239 INFO:teuthology.kill:Killing Pids: {1151} 2022-05-09T02:07:58.721 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2022-05-09T02:07:58.723 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2022-05-09T02:07:58.723 INFO:teuthology.misc:Compressing logs... 2022-05-09T02:07:58.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2022-05-09T02:07:58.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2022-05-09T02:07:59.457 INFO:teuthology.misc:Compressing logs... 2022-05-09T02:07:59.603 INFO:teuthology.misc:Compressing logs... 2022-05-09T02:21:12.052 INFO:teuthology.kill:No teuthology processes running 2022-05-09T02:21:13.430 INFO:teuthology.kill:Nuking machines: ['smithi078', 'smithi189'] 2022-05-09T02:21:14.643 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-09T02:21:14.644 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-09T02:21:14.644 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-09T02:21:14.644 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-09T02:21:14.644 INFO:teuthology.kill:2022-05-09 02:21:14,642.642 INFO:teuthology.nuke:targets: 2022-05-09T02:21:14.645 INFO:teuthology.kill: smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8y3FUioxRp8K5JsGjb2Q284ebvrwKTvjnmMi+LByEryylLxLoRDPRN5xU3QdvmZPrd9Vr/7+tRyHshFr79J+cRDA/B5Ws2Wq3TFDVxipYYkFCr/sL0hy4QsSGTZhtVEuk4i63Xtg9lOWIvYMz7VBpEnwVwl23HZt1T/W5bRQxooelOCjBqLkMhESuQuMuyyGVdSauRtEBLYWAoHp0H1ShjJOr7RMU+Z4VTzHsJd+WqiNwcDC6DiHenWMhYRZaGDvnRQdhh97QSCG48fmIRbCKvDStDUS+BJWXgv5hR24KAUdx466i2gIB51nTKasrNhyl/rWBN9s0t+fdoG8gx0ZIB+oSUbYqO/pRNvGp5dD7ENBpRWMH344q5OOgF0nmvD4M2KMrVqlVFtnrl1M7oEC7q4au7x5nnOED4LVFIn6e0q7Ar28D5q4zpCmRgJ5jAfHojtLpiohsOSzuCnypFquPZc9swY/h7vrt2TsJfRm9wOh51x/0XzlEyuX7kHwB2RE= 2022-05-09T02:21:14.645 INFO:teuthology.kill: smithi189.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDVHHv+l3O/LlMQCSg5UGXKKJxHwymQDIPIAAjoj775lQszbvoyE2zKt4WWq+auCDqcVUpNVQ8RjFhB4a2kl28b0a3nFQxXbc2UjmxEGOLdj3v6dSiJZOqHZSeJ8pOyro31p6YysOQNcGra3Yjks5IBBJIuDJxAVdYym9GjHrHQdNY4SUjh/dP03L7v1ED5d7NVEJLJZYSYK8MiOCZLSDYCRxci6CjcgyiBLSM3grao9tdZ6W23M93nZTCBjOTzG/7aKSWkLC3HxCcqVXe4xUopHW7tpTpCExKQ9NCC6I9WfZV2w+MwK4keLp0knjxp+G5m+zCSAa1llZ/eyJIzQNzkDNDPRaRmvDsx4MaTxNrwmPUpQzHRZT3qweYLYUvVkfV83vS9aNq7uCiXZBoHA8V0+fKt3nkkowq/N5ksvk4W8WqfGA8l6pLzKHAv4GNxtFkDrJaj+iawEjZU+kDTLHDA0DgbLrnQ5p3ETUwGHQp5eVAmUcXb/iuEmSr2gkCl0k= 2022-05-09T02:21:14.672 INFO:teuthology.kill:2022-05-09 02:21:14,672.672 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-09T02:21:14.674 INFO:teuthology.kill:2022-05-09 02:21:14,674.674 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-09T02:21:14.757 INFO:teuthology.kill:2022-05-09 02:21:14,757.757 INFO:teuthology.orchestra.console:Power off smithi078 2022-05-09T02:21:14.776 INFO:teuthology.kill:2022-05-09 02:21:14,775.775 INFO:teuthology.orchestra.console:Power off smithi189 2022-05-09T02:21:23.144 INFO:teuthology.kill:2022-05-09 02:21:23,143.143 INFO:teuthology.orchestra.console:Power off for smithi189 completed 2022-05-09T02:21:23.289 INFO:teuthology.kill:2022-05-09 02:21:23,288.288 INFO:teuthology.lock.ops:unlocked: smithi189.front.sepia.ceph.com 2022-05-09T02:21:27.245 INFO:teuthology.kill:2022-05-09 02:21:27,244.244 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2022-05-09T02:21:27.390 INFO:teuthology.kill:2022-05-09 02:21:27,390.390 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com 2022-05-09T02:23:27.646 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-09T02:23:27.776 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi078 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824265 2022-05-09T02:23:27.776 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi189 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-05-06_03:20:03-krbd-quincy-testing-default-smithi/6824263