2021-11-08T12:57:06.247 INFO:root:teuthology version: 1.1.0-27954452
2021-11-08T12:57:06.428 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba002.front.sepia.ceph.com' reimaging
2021-11-08T12:57:06.429 INFO:teuthology.lock.ops:Updating [ubuntu@gibba002.front.sepia.ceph.com]: reset os type and version on server
2021-11-08T12:57:06.430 INFO:teuthology.lock.ops:Updating gibba002.front.sepia.ceph.com on lock server
2021-11-08T12:57:06.448 INFO:teuthology.lock.ops:Node 'ubuntu@gibba002.front.sepia.ceph.com' reimaging is complete
2021-11-08T12:57:06.448 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba008.front.sepia.ceph.com' reimaging
2021-11-08T12:57:06.449 INFO:teuthology.lock.ops:Updating [ubuntu@gibba008.front.sepia.ceph.com]: reset os type and version on server
2021-11-08T12:57:06.449 INFO:teuthology.lock.ops:Updating gibba008.front.sepia.ceph.com on lock server
2021-11-08T12:57:06.469 INFO:teuthology.lock.ops:Node 'ubuntu@gibba008.front.sepia.ceph.com' reimaging is complete
2021-11-08T12:57:06.661 INFO:teuthology.provision.fog.gibba002:Scheduling deploy of rhel 8.4
2021-11-08T12:57:06.674 INFO:teuthology.provision.fog.gibba008:Scheduling deploy of rhel 8.4
2021-11-08T12:57:07.082 INFO:teuthology.orchestra.console:Power off gibba002
2021-11-08T12:57:07.122 INFO:teuthology.orchestra.console:Power off gibba008
2021-11-08T12:57:19.572 INFO:teuthology.orchestra.console:Power off for gibba002 completed
2021-11-08T12:57:19.600 INFO:teuthology.orchestra.console:Power off for gibba008 completed
2021-11-08T12:57:19.673 INFO:teuthology.orchestra.console:Power on gibba002
2021-11-08T12:57:19.707 INFO:teuthology.orchestra.console:Power on gibba008
2021-11-08T12:57:23.944 INFO:teuthology.orchestra.console:Power on for gibba002 completed
2021-11-08T12:57:24.046 INFO:teuthology.provision.fog.gibba002:Waiting for deploy to finish
2021-11-08T12:57:24.207 INFO:teuthology.orchestra.console:Power on for gibba008 completed
2021-11-08T12:57:24.308 INFO:teuthology.provision.fog.gibba008:Waiting for deploy to finish
2021-11-08T13:01:56.044 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-08T13:01:56.254 INFO:teuthology.provision.fog.gibba008:Node is ready
2021-11-08T13:01:56.265 INFO:teuthology.orchestra.run.gibba008.stdout:gibba008.front.sepia.ceph.com
2021-11-08T13:01:56.318 INFO:teuthology.orchestra.run.gibba008.stdout:172.21.2.108 gibba008.front.sepia.ceph.com gibba008
2021-11-08T13:01:56.613 INFO:teuthology.provision.fog.gibba008:Deploy complete!
2021-11-08T13:01:58.779 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-08T13:01:58.971 INFO:teuthology.provision.fog.gibba002:Node is ready
2021-11-08T13:01:58.982 INFO:teuthology.orchestra.run.gibba002.stdout:gibba002.front.sepia.ceph.com
2021-11-08T13:01:59.035 INFO:teuthology.orchestra.run.gibba002.stdout:172.21.2.102 gibba002.front.sepia.ceph.com gibba002
2021-11-08T13:01:59.329 INFO:teuthology.provision.fog.gibba002:Deploy complete!
2021-11-08T13:01:59.520 INFO:teuthology.lock.ops:Checking gibba002.front.sepia.ceph.com
2021-11-08T13:01:59.521 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-08T13:01:59.540 INFO:teuthology.lock.ops:Checking gibba008.front.sepia.ceph.com
2021-11-08T13:01:59.540 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-08T13:01:59.558 INFO:teuthology.lock.ops:Updating [gibba002.front.sepia.ceph.com]: set os type and version on server
2021-11-08T13:01:59.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba002.front.sepia.ceph.com'
2021-11-08T13:01:59.763 INFO:teuthology.orchestra.run.gibba002.stdout:x86_64
2021-11-08T13:01:59.815 INFO:teuthology.orchestra.run.gibba002.stdout:NAME="Red Hat Enterprise Linux"
2021-11-08T13:01:59.815 INFO:teuthology.orchestra.run.gibba002.stdout:VERSION="8.4 (Ootpa)"
2021-11-08T13:01:59.815 INFO:teuthology.orchestra.run.gibba002.stdout:ID="rhel"
2021-11-08T13:01:59.816 INFO:teuthology.orchestra.run.gibba002.stdout:ID_LIKE="fedora"
2021-11-08T13:01:59.816 INFO:teuthology.orchestra.run.gibba002.stdout:VERSION_ID="8.4"
2021-11-08T13:01:59.816 INFO:teuthology.orchestra.run.gibba002.stdout:PLATFORM_ID="platform:el8"
2021-11-08T13:01:59.816 INFO:teuthology.orchestra.run.gibba002.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-11-08T13:01:59.817 INFO:teuthology.orchestra.run.gibba002.stdout:ANSI_COLOR="0;31"
2021-11-08T13:01:59.817 INFO:teuthology.orchestra.run.gibba002.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-11-08T13:01:59.817 INFO:teuthology.orchestra.run.gibba002.stdout:HOME_URL="https://www.redhat.com/"
2021-11-08T13:01:59.817 INFO:teuthology.orchestra.run.gibba002.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-11-08T13:01:59.817 INFO:teuthology.orchestra.run.gibba002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-08T13:01:59.818 INFO:teuthology.orchestra.run.gibba002.stdout:
2021-11-08T13:01:59.818 INFO:teuthology.orchestra.run.gibba002.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-08T13:01:59.818 INFO:teuthology.orchestra.run.gibba002.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-11-08T13:01:59.818 INFO:teuthology.orchestra.run.gibba002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-11-08T13:01:59.819 INFO:teuthology.orchestra.run.gibba002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-11-08T13:01:59.820 INFO:teuthology.lock.ops:Updating gibba002.front.sepia.ceph.com on lock server
2021-11-08T13:01:59.839 INFO:teuthology.lock.ops:Updating [gibba008.front.sepia.ceph.com]: set os type and version on server
2021-11-08T13:01:59.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba008.front.sepia.ceph.com'
2021-11-08T13:02:00.054 INFO:teuthology.orchestra.run.gibba008.stdout:x86_64
2021-11-08T13:02:00.106 INFO:teuthology.orchestra.run.gibba008.stdout:NAME="Red Hat Enterprise Linux"
2021-11-08T13:02:00.107 INFO:teuthology.orchestra.run.gibba008.stdout:VERSION="8.4 (Ootpa)"
2021-11-08T13:02:00.107 INFO:teuthology.orchestra.run.gibba008.stdout:ID="rhel"
2021-11-08T13:02:00.107 INFO:teuthology.orchestra.run.gibba008.stdout:ID_LIKE="fedora"
2021-11-08T13:02:00.107 INFO:teuthology.orchestra.run.gibba008.stdout:VERSION_ID="8.4"
2021-11-08T13:02:00.108 INFO:teuthology.orchestra.run.gibba008.stdout:PLATFORM_ID="platform:el8"
2021-11-08T13:02:00.108 INFO:teuthology.orchestra.run.gibba008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-11-08T13:02:00.108 INFO:teuthology.orchestra.run.gibba008.stdout:ANSI_COLOR="0;31"
2021-11-08T13:02:00.108 INFO:teuthology.orchestra.run.gibba008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-11-08T13:02:00.109 INFO:teuthology.orchestra.run.gibba008.stdout:HOME_URL="https://www.redhat.com/"
2021-11-08T13:02:00.109 INFO:teuthology.orchestra.run.gibba008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-11-08T13:02:00.109 INFO:teuthology.orchestra.run.gibba008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-08T13:02:00.109 INFO:teuthology.orchestra.run.gibba008.stdout:
2021-11-08T13:02:00.110 INFO:teuthology.orchestra.run.gibba008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-08T13:02:00.110 INFO:teuthology.orchestra.run.gibba008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-11-08T13:02:00.110 INFO:teuthology.orchestra.run.gibba008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-11-08T13:02:00.110 INFO:teuthology.orchestra.run.gibba008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-11-08T13:02:00.111 INFO:teuthology.lock.ops:Updating gibba008.front.sepia.ceph.com on lock server
2021-11-08T13:02:00.213 INFO:teuthology.dispatcher.supervisor:Running job 6490763
2021-11-08T13:02:00.214 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2021-11-08_12:40:23-rgw-wip-yuval-test-distro-basic-gibba/6490763 --name yuvalif-2021-11-08_12:40:23-rgw-wip-yuval-test-distro-basic-gibba --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{rhel_8} tasks/test_multi} -- /home/teuthworker/archive/yuvalif-2021-11-08_12:40:23-rgw-wip-yuval-test-distro-basic-gibba/6490763/orig.config.yaml
2021-11-08T13:02:00.218 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2021-11-08_12:40:23-rgw-wip-yuval-test-distro-basic-gibba/6490763
2021-11-08T13:02:00.219 INFO:teuthology.dispatcher.supervisor:Job PID: 11505
2021-11-08T13:02:00.219 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-09T01:03:01.654 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-09T01:03:02.557 INFO:teuthology.kill:Killing Pids: {11505}
2021-11-09T01:03:03.929 INFO:teuthology.task.internal:roles: ubuntu@gibba002.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2021-11-09T01:03:03.933 INFO:teuthology.task.internal:roles: ubuntu@gibba008.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2021-11-09T01:03:03.939 INFO:teuthology.misc:Compressing logs...
2021-11-09T01:03:03.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba002.front.sepia.ceph.com'
2021-11-09T01:03:04.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba008.front.sepia.ceph.com'
2021-11-09T01:03:05.172 INFO:teuthology.misc:Compressing logs...
2021-11-09T01:03:05.212 INFO:teuthology.orchestra.run.gibba002.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-11-09T01:03:05.307 INFO:teuthology.misc:Compressing logs...
2021-11-09T01:18:05.322 INFO:teuthology.kill:No teuthology processes running
2021-11-09T01:18:06.562 INFO:teuthology.kill:Nuking machines: ['gibba002', 'gibba008']
2021-11-09T01:18:07.479 INFO:teuthology.kill:2021-11-09 01:18:07,478.478 INFO:teuthology.nuke:targets:
2021-11-09T01:18:07.480 INFO:teuthology.kill:  gibba002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNma542SsYiSXZq0/zPT8scRY8OlZ1rl4ZyH8b+jWnpou2jekP+PsrBC3nGiADdbNgjD6JTpWJ6f73jsfB16CnjX0RFmaaFd2zQDaUzlA1RPxmn2Qw/xxoP+cd2FCy4bgc9qffaIYMX5BepCL1gCFMWxXjwSHZB9p/QA5bG0Ih/o2LUQsKd/5DQS384t9pCTeRif7DdNrCblVZNXsaJr+4pmefiR5/CfoAS5tyL3Yww+mj1pXrTQVOl8IkQrpgn8XdQjyQH1XqQFYGw5fBZrVr5Ym/Rr2ji3GRx2RRipCz+W1kXFZ3lSf1K0G/CjxNnUrzGJU/pmKU2+kBJiAcg5XsVqngUolXRopoFHqz41l8FpOOf8yxlHk3Ja6pcGnfuhDej49/x2Oh35uCC6cgi2f3Aj2j/wNJAd+ISGAJo/vJAIwpS2+wWP73nN78qVy+B+yKmi/Ao+L+3xUhkx9qRxDQFi+mAMCyMFpyXzbWOkL0NApX8LE8bjanp4pvwKLFcjc=
2021-11-09T01:18:07.480 INFO:teuthology.kill:  gibba008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOezzovzUWO80X6jVFBzR2WRsdZa0dXuCw7lCdIkfWZG/wNPA+zVXIKwOnSW0IOQSq+Z1AmiOyMLRPEEIC+MFkLyMbHZS8hQPvQW2JVve2YiJMJLHgYD1u+p7EEHNP1onp+/DIxH7isTH6f6rw8a0pe3hXtLecPSVvGQy30DjRSzHbNuVUbUeQ469D88vjG+tqIwWwlB348vUuh920KJEq91xBdSIj5d5DenWYEfzhuCnUvypdICFY2tXOe+L5u4QyfrTG8fCWam1TFl9KvMtyN5it9CEEzpVy67QIhAW6YFFk6oONMT9XqiXDjP3mJfJXleIqxO3wFf6GnQ9LyoQrOal5VCqEt8HPvn7u0CzKwK7G3b6+p+BXWIqJDkbga0m06o5uDK0/GMbZFS4o+dSL8hvX6b0bVwARjQ41LsgNPPudgLuMgGrjMPsYIjp1aXbVUJdXBxhsN3o0FU+mwE40v1TA1XLj1EyG6bx1Sg2nKUYs2o4n0e1kdRM7vLdofa8=
2021-11-09T01:18:07.505 INFO:teuthology.kill:2021-11-09 01:18:07,505.505 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-09T01:18:07.509 INFO:teuthology.kill:2021-11-09 01:18:07,508.508 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-09T01:18:07.582 INFO:teuthology.kill:2021-11-09 01:18:07,581.581 INFO:teuthology.orchestra.console:Power off gibba002
2021-11-09T01:18:07.595 INFO:teuthology.kill:2021-11-09 01:18:07,595.595 INFO:teuthology.orchestra.console:Power off gibba008
2021-11-09T01:18:15.964 INFO:teuthology.kill:2021-11-09 01:18:15,963.963 INFO:teuthology.orchestra.console:Power off for gibba002 completed
2021-11-09T01:18:15.971 INFO:teuthology.kill:2021-11-09 01:18:15,971.971 INFO:teuthology.orchestra.console:Power off for gibba008 completed
2021-11-09T01:18:16.110 INFO:teuthology.kill:2021-11-09 01:18:16,109.109 INFO:teuthology.lock.ops:unlocked: gibba002.front.sepia.ceph.com
2021-11-09T01:18:16.113 INFO:teuthology.kill:2021-11-09 01:18:16,113.113 INFO:teuthology.lock.ops:unlocked: gibba008.front.sepia.ceph.com
2021-11-09T01:20:16.428 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-09T01:20:16.539 WARNING:teuthology.dispatcher.supervisor:Was going to unlock gibba002 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-11-02_05:15:03-krbd-octopus-testing-default-gibba/6475094
2021-11-09T01:20:16.540 WARNING:teuthology.dispatcher.supervisor:Was going to unlock gibba008 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-11-02_05:15:03-krbd-octopus-testing-default-gibba/6475094