2021-12-24T20:54:06.242 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-24T20:54:06.358 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi062.front.sepia.ceph.com' reimaging
2021-12-24T20:54:06.359 INFO:teuthology.lock.ops:Updating [ubuntu@smithi062.front.sepia.ceph.com]: reset os type and version on server
2021-12-24T20:54:06.359 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2021-12-24T20:54:06.376 INFO:teuthology.lock.ops:Node 'ubuntu@smithi062.front.sepia.ceph.com' reimaging is complete
2021-12-24T20:54:06.376 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi124.front.sepia.ceph.com' reimaging
2021-12-24T20:54:06.377 INFO:teuthology.lock.ops:Updating [ubuntu@smithi124.front.sepia.ceph.com]: reset os type and version on server
2021-12-24T20:54:06.377 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2021-12-24T20:54:06.399 INFO:teuthology.lock.ops:Node 'ubuntu@smithi124.front.sepia.ceph.com' reimaging is complete
2021-12-24T20:54:06.601 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of rhel 8.4
2021-12-24T20:54:06.613 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of rhel 8.4
2021-12-24T20:54:06.911 INFO:teuthology.orchestra.console:Power off smithi062
2021-12-24T20:54:06.925 INFO:teuthology.orchestra.console:Power off smithi124
2021-12-24T20:54:07.051 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2021-12-24T20:54:07.152 INFO:teuthology.orchestra.console:Power on smithi062
2021-12-24T20:54:15.594 INFO:teuthology.orchestra.console:Power on for smithi062 completed
2021-12-24T20:54:15.695 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2021-12-24T20:54:19.395 INFO:teuthology.orchestra.console:Power off for smithi124 completed
2021-12-24T20:54:19.496 INFO:teuthology.orchestra.console:Power on smithi124
2021-12-24T20:54:27.863 INFO:teuthology.orchestra.console:Power on for smithi124 completed
2021-12-24T20:54:27.964 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish
2021-12-24T20:58:14.186 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-24T20:58:34.786 INFO:teuthology.provision.fog.smithi062:Node is ready
2021-12-24T20:58:34.806 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com
2021-12-24T20:58:34.863 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062
2021-12-24T20:58:35.191 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2021-12-24T20:58:39.179 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-24T20:58:54.401 INFO:teuthology.provision.fog.smithi124:Node is ready
2021-12-24T20:58:54.418 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com
2021-12-24T20:58:54.475 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124
2021-12-24T20:58:54.819 INFO:teuthology.provision.fog.smithi124:Deploy complete!
2021-12-24T20:58:54.968 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com
2021-12-24T20:58:54.969 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-24T20:58:54.989 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com
2021-12-24T20:58:54.989 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-24T20:58:55.008 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server
2021-12-24T20:58:55.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2021-12-24T20:58:55.245 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64
2021-12-24T20:58:55.301 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux"
2021-12-24T20:58:55.301 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.4 (Ootpa)"
2021-12-24T20:58:55.302 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel"
2021-12-24T20:58:55.302 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora"
2021-12-24T20:58:55.302 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.4"
2021-12-24T20:58:55.302 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2021-12-24T20:58:55.303 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-12-24T20:58:55.303 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2021-12-24T20:58:55.303 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-12-24T20:58:55.303 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/"
2021-12-24T20:58:55.304 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-12-24T20:58:55.304 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-24T20:58:55.304 INFO:teuthology.orchestra.run.smithi062.stdout:
2021-12-24T20:58:55.304 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-24T20:58:55.304 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-12-24T20:58:55.305 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-12-24T20:58:55.305 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-12-24T20:58:55.306 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2021-12-24T20:58:55.325 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server
2021-12-24T20:58:55.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2021-12-24T20:58:55.516 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64
2021-12-24T20:58:55.572 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux"
2021-12-24T20:58:55.572 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.4 (Ootpa)"
2021-12-24T20:58:55.572 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel"
2021-12-24T20:58:55.572 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora"
2021-12-24T20:58:55.573 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.4"
2021-12-24T20:58:55.573 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8"
2021-12-24T20:58:55.573 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-12-24T20:58:55.573 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2021-12-24T20:58:55.574 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-12-24T20:58:55.574 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/"
2021-12-24T20:58:55.574 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-12-24T20:58:55.574 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-24T20:58:55.574 INFO:teuthology.orchestra.run.smithi124.stdout:
2021-12-24T20:58:55.575 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-24T20:58:55.575 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-12-24T20:58:55.575 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-12-24T20:58:55.575 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-12-24T20:58:55.576 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2021-12-24T20:58:55.664 INFO:teuthology.dispatcher.supervisor:Running job 6583779
2021-12-24T20:58:55.664 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-12-24_14:49:54-rgw-wip-yuri-master-12.24.21-distro-default-smithi/6583779 --name yuriw-2021-12-24_14:49:54-rgw-wip-yuri-master-12.24.21-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{rhel_8} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2021-12-24_14:49:54-rgw-wip-yuri-master-12.24.21-distro-default-smithi/6583779/orig.config.yaml
2021-12-24T20:58:55.670 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-12-24_14:49:54-rgw-wip-yuri-master-12.24.21-distro-default-smithi/6583779
2021-12-24T20:58:55.671 INFO:teuthology.dispatcher.supervisor:Job PID: 16292
2021-12-24T20:58:55.671 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-25T08:59:15.749 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-25T08:59:15.941 INFO:teuthology.kill:Killing Pids: {16292}
2021-12-25T08:59:17.162 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2021-12-25T08:59:17.163 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2021-12-25T08:59:17.164 INFO:teuthology.misc:Compressing logs...
2021-12-25T08:59:17.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2021-12-25T08:59:17.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2021-12-25T08:59:17.752 INFO:teuthology.misc:Compressing logs...
2021-12-25T08:59:17.869 INFO:teuthology.misc:Compressing logs...
2021-12-25T09:06:06.595 INFO:teuthology.kill:No teuthology processes running
2021-12-25T09:06:07.737 INFO:teuthology.kill:Nuking machines: ['smithi062', 'smithi124']
2021-12-25T09:06:08.692 INFO:teuthology.kill:2021-12-25 09:06:08,691.691 INFO:teuthology.nuke:targets:
2021-12-25T09:06:08.693 INFO:teuthology.kill:  smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4jrawrEi3fCyEK1yahV2irXoavRcuKQDzGbVBkdf2sS8DtjpIIMFj4SWHUhcbOj2sWPwOSyYMuLkX0XHXDhAtLEvflxzsrz9Kp5hqjRi6+p8LuEQ3cTgAyiTERUrllUylSxI63p8l2yeKiARGx+3SlUloTSVkyY+pEmUOxuUlQUD0G8msJeArjtI2PE1Cju1lPREErnqmMoq/Rl9F1FWAR8sisrbHlu3bJ9itoaYS8QjfNM+HO2qew6iUHG1jlmO8VP29lqBHVEiIJwDASlfmVnPwpQgYAK0MI0W4cs/CYbBWnFSrzxHkkSabzTyfAmgvNP0ew5MggnkahQ2ClWu4kkLTYgAtPKjxLo9uTF5d59yFHsCnHNBTxce5QFvjPmG0xhbqOtPUXjYoB/w4lH/MyiR4DrkQLUOW9gvX+YvW3LLQnDGNZY1L/cM2C3ya/or1Lg5QfZbEGOow987/N8yo6/27vFVzfMqxbu7NSuUd2BaigcHnOKBNY19+RH95USs=
2021-12-25T09:06:08.694 INFO:teuthology.kill:  smithi124.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCg5DL5YMduupmURQnfwTbwvDXuqOWdFHh7z4roezFlZOOG2IC0oZcziICKTyGYDjcnFPSwbQwSf7MxyySrPeTqFB0rEIpJn5ypEollH20+DGezdhLAW0jlCleSKS+Q2cSvwcvnrmL/ZhgLzJpxc5xiZYX35EYtqGid6p+G+fjUhHzZzN2/7T0vNrPtTqST7ITnhk7QtZDzeKO8mmmvBBA0lALCyxrcW5AAwetqAw2bu1CKBCbNb7qCG/3t3ADOpNWbmTsYujORxtejrfvRvELSOWQhmY5LXu5xIfR9ePRvfCBbWebABJdvUht19Ygh/XIsTByjYBj/GSRBWM5ghyCMFuS7FqDSof/pC8+xQS0WZ9n1zgBc0QUPkksf3EDal0KbchF/dyxVIjE56SlT5YkDsqLfVo2nIlHI2CZ9+/oRLw6NK1mKng7X4RKwSXNlDEImakggwTM+fEQhaKFohopBDDC41PfkmvESddXFJLFAzo6o/7R9cXr0Rd4uuJ/NXes=
2021-12-25T09:06:08.720 INFO:teuthology.kill:2021-12-25 09:06:08,720.720 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-25T09:06:08.724 INFO:teuthology.kill:2021-12-25 09:06:08,724.724 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-25T09:06:08.797 INFO:teuthology.kill:2021-12-25 09:06:08,797.797 INFO:teuthology.orchestra.console:Power off smithi124
2021-12-25T09:06:08.811 INFO:teuthology.kill:2021-12-25 09:06:08,811.811 INFO:teuthology.orchestra.console:Power off smithi062
2021-12-25T09:06:17.165 INFO:teuthology.kill:2021-12-25 09:06:17,165.165 INFO:teuthology.orchestra.console:Power off for smithi124 completed
2021-12-25T09:06:17.175 INFO:teuthology.kill:2021-12-25 09:06:17,175.175 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2021-12-25T09:06:17.314 INFO:teuthology.kill:2021-12-25 09:06:17,313.313 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com
2021-12-25T09:06:17.326 INFO:teuthology.kill:2021-12-25 09:06:17,326.326 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com
2021-12-25T09:08:17.635 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-25T09:08:17.732 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi062 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-21_05:15:02-krbd-octopus-testing-default-smithi/6574678
2021-12-25T09:08:17.733 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi124 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-21_05:15:02-krbd-octopus-testing-default-smithi/6574678