2021-11-09T21:05:00.731 INFO:root:teuthology version: 1.1.0-27954452
2021-11-09T21:05:00.857 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging
2021-11-09T21:05:00.859 INFO:teuthology.lock.ops:Updating [ubuntu@smithi170.front.sepia.ceph.com]: reset os type and version on server
2021-11-09T21:05:00.859 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2021-11-09T21:05:00.881 INFO:teuthology.lock.ops:Node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging is complete
2021-11-09T21:05:00.881 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi204.front.sepia.ceph.com' reimaging
2021-11-09T21:05:00.881 INFO:teuthology.lock.ops:Updating [ubuntu@smithi204.front.sepia.ceph.com]: reset os type and version on server
2021-11-09T21:05:00.882 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server
2021-11-09T21:05:00.901 INFO:teuthology.lock.ops:Node 'ubuntu@smithi204.front.sepia.ceph.com' reimaging is complete
2021-11-09T21:05:01.102 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 8.3
2021-11-09T21:05:01.119 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of centos 8.3
2021-11-09T21:05:01.446 INFO:teuthology.orchestra.console:Power off smithi170
2021-11-09T21:05:01.462 INFO:teuthology.orchestra.console:Power off smithi204
2021-11-09T21:05:09.822 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2021-11-09T21:05:09.924 INFO:teuthology.orchestra.console:Power on smithi170
2021-11-09T21:05:13.947 INFO:teuthology.orchestra.console:Power off for smithi204 completed
2021-11-09T21:05:14.048 INFO:teuthology.orchestra.console:Power on smithi204
2021-11-09T21:05:18.316 INFO:teuthology.orchestra.console:Power on for smithi204 completed
2021-11-09T21:05:18.326 INFO:teuthology.orchestra.console:Power on for smithi170 completed
2021-11-09T21:05:18.418 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish
2021-11-09T21:05:18.427 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish
2021-11-09T21:09:45.300 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-09T21:10:05.208 INFO:teuthology.provision.fog.smithi204:Node is ready
2021-11-09T21:10:05.228 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com
2021-11-09T21:10:05.285 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204
2021-11-09T21:10:05.638 INFO:teuthology.provision.fog.smithi204:Deploy complete!
2021-11-09T21:10:07.911 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-09T21:10:08.191 INFO:teuthology.provision.fog.smithi170:Node is ready
2021-11-09T21:10:08.246 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com
2021-11-09T21:10:08.301 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170
2021-11-09T21:10:08.619 INFO:teuthology.provision.fog.smithi170:Deploy complete!
2021-11-09T21:10:08.769 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com
2021-11-09T21:10:08.770 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-09T21:10:08.792 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com
2021-11-09T21:10:08.793 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-09T21:10:08.811 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server
2021-11-09T21:10:08.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2021-11-09T21:10:09.012 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64
2021-11-09T21:10:09.065 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Linux"
2021-11-09T21:10:09.066 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8"
2021-11-09T21:10:09.066 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos"
2021-11-09T21:10:09.066 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora"
2021-11-09T21:10:09.066 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8"
2021-11-09T21:10:09.067 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8"
2021-11-09T21:10:09.067 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-09T21:10:09.067 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2021-11-09T21:10:09.067 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-09T21:10:09.068 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/"
2021-11-09T21:10:09.068 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-09T21:10:09.068 INFO:teuthology.orchestra.run.smithi170.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-09T21:10:09.069 INFO:teuthology.orchestra.run.smithi170.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-09T21:10:09.070 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2021-11-09T21:10:09.088 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server
2021-11-09T21:10:09.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com'
2021-11-09T21:10:09.362 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64
2021-11-09T21:10:09.416 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Linux"
2021-11-09T21:10:09.416 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8"
2021-11-09T21:10:09.416 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos"
2021-11-09T21:10:09.416 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora"
2021-11-09T21:10:09.417 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8"
2021-11-09T21:10:09.417 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8"
2021-11-09T21:10:09.417 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-09T21:10:09.417 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31"
2021-11-09T21:10:09.418 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-09T21:10:09.418 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/"
2021-11-09T21:10:09.418 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-09T21:10:09.418 INFO:teuthology.orchestra.run.smithi204.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-09T21:10:09.419 INFO:teuthology.orchestra.run.smithi204.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-09T21:10:09.419 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server
2021-11-09T21:10:09.521 INFO:teuthology.dispatcher.supervisor:Running job 6494538
2021-11-09T21:10:09.522 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology -v --owner scheduled_mbenjamin@shatner --archive /home/teuthworker/archive/mbenjamin-2021-11-09_15:59:59-rgw-wip-rgwadminops-fsid-distro-basic-smithi/6494538 --name mbenjamin-2021-11-09_15:59:59-rgw-wip-rgwadminops-fsid-distro-basic-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{centos_8} tasks/test_multi} -- /home/teuthworker/archive/mbenjamin-2021-11-09_15:59:59-rgw-wip-rgwadminops-fsid-distro-basic-smithi/6494538/orig.config.yaml
2021-11-09T21:10:09.527 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mbenjamin-2021-11-09_15:59:59-rgw-wip-rgwadminops-fsid-distro-basic-smithi/6494538
2021-11-09T21:10:09.528 INFO:teuthology.dispatcher.supervisor:Job PID: 20256
2021-11-09T21:10:09.528 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-10T09:11:04.575 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-10T09:11:04.781 INFO:teuthology.kill:Killing Pids: {20256}
2021-11-10T09:11:05.944 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2021-11-10T09:11:05.945 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2021-11-10T09:11:05.945 INFO:teuthology.misc:Compressing logs...
2021-11-10T09:11:05.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2021-11-10T09:11:06.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com'
2021-11-10T09:11:06.569 INFO:teuthology.misc:Compressing logs...
2021-11-10T09:11:06.717 INFO:teuthology.misc:Compressing logs...
2021-11-10T09:12:43.736 INFO:teuthology.kill:No teuthology processes running
2021-11-10T09:12:44.886 INFO:teuthology.kill:Nuking machines: ['smithi170', 'smithi204']
2021-11-10T09:12:45.866 INFO:teuthology.kill:2021-11-10 09:12:45,865.865 INFO:teuthology.nuke:targets:
2021-11-10T09:12:45.867 INFO:teuthology.kill:  smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCSykoyGdcex8DZercutHmVBvq5GesHXjeNU2rkrEk8+/61N81u7MfOsF7NUr/OiLaxc/NJdR2H06If1VQKu0i/iJ/UtGW9391Jhef2v0OqeuN2nggQe3lRTN3uLClB9OMr22xyJT5sXVez5jVSKDPtMKbRJFJNHyX5ReYBH4+r9VNdx0prtwQBOyF+z5OQeHDR8KH/JMC6d+VYqrHZ2hH2SR52fLrWl8pkWbqZopGOJqTo9JJ6tucooPUjcVl5XsPuA8WFT+J8bjAtHZVbW7mSTm0SZ0vZ2SAN+XRNFa2vDVeMGNzMgWR5B55qgkEqm2rODXYFJxILLrUCF9jBDE1Wb+NkkM5pWkGlIRwknWKtLEsMsivW63h05sVZwOunQXDJVquPKryn/0F9V/sE5CS6k4I9gTVI8T2UXe3CnRlp8wwrLmqnPBV7YMzXPoMrC5q2dOySrs+RaGEAWR/HCVcEbrRclXoB+D6PAQ42q0arfaXzY0jgdYTylZRMmHy1cnM=
2021-11-10T09:12:45.867 INFO:teuthology.kill:  smithi204.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHZ1qXHTraO2eRykk95C5UlDumg1aGzZcME9PPV0giUtvsjWiD4XadUXSaoG9MM6erWApsvJl3Yff/FYXtCEfVd+VndvsegE6No0dwnm78MNocK53IE6wTUJvtOF2fWlXEHtRU1mHhMH8IBZQBnUT8Vwace4/gnL0UI/+oaRItEiPcvLl7ngTyXJsIL4dpoK2ABhvbKhZ2Mts/GEqSrJwqyPeTzQq/sn5t2yAcTO121WfHSq+Z5jOFuxNlvlAZlA4Wd4tGzdddFMgLhk6Bcwa6V9IWYQ5o+Xjs5FIVTkbNOLI8LR6Tguzw5KCGlbK8oTIr4dLmmZirNVpX9BaU/QtM9K5EKAJt2/2n6DS0yqxHxnw8qslhqPwnkZWkfM45LnurRnDvpVfB81/o4+1zwTUFiwSMrp+8b5Mpm8WsqbQvMWDgUX6vqlbTj9hPradCTUgito+G8NpVmK0+x7enHzIL8+UgKslumDb2b08vCFF7e/NGCpXUlv+kgjrqc5TVzWE=
2021-11-10T09:12:45.892 INFO:teuthology.kill:2021-11-10 09:12:45,891.891 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-10T09:12:45.895 INFO:teuthology.kill:2021-11-10 09:12:45,895.895 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-10T09:12:45.971 INFO:teuthology.kill:2021-11-10 09:12:45,970.970 INFO:teuthology.orchestra.console:Power off smithi204
2021-11-10T09:12:45.987 INFO:teuthology.kill:2021-11-10 09:12:45,987.987 INFO:teuthology.orchestra.console:Power off smithi170
2021-11-10T09:12:54.356 INFO:teuthology.kill:2021-11-10 09:12:54,355.355 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2021-11-10T09:12:54.511 INFO:teuthology.kill:2021-11-10 09:12:54,510.510 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com
2021-11-10T09:12:58.461 INFO:teuthology.kill:2021-11-10 09:12:58,461.461 INFO:teuthology.orchestra.console:Power off for smithi204 completed
2021-11-10T09:12:58.624 INFO:teuthology.kill:2021-11-10 09:12:58,624.624 INFO:teuthology.lock.ops:unlocked: smithi204.front.sepia.ceph.com
2021-11-10T09:14:58.951 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-10T09:14:59.053 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi170 but it was locked by another job: /home/teuthworker/archive/matan-2021-11-10_08:41:22-rados-wip-matanb-crimson-clog-distro-basic-smithi/6495819