2023-12-19T19:59:31.126 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-19T19:59:31.127 INFO:teuthology.results:seed: '3235'
2023-12-19T19:59:34.602 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-19T19:59:34.602 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-12-19T23:20:47.876 INFO:teuthology.results:Tests finished! gathering results...
2023-12-19T23:20:48.099 INFO:scrape:Found 3 jobs
2023-12-19T23:20:48.739 WARNING:scrape:Not-understood crash indication 2023-12-19T21:33:10.684 INFO:tasks.rgw.c2.client.0.smithi111.stderr:daemon-helper: command crashed with signal 11
2023-12-19T23:20:48.739 WARNING:scrape:Not-understood crash indication 2023-12-19T22:38:22.233 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi111.stderr: INFO: daemon-helper: command crashed with signal 11
2023-12-19T23:20:48.739 WARNING:scrape:Not-understood crash indication 
2023-12-19T23:20:48.739 INFO:scrape:Found 2 distinct failure reasons
2023-12-19T23:20:48.740 INFO:scrape:Failure: rgw multisite test failures
2023-12-19T23:20:48.740 INFO:scrape:2 jobs: ['7497353', '7497352']
2023-12-19T23:20:48.740 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'rgw:multisite/{clusters', 'tasks/test_multi}']
2023-12-19T23:20:48.740 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zones', 'realms/two-zonegroup', 'rgw:multisite/{clusters', 'supported-random-distro$/{centos_latest}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}']
2023-12-19T23:20:48.740 INFO:scrape:
2023-12-19T23:20:48.740 INFO:scrape:Failure: machine smithi174.front.sepia.ceph.com is not locked
2023-12-19T23:20:48.740 INFO:scrape:1 jobs: ['7497354']
2023-12-19T23:20:48.740 INFO:scrape:suites: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/two-zones', 'rgw:multisite/{clusters', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}']
2023-12-19T23:20:48.740 INFO:scrape:
2023-12-19T23:20:48.741 INFO:teuthology.results:Sending results to smanjara@redhat.com: Test Run: smanjara-2023-12-19_19:59:19-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/smanjara-2023-12-19_19:59:19-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/smanjara-2023-12-19_19:59:19-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/
failed:  3
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[7497352]  rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi}
-----------------------------------------------------------------
time:   02:42:09
info:   https://pulpito.ceph.com/smanjara-2023-12-19_19:59:19-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/7497352/
log:    http://qa-proxy.ceph.com/teuthology/smanjara-2023-12-19_19:59:19-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/7497352/
sentry: https://sentry.ceph.com/organizations/ceph/?query=31ca473a34bd4dc2b5618c0760e8bdee

    rgw multisite test failures

[7497353]  rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_latest} tasks/test_multi}
-----------------------------------------------------------------
time:   03:11:50
info:   https://pulpito.ceph.com/smanjara-2023-12-19_19:59:19-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/7497353/
log:    http://qa-proxy.ceph.com/teuthology/smanjara-2023-12-19_19:59:19-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/7497353/
sentry: https://sentry.ceph.com/organizations/ceph/?query=abea3b68545a41fca314fe912ac423ba

    rgw multisite test failures

[7497354]  rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/smanjara-2023-12-19_19:59:19-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/7497354/
log:    http://qa-proxy.ceph.com/teuthology/smanjara-2023-12-19_19:59:19-rgw:multisite-wip-shilpa-rgw-test-multisite-distro-default-smithi/7497354/
sentry: https://sentry.ceph.com/organizations/ceph/?query=84b2a33b52284b149e4688c3fc238d6d

    machine smithi174.front.sepia.ceph.com is not locked