2024-03-27T22:56:31.155 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-03-27T22:56:31.155 INFO:teuthology.results:subset: '111/120000'
2024-03-27T22:56:31.155 INFO:teuthology.results:seed: '1511'
2024-03-27T23:22:16.970 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-03-27T23:22:17.008 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2024-03-28T03:06:34.262 INFO:teuthology.results:Tests finished! gathering results...
2024-03-28T03:06:37.609 INFO:scrape:Found 41 jobs
2024-03-28T03:06:44.600 INFO:scrape:Found 4 distinct failure reasons
2024-03-28T03:06:44.601 INFO:scrape:Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff574b6b0a7]
2024-03-28T03:06:44.601 INFO:scrape:ceph version 18.2.2-1053-ge58b9979 (e58b9979847f029f7ab1514b5f5f99b9f03d97f6) reef (stable)
 1: /lib64/libc.so.6(+0x54db0) [0x7ff572054db0]
 2: /lib64/libc.so.6(+0xa154c) [0x7ff5720a154c]
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff574b6b0a7]
 6: /usr/lib64/ceph/libceph-common.so.2(+0x16b20b) [0x7ff574b6b20b]
 7: (std::__detail::__variant::__gen_vtable_impl<std::__detail::__variant::_Multi_array<std::__detail::__variant::__deduce_visit_result<int> (*)(FaultInjector<std::basic_string_view<char, std::char_traits<char> > >::check(std::basic_string_view<char, std::char_traits<char> > const&) const::visitor&&, std::variant<std::monostate, InjectAbort, InjectError, InjectDelay> const&)>, std::integer_sequence<unsigned long, 1ul> >::__visit_invoke(FaultInjector<std::basic_string_view<char, std::char_traits<char> > >::check(std::basic_string_view<char, std::char_traits<char> > const&) const::visitor&&, std::variant<std::monostate, InjectAbort, InjectError, InjectDelay> const&)+0x41) [0x55a284573761]
 8: radosgw-admin(+0x740302) [0x55a284585302]
 9: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, DoutPrefixProvider const*, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x249) [0x55a284589de9]
 10: main()
 11: /lib64/libc.so.6(+0x3feb0) [0x7ff57203feb0]
 12: __libc_start_main()
 13: _start()
2024-03-28T03:06:44.601 INFO:scrape:1 jobs: ['7627670']
2024-03-28T03:06:44.601 INFO:scrape:suites: ['cls', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec-profile', 's3tests', 's3tests-branch', 's3tests-java', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'supported-random-distro$/{centos_latest}', 'tasks/{bucket-check', 'validater/valgrind}', 'versioning}']
2024-03-28T03:06:44.601 INFO:scrape:
2024-03-28T03:06:44.601 INFO:scrape:Failure: Command failed on smithi088 with status 100: 'DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install python-dev'
2024-03-28T03:06:44.601 INFO:scrape:1 jobs: ['7627667']
2024-03-28T03:06:44.601 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/kmip', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 's3tests-branch', 'ubuntu_latest}']
2024-03-28T03:06:44.602 INFO:scrape:
2024-03-28T03:06:44.602 INFO:scrape:Failure: Command failed (bucket notification tests against different endpoints) on smithi111 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a kafka_test'
2024-03-28T03:06:44.602 INFO:scrape:1 jobs: ['7627656']
2024-03-28T03:06:44.602 INFO:scrape:suites: ['bluestore-bitmap', 'fixed-2', 'ignore-pg-availability', 'overrides', 'rgw/notifications/{beast', 'supported-all-distro$/{centos_8}', 'tasks/{0-install', 'test_amqp', 'test_kafka', 'test_others}}']
2024-03-28T03:06:44.602 INFO:scrape:
2024-03-28T03:06:44.602 INFO:scrape:Failure: rgw multisite test failures
2024-03-28T03:06:44.602 INFO:scrape:2 jobs: ['7627655', '7627636']
2024-03-28T03:06:44.602 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi}']
2024-03-28T03:06:44.602 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zones', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_latest}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}']
2024-03-28T03:06:44.603 INFO:scrape:
2024-03-28T03:06:44.604 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/
failed:  5
dead:    0
running: 0
waiting: 0
queued:  0
passed:  36


Fail
=================================================================
[7627636]  rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_latest} tasks/test_multi}
-----------------------------------------------------------------
time:   03:39:08
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627636/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627636/
sentry: https://sentry.ceph.com/organizations/ceph/?query=321fcc482e5a4e049d69ac14c0be06f6

    rgw multisite test failures

[7627655]  rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi}
-----------------------------------------------------------------
time:   03:45:12
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627655/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627655/
sentry: https://sentry.ceph.com/organizations/ceph/?query=771274196b424184886e0fbc60052d11

    rgw multisite test failures

[7627656]  rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides supported-all-distro$/{centos_8} tasks/{0-install test_amqp test_kafka test_others}}
-----------------------------------------------------------------
time:   00:31:04
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627656/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627656/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9e70c8871c22468c9bea0bf966bb7c87

    Command failed (bucket notification tests against different endpoints) on
    smithi111 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/
    rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/s
    rc/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s
    /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v
    -a kafka_test'

[7627667]  rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest}
-----------------------------------------------------------------
time:   00:10:01
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627667/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627667/
sentry: https://sentry.ceph.com/organizations/ceph/?query=790435e358c34e21a25eea077cd03a23

    Command failed on smithi088 with status 100:
    'DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install
    python-dev'

[7627670]  rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}
-----------------------------------------------------------------
time:   00:52:41
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627670/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627670/

    saw valgrind issues



Pass
=================================================================
[7627635] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 ignore-pg-availability overrides s3a-hadoop}
time:   00:22:51
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627635/

[7627637] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests}
time:   00:23:15
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627637/

[7627638] rgw/upgrade/{1-install/quincy/{distro$/{ubuntu_20.04} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides}
time:   00:14:26
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627638/

[7627639] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}
time:   00:44:20
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627639/

[7627640] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_ragweed ubuntu_latest}
time:   00:11:21
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627640/

[7627641] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest}
time:   00:18:47
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627641/

[7627642] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}}
time:   00:13:45
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627642/

[7627643] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/rgw_s3tests ubuntu_latest}
time:   00:20:19
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627643/

[7627644] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota}
time:   00:15:08
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627644/

[7627645] rgw/upgrade/{1-install/pacific/{distro$/{ubuntu_20.04} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides}
time:   00:13:43
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627645/

[7627646] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{rhel_8} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}
time:   00:56:25
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627646/

[7627647] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest}
time:   00:19:12
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627647/

[7627648] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_user_quota ubuntu_latest}
time:   00:12:18
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627648/

[7627649] rgw/cloud-transition/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{rhel_8} tasks/cloud_transition_s3tests}
time:   00:38:46
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627649/

[7627650] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest}
time:   00:28:09
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627650/

[7627651] rgw/dbstore/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{rhel_8} tasks/rgw_s3tests}
time:   00:25:12
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627651/

[7627652] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default ignore-pg-availability overrides s3a-hadoop}
time:   00:21:29
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627652/

[7627653] rgw/lifecycle/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/rgw_s3tests}
time:   00:27:02
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627653/

[7627654] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_bucket_quota ubuntu_latest}
time:   00:14:16
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627654/

[7627657] rgw/service-token/{clusters/fixed-1 frontend/beast ignore-pg-availability overrides tasks/service-token ubuntu_latest}
time:   00:16:53
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627657/

[7627658] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}
time:   00:13:12
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627658/

[7627659] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast s3tests-branch supported-random-distro$/{rhel_8} tasks/{0-install first ststests}}
time:   00:37:01
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627659/

[7627660] rgw/tempest/{clusters/fixed-1 frontend/beast ignore-pg-availability overrides tasks/rgw_tempest ubuntu_latest}
time:   00:24:22
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627660/

[7627661] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}
time:   00:17:10
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627661/

[7627662] rgw/tools/{centos_latest cluster ignore-pg-availability tasks}
time:   02:44:51
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627662/

[7627663] rgw/upgrade/{1-install/pacific/{distro$/{ubuntu_20.04} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides}
time:   00:13:49
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627663/

[7627664] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}
time:   00:37:01
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627664/

[7627665] rgw/website/{clusters/fixed-2 frontend/beast http ignore-pg-availability overrides s3tests-branch tasks/s3tests-website ubuntu_latest}
time:   00:22:35
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627665/

[7627666] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/rgw_multipart_upload ubuntu_latest}
time:   00:12:14
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627666/

[7627668] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload}
time:   00:15:38
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627668/

[7627669] rgw/upgrade/{1-install/quincy/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides}
time:   00:13:36
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627669/

[7627671] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_ragweed ubuntu_latest}
time:   00:11:42
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627671/

[7627672] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest}
time:   00:18:38
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627672/

[7627673] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}}
time:   00:11:20
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627673/

[7627674] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_s3tests ubuntu_latest}
time:   00:19:44
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627674/

[7627675] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest}
time:   00:18:35
info:   https://pulpito.ceph.com/yuriw-2024-03-27_22:55:38-rgw-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7627675/