2024-04-13T20:42:15.528 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-04-13T20:42:15.528 INFO:teuthology.results:subset: '0/1'
2024-04-13T20:42:15.529 INFO:teuthology.results:seed: '3741'
2024-04-13T21:13:12.800 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-04-13T21:13:12.829 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2024-04-14T00:34:29.472 INFO:teuthology.results:Tests finished! gathering results...
2024-04-14T00:34:35.072 INFO:scrape:Found 69 jobs
2024-04-14T00:34:40.740 INFO:scrape:Found 6 distinct failure reasons
2024-04-14T00:34:40.741 INFO:scrape:Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3dfad6b0a7]
2024-04-14T00:34:40.741 INFO:scrape:ceph version 18.2.2-1217-g7d36322c (7d36322c373c73b184fd252cd881b122d8c51a3b) reef (stable)
 1: /lib64/libc.so.6(+0x54db0) [0x7f3df8254db0]
 2: /lib64/libc.so.6(+0xa154c) [0x7f3df82a154c]
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3dfad6b0a7]
 6: /usr/lib64/ceph/libceph-common.so.2(+0x16b20b) [0x7f3dfad6b20b]
 7: (std::__detail::__variant::__gen_vtable_impl<std::__detail::__variant::_Multi_array<std::__detail::__variant::__deduce_visit_result<int> (*)(FaultInjector<std::basic_string_view<char, std::char_traits<char> > >::check(std::basic_string_view<char, std::char_traits<char> > const&) const::visitor&&, std::variant<std::monostate, InjectAbort, InjectError, InjectDelay> const&)>, std::integer_sequence<unsigned long, 1ul> >::__visit_invoke(FaultInjector<std::basic_string_view<char, std::char_traits<char> > >::check(std::basic_string_view<char, std::char_traits<char> > const&) const::visitor&&, std::variant<std::monostate, InjectAbort, InjectError, InjectDelay> const&)+0x41) [0x5614e644c761]
 8: radosgw-admin(+0x740302) [0x5614e645e302]
 9: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, DoutPrefixProvider const*, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x249) [0x5614e6462de9]
 10: main()
 11: /lib64/libc.so.6(+0x3feb0) [0x7f3df823feb0]
 12: __libc_start_main()
 13: _start()
2024-04-14T00:34:40.741 INFO:scrape:1 jobs: ['7654827']
2024-04-14T00:34:40.741 INFO:scrape:suites: ['cls', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 's3tests', 's3tests-branch', 's3tests-java', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'supported-random-distro$/{centos_latest}', 'tasks/{bucket-check', 'validater/valgrind}', 'versioning}']
2024-04-14T00:34:40.741 INFO:scrape:
2024-04-14T00:34:40.741 INFO:scrape:Failure: rgw multisite test failures
2024-04-14T00:34:40.741 INFO:scrape:2 jobs: ['7654786', '7654822']
2024-04-14T00:34:40.742 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi}']
2024-04-14T00:34:40.742 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zones', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'tasks/test_multi}']
2024-04-14T00:34:40.742 INFO:scrape:
2024-04-14T00:34:40.742 INFO:scrape:Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdfadf6b0a7]
2024-04-14T00:34:40.742 INFO:scrape:ceph version 18.2.2-1217-g7d36322c (7d36322c373c73b184fd252cd881b122d8c51a3b) reef (stable)
 1: /lib64/libc.so.6(+0x54db0) [0x7fdfab454db0]
 2: /lib64/libc.so.6(+0xa154c) [0x7fdfab4a154c]
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdfadf6b0a7]
 6: /usr/lib64/ceph/libceph-common.so.2(+0x16b20b) [0x7fdfadf6b20b]
 7: (std::__detail::__variant::__gen_vtable_impl<std::__detail::__variant::_Multi_array<std::__detail::__variant::__deduce_visit_result<int> (*)(FaultInjector<std::basic_string_view<char, std::char_traits<char> > >::check(std::basic_string_view<char, std::char_traits<char> > const&) const::visitor&&, std::variant<std::monostate, InjectAbort, InjectError, InjectDelay> const&)>, std::integer_sequence<unsigned long, 1ul> >::__visit_invoke(FaultInjector<std::basic_string_view<char, std::char_traits<char> > >::check(std::basic_string_view<char, std::char_traits<char> > const&) const::visitor&&, std::variant<std::monostate, InjectAbort, InjectError, InjectDelay> const&)+0x41) [0x55ee7152f761]
 8: radosgw-admin(+0x740302) [0x55ee71541302]
 9: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, DoutPrefixProvider const*, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x249) [0x55ee71545de9]
 10: main()
 11: /lib64/libc.so.6(+0x3feb0) [0x7fdfab43feb0]
 12: __libc_start_main()
 13: _start()
2024-04-14T00:34:40.742 INFO:scrape:1 jobs: ['7654835']
2024-04-14T00:34:40.742 INFO:scrape:suites: ['cls', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/replicated', 's3tests', 's3tests-branch', 's3tests-java', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'supported-random-distro$/{centos_latest}', 'tasks/{bucket-check', 'validater/valgrind}', 'versioning}']
2024-04-14T00:34:40.742 INFO:scrape:
2024-04-14T00:34:40.742 INFO:scrape:Failure: Command failed on smithi072 with status 128: 'git clone -b stable/xena https://github.com/openstack/barbican.git /home/ubuntu/cephtest/barbican'
2024-04-14T00:34:40.743 INFO:scrape:1 jobs: ['7654781']
2024-04-14T00:34:40.743 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 's3tests-branch', 'ubuntu_latest}']
2024-04-14T00:34:40.743 INFO:scrape:
2024-04-14T00:34:40.743 INFO:scrape:Failure: Command failed on smithi044 with status 100: 'DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install python-dev'
2024-04-14T00:34:40.743 INFO:scrape:1 jobs: ['7654802']
2024-04-14T00:34:40.743 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/kmip', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 's3tests-branch', 'ubuntu_latest}']
2024-04-14T00:34:40.743 INFO:scrape:
2024-04-14T00:34:40.743 INFO:scrape:Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbb5a76b0a7]
2024-04-14T00:34:40.743 INFO:scrape:ceph version 18.2.2-1217-g7d36322c (7d36322c373c73b184fd252cd881b122d8c51a3b) reef (stable)
 1: /lib64/libc.so.6(+0x54db0) [0x7fbb57c54db0]
 2: /lib64/libc.so.6(+0xa154c) [0x7fbb57ca154c]
 3: raise()
 4: abort()
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbb5a76b0a7]
 6: /usr/lib64/ceph/libceph-common.so.2(+0x16b20b) [0x7fbb5a76b20b]
 7: (std::__detail::__variant::__gen_vtable_impl<std::__detail::__variant::_Multi_array<std::__detail::__variant::__deduce_visit_result<int> (*)(FaultInjector<std::basic_string_view<char, std::char_traits<char> > >::check(std::basic_string_view<char, std::char_traits<char> > const&) const::visitor&&, std::variant<std::monostate, InjectAbort, InjectError, InjectDelay> const&)>, std::integer_sequence<unsigned long, 1ul> >::__visit_invoke(FaultInjector<std::basic_string_view<char, std::char_traits<char> > >::check(std::basic_string_view<char, std::char_traits<char> > const&) const::visitor&&, std::variant<std::monostate, InjectAbort, InjectError, InjectDelay> const&)+0x41) [0x55c0f0148761]
 8: radosgw-admin(+0x740302) [0x55c0f015a302]
 9: (RGWBucketReshard::execute(int, FaultInjector<std::basic_string_view<char, std::char_traits<char> > >&, int, DoutPrefixProvider const*, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x249) [0x55c0f015ede9]
 10: main()
 11: /lib64/libc.so.6(+0x3feb0) [0x7fbb57c3feb0]
 12: __libc_start_main()
 13: _start()
2024-04-14T00:34:40.743 INFO:scrape:1 jobs: ['7654815']
2024-04-14T00:34:40.743 INFO:scrape:suites: ['cls', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec-profile', 's3tests', 's3tests-branch', 's3tests-java', 'sharding$/{single}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{centos_latest}', 'tasks/{bucket-check', 'validater/valgrind}', 'versioning}']
2024-04-14T00:34:40.744 INFO:scrape:
2024-04-14T00:34:40.746 INFO:teuthology.results:Sending results to ceph-qa@ceph.com: Test Run: teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/
failed:  7
dead:    0
running: 0
waiting: 0
queued:  0
passed:  62


Fail
=================================================================
[7654781]  rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest}
-----------------------------------------------------------------
time:   00:18:20
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654781/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654781/
sentry: https://sentry.ceph.com/organizations/ceph/?query=60a4aea2cbe64ec0865bcdb387cf7352

    Command failed on smithi072 with status 128: 'git clone -b stable/xena
    https://github.com/openstack/barbican.git /home/ubuntu/cephtest/barbican'

[7654786]  rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{centos_8} tasks/test_multi}
-----------------------------------------------------------------
time:   03:42:14
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654786/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654786/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4535ab05dbb049d3a36cfc7c67268e7c

    rgw multisite test failures

[7654802]  rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest}
-----------------------------------------------------------------
time:   00:10:04
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654802/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654802/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2b907fafb9fa4acc9c4761ae7b49b365

    Command failed on smithi044 with status 100:
    'DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install
    python-dev'

[7654815]  rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}
-----------------------------------------------------------------
time:   00:50:19
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654815/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654815/

    saw valgrind issues

[7654822]  rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{rhel_8} tasks/test_multi}
-----------------------------------------------------------------
time:   02:33:28
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654822/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654822/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6ea88206543243d29f7dad146446706d

    rgw multisite test failures

[7654827]  rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}
-----------------------------------------------------------------
time:   01:03:43
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654827/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654827/

    saw valgrind issues

[7654835]  rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}
-----------------------------------------------------------------
time:   01:01:46
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654835/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654835/

    saw valgrind issues



Pass
=================================================================
[7654780] rgw/cloud-transition/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/cloud_transition_s3tests}
time:   00:33:14
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654780/

[7654782] rgw/dbstore/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_20.04} tasks/rgw_s3tests}
time:   00:16:48
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654782/

[7654783] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default ignore-pg-availability overrides s3a-hadoop}
time:   00:21:57
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654783/

[7654784] rgw/lifecycle/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_20.04} tasks/rgw_s3tests}
time:   00:26:01
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654784/

[7654785] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_bucket_quota ubuntu_latest}
time:   00:13:39
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654785/

[7654787] rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides supported-all-distro$/{centos_8} tasks/{0-install test_amqp test_kafka test_others}}
time:   00:37:21
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654787/

[7654788] rgw/service-token/{clusters/fixed-1 frontend/beast ignore-pg-availability overrides tasks/service-token ubuntu_latest}
time:   00:16:47
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654788/

[7654789] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_20.04}}
time:   00:11:53
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654789/

[7654790] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/{0-install first ststests}}
time:   00:31:35
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654790/

[7654791] rgw/tempest/{clusters/fixed-1 frontend/beast ignore-pg-availability overrides tasks/rgw_tempest ubuntu_latest}
time:   00:24:43
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654791/

[7654792] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}
time:   00:17:16
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654792/

[7654793] rgw/tools/{centos_latest cluster ignore-pg-availability tasks}
time:   02:42:33
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654793/

[7654794] rgw/upgrade/{1-install/pacific/{distro$/{centos_8.stream} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides}
time:   00:18:57
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654794/

[7654795] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}
time:   00:35:00
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654795/

[7654796] rgw/website/{clusters/fixed-2 frontend/beast http ignore-pg-availability overrides s3tests-branch tasks/s3tests-website ubuntu_latest}
time:   00:22:21
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654796/

[7654797] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_8} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}
time:   01:05:59
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654797/

[7654798] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/rgw_multipart_upload ubuntu_latest}
time:   00:12:39
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654798/

[7654799] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}
time:   00:34:30
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654799/

[7654800] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rhel_8} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}
time:   01:11:16
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654800/

[7654801] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_ragweed ubuntu_latest}
time:   00:11:28
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654801/

[7654803] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}
time:   00:36:31
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654803/

[7654804] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_s3tests ubuntu_latest}
time:   00:20:16
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654804/

[7654805] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_20.04} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}
time:   01:26:19
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654805/

[7654806] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload}
time:   00:16:14
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654806/

[7654807] rgw/upgrade/{1-install/quincy/{distro$/{ubuntu_20.04} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides}
time:   00:14:19
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654807/

[7654808] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rhel_8} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}
time:   00:44:17
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654808/

[7654809] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/rgw_user_quota ubuntu_latest}
time:   00:12:27
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654809/

[7654810] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rhel_8} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}
time:   00:58:09
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654810/

[7654811] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest}
time:   00:18:36
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654811/

[7654812] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_bucket_quota ubuntu_latest}
time:   00:14:01
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654812/

[7654813] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}}
time:   00:13:04
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654813/

[7654814] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}
time:   00:47:19
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654814/

[7654816] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_multipart_upload ubuntu_latest}
time:   00:12:49
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654816/

[7654817] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}
time:   00:39:29
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654817/

[7654818] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_20.04} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}
time:   01:06:49
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654818/

[7654819] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/rgw_ragweed ubuntu_latest}
time:   00:11:18
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654819/

[7654820] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest}
time:   00:19:14
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654820/

[7654821] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 ignore-pg-availability overrides s3a-hadoop}
time:   00:20:14
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654821/

[7654823] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests}
time:   00:23:06
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654823/

[7654824] rgw/upgrade/{1-install/quincy/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides}
time:   00:13:41
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654824/

[7654825] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}
time:   00:37:27
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654825/

[7654826] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_s3tests ubuntu_latest}
time:   00:19:33
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654826/

[7654828] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}
time:   00:44:37
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654828/

[7654829] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_user_quota ubuntu_latest}
time:   00:12:30
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654829/

[7654830] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}
time:   01:49:02
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654830/

[7654831] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest}
time:   00:18:48
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654831/

[7654832] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/rgw_bucket_quota ubuntu_latest}
time:   00:13:44
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654832/

[7654833] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}}
time:   00:13:01
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654833/

[7654834] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rhel_8} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}
time:   00:39:40
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654834/

[7654836] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_multipart_upload ubuntu_latest}
time:   00:13:24
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654836/

[7654837] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota}
time:   00:18:32
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654837/

[7654838] rgw/upgrade/{1-install/pacific/{distro$/{ubuntu_20.04} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides}
time:   00:13:57
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654838/

[7654839] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rhel_8} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}
time:   00:43:07
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654839/

[7654840] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}
time:   00:52:44
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654840/

[7654841] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_ragweed ubuntu_latest}
time:   00:11:22
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654841/

[7654842] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest}
time:   00:19:04
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654842/

[7654843] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}
time:   00:41:19
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654843/

[7654844] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/rgw_s3tests ubuntu_latest}
time:   00:20:22
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654844/

[7654845] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_20.04} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}
time:   01:05:06
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654845/

[7654846] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}
time:   00:48:05
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654846/

[7654847] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_user_quota ubuntu_latest}
time:   00:12:32
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654847/

[7654848] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}
time:   01:16:20
info:   https://pulpito.ceph.com/teuthology-2024-04-12_22:40:02-rgw-reef-distro-default-smithi/7654848/