2024-04-09T09:42:55.054 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-04-09T09:42:55.054 INFO:teuthology.results:subset: '111/120000'
2024-04-09T09:42:55.054 INFO:teuthology.results:seed: '9468'
2024-04-09T21:16:58.291 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-04-09T21:16:58.311 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2024-04-10T08:34:04.669 INFO:teuthology.results:Tests finished! gathering results...
2024-04-10T08:34:29.917 INFO:scrape:Found 304 jobs
2024-04-10T08:34:31.893 WARNING:scrape:Misunderstood line: 
2024-04-10T08:34:34.548 WARNING:scrape:Misunderstood line: 
2024-04-10T08:34:35.054 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647635/teuthology.log
2024-04-10T08:34:35.371 INFO:scrape:Found 12 distinct failure reasons
2024-04-10T08:34:35.371 INFO:scrape:Failure: Command failed (workunit test cephtool/test.sh) on smithi187 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'
2024-04-10T08:34:35.372 INFO:scrape:4 jobs: ['7647523', '7647366', '7647663', '7647809']
2024-04-10T08:34:35.372 INFO:scrape:suites intersection: ['rados', 'rados/singleton-bluestore/{all/cephtool']
2024-04-10T08:34:35.372 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/none', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'rados', 'rados/singleton-bluestore/{all/cephtool', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}}']
2024-04-10T08:34:35.372 INFO:scrape:
2024-04-10T08:34:35.372 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi194 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'
2024-04-10T08:34:35.372 INFO:scrape:3 jobs: ['7647904', '7647410', '7647645']
2024-04-10T08:34:35.372 INFO:scrape:suites intersection: ['agent/on', 'mon_election/connectivity', 'task/test_cephadm}']
2024-04-10T08:34:35.373 INFO:scrape:suites union: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_cephadm}']
2024-04-10T08:34:35.373 INFO:scrape:
2024-04-10T08:34:35.373 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh
2024-04-10T08:34:35.373 INFO:scrape:1 jobs: ['7647721']
2024-04-10T08:34:35.373 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_cls_all', 'validater/valgrind}']
2024-04-10T08:34:35.373 INFO:scrape:
2024-04-10T08:34:35.373 INFO:scrape:Dead: b'2024-04-10T08:31:14.280 DEBUG:teuthology.exit:Finished running handlers'
2024-04-10T08:34:35.373 INFO:scrape:1 jobs: ['7647835']
2024-04-10T08:34:35.373 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'mon_election/connectivity', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'recovery-overrides/{more-async-recovery}', 'supported-random-distro$/{ubuntu_20.04}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}']
2024-04-10T08:34:35.373 INFO:scrape:
2024-04-10T08:34:35.374 INFO:scrape:Timeout 6h running clone.client.0/qa/workunits/rados/test.sh
2024-04-10T08:34:35.374 INFO:scrape:2 jobs: ['7647859', '7647481']
2024-04-10T08:34:35.374 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}']
2024-04-10T08:34:35.374 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}']
2024-04-10T08:34:35.374 INFO:scrape:
2024-04-10T08:34:35.374 INFO:scrape:Valgrind: mon (Leak_StillReachable)
2024-04-10T08:34:35.374 INFO:scrape:2 jobs: ['7647587', '7647585']
2024-04-10T08:34:35.374 INFO:scrape:suites intersection: []
2024-04-10T08:34:35.374 INFO:scrape:suites union: ['2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'validater/valgrind}']
2024-04-10T08:34:35.375 INFO:scrape:
2024-04-10T08:34:35.375 INFO:scrape:Failure: Command failed on smithi165 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1187-gd540ebac-1jammy ceph-mds=18.2.2-1187-gd540ebac-1jammy ceph-common=18.2.2-1187-gd540ebac-1jammy ceph-fuse=18.2.2-1187-gd540ebac-1jammy ceph-test=18.2.2-1187-gd540ebac-1jammy radosgw=18.2.2-1187-gd540ebac-1jammy python-ceph=18.2.2-1187-gd540ebac-1jammy libcephfs1=18.2.2-1187-gd540ebac-1jammy libcephfs-java=18.2.2-1187-gd540ebac-1jammy libcephfs-jni=18.2.2-1187-gd540ebac-1jammy librados2=18.2.2-1187-gd540ebac-1jammy librbd1=18.2.2-1187-gd540ebac-1jammy rbd-fuse=18.2.2-1187-gd540ebac-1jammy'
2024-04-10T08:34:35.375 INFO:scrape:2 jobs: ['7647487', '7647491']
2024-04-10T08:34:35.375 INFO:scrape:suites intersection: ['mon_election/connectivity', 'rados']
2024-04-10T08:34:35.375 INFO:scrape:suites union: ['clusters/{fixed-4', 'mon_election/connectivity', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/singleton-nomsgr/{all/crushdiff', 'rados/thrash-erasure-code-shec/{ceph', 'recovery-overrides/{default}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'thrashers/default', 'thrashosds-health', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}']
2024-04-10T08:34:35.375 INFO:scrape:
2024-04-10T08:34:35.375 INFO:scrape:Failure: Command failed (workunit test mon/osd-erasure-code-profile.sh) on smithi115 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh'
2024-04-10T08:34:35.375 INFO:scrape:1 jobs: ['7647747']
2024-04-10T08:34:35.375 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{rhel_8}', 'workloads/mon}']
2024-04-10T08:34:35.375 INFO:scrape:
2024-04-10T08:34:35.376 INFO:scrape:Failure: Command failed on smithi005 with status 1: 'sudo yum -y install cephfs-java'
2024-04-10T08:34:35.376 INFO:scrape:1 jobs: ['7647494']
2024-04-10T08:34:35.376 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/many', 'msgr/async-v1only', 'objectstore/bluestore-comp-snappy', 'rados', 'rados/singleton/{all/mon-config-keys', 'supported-random-distro$/{centos_latest}}']
2024-04-10T08:34:35.376 INFO:scrape:
2024-04-10T08:34:35.376 INFO:scrape:Failure: "2024-04-09T11:40:00.000170+0000 mon.a (mon.0) 610 : cluster [WRN] overall HEALTH_WARN 1 pool(s) do not have an application enabled" in cluster log
2024-04-10T08:34:35.376 INFO:scrape:1 jobs: ['7647437']
2024-04-10T08:34:35.376 INFO:scrape:suites: ['clusters/{fixed-2', 'mon_election/classic', 'msgr-failures/many', 'msgr/async', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rados_cls_all}']
2024-04-10T08:34:35.376 INFO:scrape:
2024-04-10T08:34:35.376 INFO:scrape:Dead: None
2024-04-10T08:34:35.376 INFO:scrape:1 jobs: ['7647635']
2024-04-10T08:34:35.376 INFO:scrape:
2024-04-10T08:34:35.377 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats'
2024-04-10T08:34:35.377 INFO:scrape:1 jobs: ['7647551']
2024-04-10T08:34:35.377 INFO:scrape:suites: ['mon_election/classic', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{ubuntu_latest}}']
2024-04-10T08:34:35.377 INFO:scrape:
2024-04-10T08:34:35.388 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/
failed:  18
dead:    2
running: 0
waiting: 0
queued:  0
passed:  284


Fail
=================================================================
[7647366]  rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:37:12
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647366/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647366/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3d776e9c274744fb8e5d66b0dd8986fb

    Command failed (workunit test cephtool/test.sh) on smithi170 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

[7647410]  rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:09:32
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647410/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647410/
sentry: https://sentry.ceph.com/organizations/ceph/?query=21a1456edfe3460298b2eb754a1301fd

    Command failed (workunit test cephadm/test_cephadm.sh) on smithi152 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

[7647437]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all}
-----------------------------------------------------------------
time:   00:21:46
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647437/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647437/

    "2024-04-09T11:40:00.000170+0000 mon.a (mon.0) 610 : cluster [WRN] overall
    HEALTH_WARN 1 pool(s) do not have an application enabled" in cluster log

[7647481]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}
-----------------------------------------------------------------
time:   06:21:15
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647481/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7f18ee2c431c44ad972a61621d1c2393

    Command failed (workunit test rados/test.sh) on smithi029 with status 124:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 6h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

[7647487]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   00:07:34
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647487/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647487/
sentry: https://sentry.ceph.com/organizations/ceph/?query=61ca044245c446c09e1a2b33f66602aa

    Command failed on smithi165 with status 100: 'sudo
    DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="
    --force-confdef" -o Dpkg::Options::="--force-confold" install
    ceph=18.2.2-1187-gd540ebac-1jammy ceph-mds=18.2.2-1187-gd540ebac-1jammy
    ceph-common=18.2.2-1187-gd540ebac-1jammy ceph-
    fuse=18.2.2-1187-gd540ebac-1jammy ceph-test=18.2.2-1187-gd540ebac-1jammy
    radosgw=18.2.2-1187-gd540ebac-1jammy python-
    ceph=18.2.2-1187-gd540ebac-1jammy libcephfs1=18.2.2-1187-gd540ebac-1jammy
    libcephfs-java=18.2.2-1187-gd540ebac-1jammy libcephfs-
    jni=18.2.2-1187-gd540ebac-1jammy librados2=18.2.2-1187-gd540ebac-1jammy
    librbd1=18.2.2-1187-gd540ebac-1jammy rbd-fuse=18.2.2-1187-gd540ebac-1jammy'

[7647491]  rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:07:05
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647491/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647491/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cf16e1eb7ef84f42827f6f7ae6f3bf7d

    Command failed on smithi159 with status 100: 'sudo
    DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="
    --force-confdef" -o Dpkg::Options::="--force-confold" install
    ceph=18.2.2-1187-gd540ebac-1jammy ceph-mds=18.2.2-1187-gd540ebac-1jammy
    ceph-common=18.2.2-1187-gd540ebac-1jammy ceph-
    fuse=18.2.2-1187-gd540ebac-1jammy ceph-test=18.2.2-1187-gd540ebac-1jammy
    radosgw=18.2.2-1187-gd540ebac-1jammy python-
    ceph=18.2.2-1187-gd540ebac-1jammy libcephfs1=18.2.2-1187-gd540ebac-1jammy
    libcephfs-java=18.2.2-1187-gd540ebac-1jammy libcephfs-
    jni=18.2.2-1187-gd540ebac-1jammy librados2=18.2.2-1187-gd540ebac-1jammy
    librbd1=18.2.2-1187-gd540ebac-1jammy rbd-fuse=18.2.2-1187-gd540ebac-1jammy'

[7647494]  rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
-----------------------------------------------------------------
time:   00:05:52
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647494/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647494/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a2ba9a04e7614e5a81b7b6e85fa12b6b

    Command failed on smithi005 with status 1: 'sudo yum -y install cephfs-
    java'

[7647523]  rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:37:24
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647523/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647523/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fcb17034920d461297f213615401c7e8

    Command failed (workunit test cephtool/test.sh) on smithi187 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

[7647551]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:10:36
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647551/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647551/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9ba7548f1c2a470c9d3548dcf5754546

    Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c
    ceph_test_lazy_omap_stats'

[7647585]  rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
-----------------------------------------------------------------
time:   00:19:37
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647585/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647585/

    saw valgrind issues

[7647587]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}
-----------------------------------------------------------------
time:   00:38:33
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647587/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647587/

    saw valgrind issues

[7647645]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:19:44
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647645/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647645/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b62387fd63bc4fe69688be39807ce7bc

    Command failed (workunit test cephadm/test_cephadm.sh) on smithi175 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

[7647663]  rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:28:04
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647663/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647663/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1ee78dc15f29462d8c1c0950193c88aa

    Command failed (workunit test cephtool/test.sh) on smithi077 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

[7647721]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}
-----------------------------------------------------------------
time:   03:19:17
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647721/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647721/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0ad3b43377b54c628f0958ad5a5c3a1d

    Command failed (workunit test cls/test_cls_2pc_queue.sh) on smithi077 with
    status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cls/test_cls_2pc_queue.sh'

[7647747]  rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon}
-----------------------------------------------------------------
time:   00:54:45
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647747/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647747/
sentry: https://sentry.ceph.com/organizations/ceph/?query=caf01799aea4429385f85eee1aef2f17

    Command failed (workunit test mon/osd-erasure-code-profile.sh) on smithi115
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-
    profile.sh'

[7647809]  rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:28:03
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647809/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647809/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3485b2e2570e425ba658898eb361d505

    Command failed (workunit test cephtool/test.sh) on smithi190 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

[7647859]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind}
-----------------------------------------------------------------
time:   06:20:27
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647859/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647859/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e368469e79f14e59876b5ff01719c4ec

    Command failed (workunit test rados/test.sh) on smithi060 with status 124:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 6h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

[7647904]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:11:04
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647904/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647904/
sentry: https://sentry.ceph.com/organizations/ceph/?query=df5ef6b5b276423a9ddd5732174acaee

    Command failed (workunit test cephadm/test_cephadm.sh) on smithi194 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'



Dead
=================================================================
[7647635]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647635/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647635/

    Error reimaging machines: Expected smithi196's OS to be ubuntu 20.04 but
    found centos 9

[7647835]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647835/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647835/

    hit max job timeout



Pass
=================================================================
[7647303] rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub}
time:   02:39:13
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647303/

[7647306] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/workunits}
time:   00:11:25
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647306/

[7647309] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:35:36
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647309/

[7647312] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed}
time:   00:12:00
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647312/

[7647315] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:28:12
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647315/

[7647318] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:11:48
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647318/

[7647321] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:19:08
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647321/

[7647324] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_workunits}
time:   00:29:31
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647324/

[7647327] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:09:42
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647327/

[7647330] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-snaps}
time:   00:23:01
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647330/

[7647333] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_ca_signed_key}
time:   00:21:09
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647333/

[7647336] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:09:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647336/

[7647339] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:20:32
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647339/

[7647342] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
time:   00:39:34
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647342/

[7647345] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:24:04
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647345/

[7647348] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:13:20
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647348/

[7647351] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/rados_api_tests}
time:   00:26:05
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647351/

[7647354] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/pool-snaps-few-objects}
time:   00:27:09
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647354/

[7647357] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
time:   00:23:44
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647357/

[7647360] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:21:45
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647360/

[7647363] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:25:08
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647363/

[7647369] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:15:30
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647369/

[7647372] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:25:11
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647372/

[7647374] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:31:48
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647374/

[7647377] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:37:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647377/

[7647381] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/rados_api_tests}
time:   00:27:44
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647381/

[7647384] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} tasks/dashboard}
time:   01:22:26
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647384/

[7647386] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{rhel_8} tasks/crash}
time:   00:21:31
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647386/

[7647389] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_latest}}
time:   00:36:52
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647389/

[7647392] rados/rest/{mgr-restful supported-random-distro$/{centos_latest}}
time:   00:12:06
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647392/

[7647395] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:09
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647395/

[7647398] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c}
time:   00:15:21
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647398/

[7647401] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   01:32:09
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647401/

[7647404] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
time:   00:17:22
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647404/

[7647407] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep}
time:   00:12:24
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647407/

[7647413] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:23:04
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647413/

[7647416] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}}
time:   00:10:17
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647416/

[7647419] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:16:51
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647419/

[7647422] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency}
time:   00:37:02
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647422/

[7647425] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:11:51
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647425/

[7647428] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:13:50
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647428/

[7647431] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/one workloads/snaps-few-objects}
time:   00:36:29
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647431/

[7647434] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}}
time:   00:11:42
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647434/

[7647440] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final}
time:   00:17:39
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647440/

[7647443] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} tasks/mon_clock_with_skews}
time:   00:08:47
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647443/

[7647446] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench}
time:   00:27:04
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647446/

[7647449] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:22:45
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647449/

[7647452] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:13:32
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647452/

[7647455] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos}
time:   00:07:37
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647455/

[7647458] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:13:23
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647458/

[7647460] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/redirect}
time:   00:12:02
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647460/

[7647462] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:15:15
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647462/

[7647463] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:19:38
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647463/

[7647464] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
time:   00:38:51
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647464/

[7647465] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:51
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647465/

[7647466] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:25
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647466/

[7647467] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_20.04} tasks/failover}
time:   00:15:24
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647467/

[7647468] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush}
time:   00:31:01
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647468/

[7647470] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:13:12
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647470/

[7647472] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
time:   00:12:59
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647472/

[7647474] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:17:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647474/

[7647475] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:18:51
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647475/

[7647477] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests}
time:   00:14:27
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647477/

[7647479] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps}
time:   00:43:26
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647479/

[7647483] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python}
time:   00:17:50
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647483/

[7647485] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:10:50
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647485/

[7647489] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_extra_daemon_features}
time:   00:17:56
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647489/

[7647493] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect_set_object}
time:   00:17:56
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647493/

[7647495] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_latest}}
time:   00:07:47
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647495/

[7647496] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:21:47
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647496/

[7647497] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/pool-create-delete}
time:   00:18:12
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647497/

[7647498] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_recovery}
time:   00:34:45
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647498/

[7647499] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_host_drain}
time:   00:28:21
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647499/

[7647500] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:00
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647500/

[7647502] rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04}}
time:   00:16:51
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647502/

[7647504] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/set-chunks-read}
time:   00:28:25
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647504/

[7647506] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
time:   00:13:52
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647506/

[7647508] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:20:50
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647508/

[7647510] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_8} tasks/insights}
time:   00:13:50
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647510/

[7647512] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/rados_stress_watch}
time:   00:14:56
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647512/

[7647514] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:11:06
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647514/

[7647515] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
time:   00:28:06
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647515/

[7647516] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:26:40
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647516/

[7647517] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:23:11
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647517/

[7647518] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced}
time:   00:24:38
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647518/

[7647519] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/erasure-code}
time:   01:25:33
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647519/

[7647520] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:24:44
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647520/

[7647521] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:16:24
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647521/

[7647522] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:37:56
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647522/

[7647524] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}}
time:   00:30:10
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647524/

[7647525] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:10:02
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647525/

[7647526] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}
time:   00:17:51
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647526/

[7647527] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:20:05
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647527/

[7647528] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-localized}
time:   00:21:14
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647528/

[7647529] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:19
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647529/

[7647530] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
time:   00:13:59
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647530/

[7647531] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:18:02
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647531/

[7647532] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:15:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647532/

[7647533] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} tasks/e2e}
time:   00:26:35
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647533/

[7647535] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:09:10
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647535/

[7647537] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench}
time:   01:57:59
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647537/

[7647539] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects}
time:   00:30:36
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647539/

[7647541] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925}
time:   00:12:13
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647541/

[7647543] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite}
time:   00:18:47
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647543/

[7647545] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} tasks/rados_striper}
time:   00:10:44
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647545/

[7647547] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:33
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647547/

[7647549] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews}
time:   00:11:49
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647549/

[7647553] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_latest} tasks/module_selftest}
time:   00:23:39
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647553/

[7647555] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:32:33
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647555/

[7647557] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_20.04}}
time:   00:14:09
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647557/

[7647559] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final}
time:   00:20:12
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647559/

[7647561] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/mgr}
time:   00:15:39
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647561/

[7647563] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
time:   01:16:12
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647563/

[7647565] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:14:18
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647565/

[7647567] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-radosbench}
time:   02:01:24
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647567/

[7647569] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:17:33
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647569/

[7647571] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write}
time:   00:12:37
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647571/

[7647573] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:24:41
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647573/

[7647575] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/snaps-few-objects-localized}
time:   00:26:00
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647575/

[7647577] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:21:17
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647577/

[7647579] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:16:30
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647579/

[7647581] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_set_mon_crush_locations}
time:   01:12:12
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647581/

[7647583] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:18:45
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647583/

[7647589] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   01:17:43
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647589/

[7647591] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:22:27
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647591/

[7647593] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects}
time:   00:25:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647593/

[7647595] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} tasks/rados_workunit_loadgen_big}
time:   00:32:27
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647595/

[7647597] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:23:38
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647597/

[7647599] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
time:   00:18:12
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647599/

[7647601] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:19:42
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647601/

[7647603] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests}
time:   01:03:53
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647603/

[7647605] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_ca_signed_key}
time:   00:43:13
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647605/

[7647607] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed}
time:   00:16:15
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647607/

[7647609] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_latest} tasks/per_module_finisher_stats}
time:   00:09:34
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647609/

[7647611] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write}
time:   00:24:01
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647611/

[7647613] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}}
time:   00:17:53
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647613/

[7647615] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews}
time:   00:08:35
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647615/

[7647617] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:19:05
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647617/

[7647619] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:18:22
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647619/

[7647621] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls}
time:   00:35:56
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647621/

[7647623] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/misc}
time:   01:06:40
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647623/

[7647625] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:14:57
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647625/

[7647627] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}}
time:   00:34:15
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647627/

[7647629] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:26:25
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647629/

[7647631] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:11:28
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647631/

[7647633] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced}
time:   00:20:35
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647633/

[7647637] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix}
time:   00:23:24
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647637/

[7647639] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}}
time:   00:33:50
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647639/

[7647641] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big}
time:   00:22:44
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647641/

[7647643] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:15:06
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647643/

[7647647] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:39:45
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647647/

[7647649] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:52
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647649/

[7647651] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}
time:   00:25:34
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647651/

[7647653] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:14
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647653/

[7647655] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio}
time:   00:14:49
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647655/

[7647657] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:16:07
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647657/

[7647659] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}}
time:   00:29:19
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647659/

[7647661] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-small}
time:   00:15:35
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647661/

[7647665] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_20.04} tasks/progress}
time:   00:24:16
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647665/

[7647667] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:23:13
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647667/

[7647669] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:16:40
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647669/

[7647671] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:22:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647671/

[7647673] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune}
time:   00:55:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647673/

[7647675] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:09:38
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647675/

[7647677] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:31:28
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647677/

[7647679] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos}
time:   00:14:31
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647679/

[7647681] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} tasks/mon_recovery}
time:   00:15:48
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647681/

[7647683] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread}
time:   00:26:49
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647683/

[7647685] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/dashboard}
time:   01:21:54
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647685/

[7647687] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:20:04
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647687/

[7647689] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/mon-stretch}
time:   00:24:32
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647689/

[7647691] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   01:39:27
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647691/

[7647693] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:20
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647693/

[7647695] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final}
time:   00:15:13
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647695/

[7647697] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps}
time:   00:24:32
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647697/

[7647699] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench}
time:   00:12:48
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647699/

[7647701] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:21:21
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647701/

[7647703] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read}
time:   00:32:09
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647703/

[7647705] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:30
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647705/

[7647707] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_extra_daemon_features}
time:   00:18:04
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647707/

[7647709] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:08
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647709/

[7647711] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
time:   00:39:53
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647711/

[7647713] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:13:41
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647713/

[7647715] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced}
time:   00:21:26
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647715/

[7647717] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:16:02
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647717/

[7647719] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:12:46
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647719/

[7647723] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:18:24
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647723/

[7647725] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/prometheus}
time:   00:11:38
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647725/

[7647727] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
time:   01:21:01
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647727/

[7647729] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{rhel_8}}
time:   02:21:31
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647729/

[7647731] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps}
time:   00:21:23
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647731/

[7647733] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/readwrite}
time:   00:17:28
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647733/

[7647735] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:22:25
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647735/

[7647737] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:19:13
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647737/

[7647739] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
time:   00:14:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647739/

[7647741] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}}
time:   00:32:03
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647741/

[7647743] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits}
time:   00:31:12
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647743/

[7647745] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_host_drain}
time:   00:18:12
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647745/

[7647749] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache}
time:   00:14:32
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647749/

[7647751] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:10:13
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647751/

[7647753] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:08:23
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647753/

[7647755] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}}
time:   00:22:37
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647755/

[7647757] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:31:36
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647757/

[7647759] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:15:22
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647759/

[7647761] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed}
time:   00:23:20
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647761/

[7647763] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:19:19
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647763/

[7647765] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:28:22
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647765/

[7647767] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:33:14
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647767/

[7647769] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:11:26
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647769/

[7647771] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:20:33
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647771/

[7647773] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/repair_test}
time:   00:18:48
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647773/

[7647775] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:37:03
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647775/

[7647777] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:14:46
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647777/

[7647779] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/workunits}
time:   00:11:20
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647779/

[7647780] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:16:13
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647780/

[7647783] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/dedup-io-snaps}
time:   00:12:51
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647783/

[7647785] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:04
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647785/

[7647787] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:18:31
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647787/

[7647789] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
time:   00:18:22
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647789/

[7647791] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep}
time:   00:12:23
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647791/

[7647793] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}}
time:   00:09:15
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647793/

[7647795] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_rgw_multisite}
time:   00:25:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647795/

[7647797] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api}
time:   00:22:13
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647797/

[7647799] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects}
time:   00:25:42
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647799/

[7647801] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
time:   00:17:36
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647801/

[7647803] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:49
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647803/

[7647805] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:26:01
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647805/

[7647807] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd-backfill}
time:   02:35:56
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647807/

[7647811] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete}
time:   00:15:37
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647811/

[7647813] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{rhel_8}}
time:   00:16:54
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647813/

[7647815] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews}
time:   00:19:14
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647815/

[7647817] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests}
time:   00:26:37
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647817/

[7647819] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:19:23
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647819/

[7647821] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}}
time:   00:21:35
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647821/

[7647823] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:13:59
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647823/

[7647825] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
time:   00:12:55
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647825/

[7647827] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/scrub_test}
time:   00:17:39
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647827/

[7647829] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_set_mon_crush_locations}
time:   00:27:39
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647829/

[7647831] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}}
time:   00:20:06
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647831/

[7647833] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency}
time:   00:24:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647833/

[7647837] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-small-objects}
time:   00:21:43
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647837/

[7647839] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} tasks/e2e}
time:   00:26:39
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647839/

[7647841] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{rhel_8} tasks/crash}
time:   00:23:08
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647841/

[7647843] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:12:07
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647843/

[7647845] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites}
time:   00:26:22
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647845/

[7647847] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:17:52
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647847/

[7647849] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:11:03
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647849/

[7647851] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:11:04
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647851/

[7647853] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:23:41
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647853/

[7647855] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/radosbench}
time:   00:51:28
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647855/

[7647857] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:12:29
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647857/

[7647861] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final}
time:   00:14:21
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647861/

[7647863] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:13:04
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647863/

[7647865] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}}
time:   00:12:05
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647865/

[7647867] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd}
time:   02:36:35
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647867/

[7647869] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:17:13
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647869/

[7647871] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/libcephsqlite}
time:   00:15:25
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647871/

[7647873] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:14:12
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647873/

[7647875] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect}
time:   00:16:01
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647875/

[7647877] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925}
time:   00:12:22
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647877/

[7647879] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_ca_signed_key}
time:   00:15:41
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647879/

[7647881] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps}
time:   00:35:02
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647881/

[7647882] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:21:34
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647882/

[7647885] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} tasks/mon_recovery}
time:   00:13:11
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647885/

[7647887] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:15:39
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647887/

[7647889] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests}
time:   00:14:45
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647889/

[7647891] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:16:36
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647891/

[7647893] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_latest} tasks/failover}
time:   00:13:34
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647893/

[7647895] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:18:18
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647895/

[7647896] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:25:43
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647896/

[7647898] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{ubuntu_latest}}
time:   00:09:31
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647898/

[7647900] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:27:31
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647900/

[7647901] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:30:20
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647901/

[7647902] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:13:14
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647902/

[7647903] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object}
time:   00:18:49
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647903/

[7647905] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:35:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647905/

[7647906] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}
time:   00:34:17
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647906/

[7647907] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests}
time:   00:29:14
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647907/

[7647908] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:33
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647908/

[7647909] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:18:21
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647909/

[7647910] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:19:06
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647910/

[7647911] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep}
time:   00:17:45
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647911/

[7647912] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read}
time:   00:17:42
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647912/

[7647913] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:35:48
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:16:20-rados-reef-release-distro-default-smithi/7647913/