2023-04-08T18:18:06.043 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae
2023-04-08T18:18:06.045 INFO:teuthology.results:subset: '111/12000'
2023-04-08T18:18:06.045 INFO:teuthology.results:seed: '9565'
2023-04-09T06:17:09.193 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae
2023-04-09T06:17:09.238 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-04-09T08:45:24.554 INFO:teuthology.results:Tests finished! gathering results...
2023-04-09T08:45:53.922 INFO:scrape:Found 387 jobs
2023-04-09T08:46:02.573 INFO:scrape:Found 7 distinct failure reasons
2023-04-09T08:46:02.574 INFO:scrape:Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi131 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=61110f1122e541c2fc2ece306e84ac8a90b2f589 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'
2023-04-09T08:46:02.575 INFO:scrape:2 jobs: ['7236167', '7236265']
2023-04-09T08:46:02.575 INFO:scrape:suites intersection: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'rados', 'test_envlibrados_for_rocksdb}']
2023-04-09T08:46:02.575 INFO:scrape:suites union: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_20.04}}', 'test_envlibrados_for_rocksdb}']
2023-04-09T08:46:02.576 INFO:scrape:
2023-04-09T08:46:02.576 INFO:scrape:Failure: Command failed on smithi089 with status 1: 'sudo yum install -y kernel'
2023-04-09T08:46:02.576 INFO:scrape:13 jobs: ['7235747', '7236303', '7236299', '7235927', '7236151', '7236396', '7235871', '7236315', '7235924', '7236378', '7235744', '7236390', '7235786']
2023-04-09T08:46:02.577 INFO:scrape:suites intersection: []
2023-04-09T08:46:02.577 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '0-size-min-size-overrides/3-size-2-min-size', '1-install/nautilus-v2only', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '1-rook', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-recovery}', '2-workload/none', '2-workload/radosbench', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'agent/off', 'agent/on', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'cluster/1-node', 'cluster/3-node', 'clusters/{fixed-2', 'clusters/{openstack', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'd-thrash/default/{default', 'd-thrash/none', 'debug/mgr', 'k8s/1.21', 'mgr_ttl_cache/disable', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'net/calico', 'net/flannel', 'net/host', 'no_pools', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/multimon/{clusters/3', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/verify/{centos_latest', 'random-objectstore$/{bluestore-comp-snappy}', 'rook/1.7.2}', 'rook/master}', 'supported-random-distro$/{centos_8}', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'task/test_orch_cli_mon}', 'tasks/mon_clock_no_skews}', 'tasks/mon_recovery', 'tasks/rados_cls_all', 'tasks/workunits}', 'test_iscsi_pids_limit}}', 'thrashers/careful', 'thrashers/morepggrow', 'thrashosds-health', 'thrashosds-health}', 'three-plus-one}', 'validater/lockdep}', 'validater/valgrind}', 'workloads/admin_socket_objecter_requests}', 'workloads/small-objects-balanced}', 'workloads/snaps-few-objects}']
2023-04-09T08:46:02.577 INFO:scrape:
2023-04-09T08:46:02.578 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi040 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=61110f1122e541c2fc2ece306e84ac8a90b2f589 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'
2023-04-09T08:46:02.578 INFO:scrape:2 jobs: ['7236149', '7236394']
2023-04-09T08:46:02.578 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}']
2023-04-09T08:46:02.579 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-lz4}', 'random-objectstore$/{bluestore-comp-zstd}', 'tasks/e2e}']
2023-04-09T08:46:02.579 INFO:scrape:
2023-04-09T08:46:02.579 INFO:scrape:Failure: "1681001611.7116923 osd.4 (osd.4) 93 : cluster [WRN] WaitReplicas::react(const DigestUpdate&): Unexpected DigestUpdate event" in cluster log
2023-04-09T08:46:02.579 INFO:scrape:3 jobs: ['7236068', '7236277', '7235798']
2023-04-09T08:46:02.580 INFO:scrape:suites intersection: ['mon_election/classic', 'rados']
2023-04-09T08:46:02.580 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-active-recovery}', '3-scrub-overrides/{default}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/fastclose', 'msgr-failures/none', 'msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/singleton-nomsgr/{all/recovery-unfound-found', 'rados/singleton/{all/osd-recovery-incomplete', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'thrashers/default', 'thrashosds-health', 'workloads/cache-snaps}']
2023-04-09T08:46:02.580 INFO:scrape:
2023-04-09T08:46:02.581 INFO:scrape:Failure: Command failed (workunit test misc/mclock-config.sh) on smithi005 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=61110f1122e541c2fc2ece306e84ac8a90b2f589 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh'
2023-04-09T08:46:02.581 INFO:scrape:1 jobs: ['7236278']
2023-04-09T08:46:02.581 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{rhel_8}', 'workloads/misc}']
2023-04-09T08:46:02.582 INFO:scrape:
2023-04-09T08:46:02.582 INFO:scrape:Failure: Test failure: test_create_and_delete_export (tasks.cephfs.test_nfs.TestNFS)
2023-04-09T08:46:02.582 INFO:scrape:1 jobs: ['7236077']
2023-04-09T08:46:02.582 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'task/test_nfs}']
2023-04-09T08:46:02.583 INFO:scrape:
2023-04-09T08:46:02.583 INFO:scrape:Timeout 120 running ceph --cluster ceph osd dump --format=json
2023-04-09T08:46:02.583 INFO:scrape:1 jobs: ['7236275']
2023-04-09T08:46:02.584 INFO:scrape:suites: ['clusters/{fixed-2', 'fast/normal', 'mon_election/connectivity', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-active-recovery}', 'supported-random-distro$/{ubuntu_20.04}', 'thrashers/careful', 'thrashosds-health', 'workloads/ec-radosbench}']
2023-04-09T08:46:02.584 INFO:scrape:
2023-04-09T08:46:02.603 INFO:teuthology.results:Sending results to yweinste@radhat.com: Test Run: yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/
failed:  23
dead:    0
running: 0
waiting: 0
queued:  0
passed:  364


Fail
=================================================================
[7235744]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/workunits}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235744/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235744/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a35b459c0b2d47559648ab906ccb7d27

    Command failed on smithi158 with status 1: 'sudo yum install -y kernel'

[7235747]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235747/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235747/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d737bfea87164705a3da5b0ead273209

    Command failed on smithi089 with status 1: 'sudo yum install -y kernel'

[7235786]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235786/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235786/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f018e2696ef34c888fa6b481797ac50e

    Command failed on smithi151 with status 1: 'sudo yum install -y kernel'

[7235798]  rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:47:55
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235798/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235798/

    "1680985639.2909472 osd.0 (osd.0) 8 : cluster [WRN]
    WaitReplicas::react(const DigestUpdate&): Unexpected DigestUpdate event" in
    cluster log

[7235871]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2}
-----------------------------------------------------------------
time:   00:06:16
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235871/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235871/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5699fc36bcea4d3a98ca7815d4e44987

    Command failed on smithi154 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7235924]  rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235924/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235924/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bd60447d25a5443da2d96cb843a7f35e

    Command failed on smithi100 with status 1: 'sudo yum install -y kernel'

[7235927]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235927/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235927/
sentry: https://sentry.ceph.com/organizations/ceph/?query=17fae4c2f8054a94adf1cacf6e8d57d1

    Command failed on smithi081 with status 1: 'sudo yum install -y kernel'

[7236068]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:25:13
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236068/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236068/

    "1681001611.7116923 osd.4 (osd.4) 93 : cluster [WRN]
    WaitReplicas::react(const DigestUpdate&): Unexpected DigestUpdate event" in
    cluster log

[7236077]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs}
-----------------------------------------------------------------
time:   01:31:37
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236077/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236077/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e711fc63b1a744cd8b40a779659b2981

    Test failure: test_create_and_delete_export (tasks.cephfs.test_nfs.TestNFS)

[7236149]  rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/e2e}
-----------------------------------------------------------------
time:   01:47:22
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236149/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236149/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5081bd33a023457d9c0a3f12f0a2fda5

    Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi040
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=61110f1122e541c2fc2ece306e84ac8a90b2f589
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

[7236151]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master}
-----------------------------------------------------------------
time:   00:06:21
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236151/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236151/
sentry: https://sentry.ceph.com/organizations/ceph/?query=539c2262e44a47bd80b3e9cae66e55cc

    Command failed on smithi002 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7236167]  rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}}
-----------------------------------------------------------------
time:   00:09:58
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236167/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236167/
sentry: https://sentry.ceph.com/organizations/ceph/?query=565fabd143594816b5a8e5b56794bdda

    Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on
    smithi131 with status 2: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=61110f1122e541c2fc2ece306e84ac8a90b2f589
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'

[7236265]  rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:13:26
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236265/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236265/
sentry: https://sentry.ceph.com/organizations/ceph/?query=66e9c392920d4eb08c27ab3cf217796d

    Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on
    smithi049 with status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=61110f1122e541c2fc2ece306e84ac8a90b2f589
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'

[7236275]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-radosbench}
-----------------------------------------------------------------
time:   01:27:26
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236275/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236275/

    Command failed on smithi081 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph osd dump --format=json'

[7236277]  rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:29:19
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236277/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236277/

    "1681014049.7263494 osd.0 (osd.0) 4 : cluster [WRN]
    WaitReplicas::react(const DigestUpdate&): Unexpected DigestUpdate event" in
    cluster log

[7236278]  rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc}
-----------------------------------------------------------------
time:   00:17:30
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236278/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236278/
sentry: https://sentry.ceph.com/organizations/ceph/?query=422346419fe344e7b08c9aa301d018a5

    Command failed (workunit test misc/mclock-config.sh) on smithi005 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=61110f1122e541c2fc2ece306e84ac8a90b2f589
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh'

[7236299]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2}
-----------------------------------------------------------------
time:   00:06:17
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236299/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236299/
sentry: https://sentry.ceph.com/organizations/ceph/?query=439cb58112ec4b8fa7683edc03c9e305

    Command failed on smithi067 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7236303]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236303/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236303/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5b805f7ae3cd4fb19a73ecb3e2b8aa41

    Command failed on smithi158 with status 1: 'sudo yum install -y kernel'

[7236315]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
-----------------------------------------------------------------
time:   00:18:21
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236315/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236315/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3d5c0c2abe494a0da2cf3b08acf6f35a

    Command failed on smithi167 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7236378]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236378/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236378/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7f5d6296d7a44d7f80dfa308ab7f615e

    Command failed on smithi023 with status 1: 'sudo yum install -y kernel'

[7236390]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236390/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236390/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0ccd7c9564c542db9dc4471f7fd2fbd3

    Command failed on smithi149 with status 1: 'sudo yum install -y kernel'

[7236394]  rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/e2e}
-----------------------------------------------------------------
time:   01:46:47
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236394/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236394/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2a60d167fe334ff8b8aa11efe8aa1d34

    Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi120
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=61110f1122e541c2fc2ece306e84ac8a90b2f589
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

[7236396]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master}
-----------------------------------------------------------------
time:   00:06:22
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236396/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236396/
sentry: https://sentry.ceph.com/organizations/ceph/?query=546c8a58bae046a08474174ec1148f1e

    Command failed on smithi035 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'



Pass
=================================================================
[7235726] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects}
time:   00:29:07
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235726/

[7235729] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed}
time:   00:18:22
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235729/

[7235732] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:10:24
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235732/

[7235735] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:32
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235735/

[7235738] rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub}
time:   03:38:37
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235738/

[7235741] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:17:23
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235741/

[7235750] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes}
time:   01:23:59
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235750/

[7235753] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-big}
time:   00:31:35
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235753/

[7235756] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:29:28
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235756/

[7235759] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:12:40
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235759/

[7235762] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:11:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235762/

[7235765] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small}
time:   00:18:34
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235765/

[7235768] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:19:49
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235768/

[7235771] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:18:56
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235771/

[7235774] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:11:46
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235774/

[7235777] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}}
time:   01:08:51
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235777/

[7235780] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   01:22:55
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235780/

[7235783] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_recovery}
time:   01:24:42
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235783/

[7235789] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps}
time:   00:21:48
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235789/

[7235792] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix}
time:   00:22:27
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235792/

[7235795] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption}
time:   00:14:29
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235795/

[7235801] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced}
time:   00:22:45
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235801/

[7235804] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:32:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235804/

[7235807] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps}
time:   00:27:58
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235807/

[7235810] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache}
time:   00:13:53
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235810/

[7235813] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:23:56
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235813/

[7235816] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:17:06
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235816/

[7235819] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed}
time:   00:13:40
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235819/

[7235822] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/one workloads/rados_mon_workunits}
time:   00:30:53
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235822/

[7235825] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:16:09
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235825/

[7235828] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps}
time:   00:16:35
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235828/

[7235831] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
time:   00:10:46
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235831/

[7235834] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:28:43
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235834/

[7235837] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
time:   01:08:14
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235837/

[7235841] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects}
time:   00:28:15
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235841/

[7235844] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:35:38
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235844/

[7235847] rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
time:   00:14:12
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235847/

[7235850] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests}
time:   01:30:33
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235850/

[7235853] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency}
time:   01:42:32
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235853/

[7235856] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm}
time:   00:19:01
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235856/

[7235859] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/dashboard}
time:   02:07:31
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235859/

[7235862] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/crash}
time:   00:13:16
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235862/

[7235865] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_20.04}}
time:   00:39:30
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235865/

[7235868] rados/rest/{mgr-restful supported-random-distro$/{centos_8}}
time:   01:13:10
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235868/

[7235874] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}}
time:   01:18:04
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235874/

[7235877] rados/standalone/{supported-random-distro$/{centos_8} workloads/c2c}
time:   00:52:01
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235877/

[7235880] rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   01:34:43
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235880/

[7235883] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
time:   01:16:09
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235883/

[7235886] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects}
time:   00:23:02
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235886/

[7235889] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench}
time:   00:54:02
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235889/

[7235891] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} tasks/rados_workunit_loadgen_mostlyread}
time:   00:29:59
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235891/

[7235894] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04}}
time:   00:15:14
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235894/

[7235897] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:23
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235897/

[7235900] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:23
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235900/

[7235903] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect}
time:   00:21:33
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235903/

[7235906] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:30:11
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235906/

[7235909] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests}
time:   01:12:45
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235909/

[7235912] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:28:23
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235912/

[7235915] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   01:12:12
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235915/

[7235918] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_set_object}
time:   01:13:50
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235918/

[7235921] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:14:29
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235921/

[7235930] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read}
time:   01:17:11
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235930/

[7235933] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final}
time:   00:14:05
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235933/

[7235936] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
time:   00:10:50
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235936/

[7235940] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-balanced}
time:   01:23:24
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235940/

[7235943] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:24
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235943/

[7235946] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-localized}
time:   00:24:39
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235946/

[7235949] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}
time:   01:11:04
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235949/

[7235952] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos}
time:   00:06:54
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235952/

[7235955] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects}
time:   00:24:57
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235955/

[7235958] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/sync-many workloads/snaps-few-objects}
time:   00:28:13
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235958/

[7235961] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:31:21
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235961/

[7235964] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:13:24
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235964/

[7235967] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized}
time:   00:28:55
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235967/

[7235970] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:28:53
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235970/

[7235973] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/readwrite}
time:   00:15:14
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235973/

[7235976] rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:16:18
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235976/

[7235979] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects}
time:   01:29:09
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235979/

[7235982] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed}
time:   00:16:14
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235982/

[7235985] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:30:15
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235985/

[7235988] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_20.04} tasks/failover}
time:   00:13:15
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235988/

[7235991] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
time:   01:23:16
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235991/

[7235994] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:34:38
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235994/

[7235997] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:08:15
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7235997/

[7236000] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush}
time:   00:22:24
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236000/

[7236003] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:20:04
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236003/

[7236006] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:27:46
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236006/

[7236009] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps}
time:   01:25:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236009/

[7236012] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
time:   00:10:52
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236012/

[7236015] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/cache-agent-big}
time:   01:00:50
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236015/

[7236018] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:25:22
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236018/

[7236021] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   01:14:18
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236021/

[7236024] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:23:25
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236024/

[7236027] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small}
time:   00:17:09
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236027/

[7236030] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
time:   01:18:29
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236030/

[7236033] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:15:36
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236033/

[7236036] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}}
time:   00:14:27
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236036/

[7236039] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:20:50
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236039/

[7236041] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:13:57
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236041/

[7236044] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}}
time:   00:10:06
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236044/

[7236047] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps}
time:   00:23:41
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236047/

[7236050] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews}
time:   01:08:09
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236050/

[7236053] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}
time:   01:33:20
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236053/

[7236056] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:16:44
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236056/

[7236059] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/cache-snaps-balanced}
time:   00:24:32
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236059/

[7236062] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}}
time:   00:24:13
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236062/

[7236065] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/repair_test}
time:   00:19:25
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236065/

[7236071] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:12:19
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236071/

[7236074] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/cache}
time:   00:12:24
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236074/

[7236080] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/dedup-io-mixed}
time:   00:12:23
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236080/

[7236083] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write}
time:   00:10:55
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236083/

[7236086] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/sync workloads/pool-create-delete}
time:   00:19:38
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236086/

[7236089] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}}
time:   01:09:13
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236089/

[7236092] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/dedup-io-snaps}
time:   00:15:02
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236092/

[7236095] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:17:53
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236095/

[7236098] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:09:24
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236098/

[7236101] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects}
time:   00:29:32
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236101/

[7236104] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/rados_api_tests}
time:   01:28:55
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236104/

[7236107] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:14:56
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236107/

[7236110] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{rhel_8} tasks/insights}
time:   00:17:10
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236110/

[7236113] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:15:30
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236113/

[7236116] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency}
time:   01:36:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236116/

[7236119] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
time:   00:25:36
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236119/

[7236122] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:10:15
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236122/

[7236125] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code}
time:   01:30:12
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236125/

[7236128] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench}
time:   01:28:11
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236128/

[7236130] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   01:25:05
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236130/

[7236132] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:06
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236132/

[7236134] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect}
time:   00:16:24
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236134/

[7236136] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}}
time:   01:11:32
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236136/

[7236138] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli}
time:   00:18:38
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236138/

[7236140] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} tasks/scrub_test}
time:   00:12:02
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236140/

[7236142] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/redirect_promote_tests}
time:   00:12:31
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236142/

[7236144] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench}
time:   02:37:58
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236144/

[7236146] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:27:30
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236146/

[7236153] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   01:09:42
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236153/

[7236155] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object}
time:   00:17:53
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236155/

[7236157] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write}
time:   00:25:23
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236157/

[7236159] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:17:25
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236159/

[7236161] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/set-chunks-read}
time:   00:16:24
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236161/

[7236163] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:17:24
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236163/

[7236165] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}
time:   03:06:30
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236165/

[7236169] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:25:30
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236169/

[7236171] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-balanced}
time:   00:25:13
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236171/

[7236173] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-localized}
time:   00:24:02
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236173/

[7236175] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}}
time:   01:10:07
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236175/

[7236177] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final}
time:   00:29:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236177/

[7236178] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/small-objects}
time:   00:21:48
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236178/

[7236179] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:53:28
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236179/

[7236180] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}}
time:   00:16:44
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236180/

[7236181] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:27:18
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236181/

[7236182] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/force-sync-many workloads/rados_5925}
time:   00:11:19
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236182/

[7236183] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon}
time:   00:28:29
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236183/

[7236184] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized}
time:   00:31:51
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236184/

[7236186] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:12:28
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236186/

[7236188] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
time:   01:37:29
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236188/

[7236190] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/snaps-few-objects}
time:   00:28:10
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236190/

[7236192] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite}
time:   00:16:29
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236192/

[7236194] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed}
time:   00:18:54
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236194/

[7236196] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_20.04} tasks/module_selftest}
time:   00:26:34
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236196/

[7236198] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio}
time:   00:12:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236198/

[7236200] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:15:12
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236200/

[7236202] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:19:38
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236202/

[7236204] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
time:   00:27:34
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236204/

[7236206] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:19:22
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236206/

[7236208] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr}
time:   00:19:29
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236208/

[7236210] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
time:   01:20:33
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236210/

[7236212] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}}
time:   00:24:06
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236212/

[7236214] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big}
time:   00:23:11
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236214/

[7236216] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:14
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236216/

[7236218] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:20
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236218/

[7236220] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:24:08
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236220/

[7236222] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-small}
time:   01:14:20
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236222/

[7236224] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:34:06
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236224/

[7236226] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:24:53
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236226/

[7236228] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:15:25
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236228/

[7236230] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:22:54
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236230/

[7236232] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:21:49
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236232/

[7236234] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps}
time:   00:31:12
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236234/

[7236236] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption}
time:   00:09:49
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236236/

[7236238] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews}
time:   01:12:52
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236238/

[7236240] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep}
time:   01:19:04
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236240/

[7236242] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps-balanced}
time:   00:27:13
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236242/

[7236244] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls}
time:   01:18:13
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236244/

[7236246] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps}
time:   01:22:19
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236246/

[7236248] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:26
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236248/

[7236250] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:18:32
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236250/

[7236252] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}}
time:   01:20:51
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236252/

[7236254] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache}
time:   01:12:07
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236254/

[7236256] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests}
time:   00:29:57
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236256/

[7236258] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench}
time:   00:10:57
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236258/

[7236260] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/dedup-io-mixed}
time:   00:14:04
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236260/

[7236262] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/many workloads/rados_api_tests}
time:   00:36:52
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236262/

[7236263] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/dedup-io-snaps}
time:   00:14:19
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236263/

[7236264] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites}
time:   01:26:41
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236264/

[7236266] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:30:41
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236266/

[7236267] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects}
time:   00:28:07
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236267/

[7236268] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:48
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236268/

[7236269] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rados_api_tests}
time:   00:29:17
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236269/

[7236270] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_20.04} tasks/progress}
time:   00:22:53
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236270/

[7236271] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_20.04}}
time:   00:30:13
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236271/

[7236272] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm}
time:   01:17:16
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236272/

[7236273] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency}
time:   00:26:57
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236273/

[7236274] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:08:46
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236274/

[7236276] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench}
time:   00:54:59
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236276/

[7236279] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect}
time:   00:15:47
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236279/

[7236280] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   01:28:58
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236280/

[7236281] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:16:39
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236281/

[7236282] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:28:12
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236282/

[7236283] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests}
time:   00:14:46
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236283/

[7236284] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}}
time:   00:29:55
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236284/

[7236285] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
time:   00:12:41
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236285/

[7236286] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:30:10
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236286/

[7236287] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_cls_all}
time:   00:19:31
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236287/

[7236288] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_set_object}
time:   01:19:34
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236288/

[7236289] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:15:39
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236289/

[7236290] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:29:59
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236290/

[7236291] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/set-chunks-read}
time:   00:16:53
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236291/

[7236292] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews}
time:   01:10:23
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236292/

[7236293] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind}
time:   01:47:31
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236293/

[7236294] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}}
time:   01:08:25
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236294/

[7236295] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced}
time:   00:24:55
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236295/

[7236296] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-localized}
time:   00:23:01
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236296/

[7236297] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos}
time:   00:23:38
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236297/

[7236298] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/dashboard}
time:   02:09:25
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236298/

[7236300] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:18:39
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236300/

[7236301] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   02:25:30
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236301/

[7236302] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/small-objects}
time:   00:19:43
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236302/

[7236304] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:12
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236304/

[7236305] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced}
time:   01:31:11
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236305/

[7236306] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_osdmap_prune}
time:   00:58:23
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236306/

[7236307] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final}
time:   00:14:40
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236307/

[7236308] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized}
time:   00:29:50
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236308/

[7236309] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:10:05
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236309/

[7236310] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects}
time:   00:32:09
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236310/

[7236311] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:12:39
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236311/

[7236312] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}}
time:   01:11:55
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236312/

[7236313] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/prometheus}
time:   00:13:30
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236313/

[7236314] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed}
time:   01:17:34
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236314/

[7236316] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_python}
time:   00:52:35
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236316/

[7236317] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:25:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236317/

[7236318] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-small-objects-balanced}
time:   00:21:05
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236318/

[7236319] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:40:01
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236319/

[7236320] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/cache-agent-big}
time:   00:16:16
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236320/

[7236321] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   01:08:59
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236321/

[7236322] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon}
time:   01:20:26
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236322/

[7236323] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}}
time:   01:07:59
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236323/

[7236324] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:28:27
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236324/

[7236325] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   01:16:20
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236325/

[7236326] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:28:56
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236326/

[7236327] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/cache-agent-small}
time:   00:13:27
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236327/

[7236328] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   01:35:22
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236328/

[7236329] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}}
time:   02:29:54
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236329/

[7236330] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:15:32
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236330/

[7236331] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps}
time:   00:26:33
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236331/

[7236332] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:18:04
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236332/

[7236333] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
time:   01:25:05
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236333/

[7236334] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:13:53
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236334/

[7236335] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced}
time:   01:23:10
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236335/

[7236336] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_recovery}
time:   00:17:24
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236336/

[7236337] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep}
time:   01:18:01
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236337/

[7236338] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}}
time:   01:32:58
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236338/

[7236339] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps}
time:   00:24:44
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236339/

[7236340] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
time:   00:12:26
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236340/

[7236341] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs}
time:   00:30:39
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236341/

[7236342] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache}
time:   00:16:10
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236342/

[7236343] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:50:47
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236343/

[7236344] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:08:19
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236344/

[7236345] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed}
time:   00:14:23
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236345/

[7236346] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch}
time:   00:21:57
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236346/

[7236347] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_workunits}
time:   00:30:04
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236347/

[7236348] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup-io-snaps}
time:   00:18:25
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236348/

[7236349] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:28:26
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236349/

[7236350] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects}
time:   00:36:39
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236350/

[7236351] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}}
time:   01:08:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236351/

[7236352] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:09:45
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236352/

[7236353] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api}
time:   01:18:02
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236353/

[7236354] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests}
time:   00:43:38
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236354/

[7236355] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{rhel_8} tasks/workunits}
time:   00:13:45
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236355/

[7236356] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:16:57
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236356/

[7236357] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency}
time:   01:37:58
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236357/

[7236358] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read}
time:   00:22:46
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236358/

[7236359] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}}
time:   00:31:44
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236359/

[7236360] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench}
time:   00:48:44
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236360/

[7236361] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:12:48
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236361/

[7236362] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/osd-backfill}
time:   03:28:56
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236362/

[7236363] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect}
time:   00:14:32
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236363/

[7236364] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
time:   01:20:34
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236364/

[7236365] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:12:23
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236365/

[7236366] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli}
time:   00:19:03
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236366/

[7236367] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   01:25:58
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236367/

[7236368] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   01:19:05
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236368/

[7236369] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests}
time:   00:21:09
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236369/

[7236370] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
time:   00:34:30
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236370/

[7236371] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object}
time:   00:15:15
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236371/

[7236372] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   01:28:37
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236372/

[7236373] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:23:12
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236373/

[7236374] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:24:55
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236374/

[7236375] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/set-chunks-read}
time:   00:19:47
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236375/

[7236376] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} tasks/rados_striper}
time:   00:09:40
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236376/

[7236377] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:16
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236377/

[7236379] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews}
time:   00:12:45
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236379/

[7236380] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep}
time:   01:13:17
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236380/

[7236381] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:33
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236381/

[7236382] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/small-objects-localized}
time:   00:20:09
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236382/

[7236383] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:16:17
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236383/

[7236384] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_8}}
time:   01:09:19
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236384/

[7236385] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects}
time:   00:24:30
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236385/

[7236386] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:10:17
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236386/

[7236387] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced}
time:   01:29:56
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236387/

[7236388] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}}
time:   00:12:22
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236388/

[7236389] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/snaps-few-objects}
time:   00:30:59
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236389/

[7236391] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-localized}
time:   01:28:15
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236391/

[7236392] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:12:21
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236392/

[7236393] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects}
time:   01:28:09
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236393/

[7236395] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_8} tasks/crash}
time:   01:13:09
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236395/

[7236397] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:13:13
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236397/

[7236398] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed}
time:   00:17:28
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236398/

[7236399] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:30:19
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236399/

[7236400] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}}
time:   01:13:08
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236400/

[7236401] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:24:14
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236401/

[7236402] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:21:41
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236402/

[7236403] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big}
time:   01:11:22
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236403/

[7236404] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big}
time:   01:19:47
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236404/

[7236405] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps}
time:   01:17:43
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236405/

[7236406] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final}
time:   00:28:30
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236406/

[7236407] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:14:34
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236407/

[7236408] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd}
time:   02:56:13
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236408/

[7236409] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   01:26:25
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236409/

[7236410] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:12:06
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236410/

[7236411] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-small}
time:   01:18:20
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236411/

[7236412] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:37
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236412/

[7236413] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:21:53
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236413/

[7236414] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:11:33
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236414/

[7236415] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps}
time:   00:26:54
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236415/

[7236416] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption}
time:   01:10:31
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236416/

[7236417] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:29
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236417/

[7236418] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced}
time:   00:20:56
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236418/

[7236419] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:10:52
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236419/

[7236420] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:14:55
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236420/

[7236421] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews}
time:   01:10:18
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236421/

[7236422] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind}
time:   01:54:34
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236422/

[7236423] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps}
time:   01:22:22
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236423/

[7236424] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:15:50
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236424/

[7236425] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache}
time:   00:16:00
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236425/

[7236426] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:24:58
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236426/

[7236427] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup-io-mixed}
time:   00:13:47
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236427/

[7236428] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}}
time:   00:18:21
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236428/

[7236429] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:34:03
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236429/

[7236430] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:18:40
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236430/

[7236431] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-snaps}
time:   00:17:17
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236431/

[7236432] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_cephadm}
time:   00:19:55
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236432/

[7236433] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/pool-create-delete}
time:   00:21:33
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236433/

[7236434] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} tasks/rados_workunit_loadgen_mix}
time:   00:21:18
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236434/

[7236435] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects}
time:   01:31:20
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236435/

[7236436] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}}
time:   00:14:52
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236436/

[7236437] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/failover}
time:   01:15:08
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236437/

[7236438] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{centos_8}}
time:   01:12:23
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236438/

[7236439] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests}
time:   00:34:05
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236439/

[7236440] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}}
time:   01:26:35
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236440/

[7236441] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:30:16
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236441/

[7236442] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency}
time:   00:50:01
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236442/

[7236443] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects}
time:   00:25:34
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236443/

[7236444] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench}
time:   00:51:48
info:   http://pulpito.ceph.com/yuriw-2023-04-08_15:50:39-rados-reef-distro-default-smithi/7236444/