2024-03-02T16:01:00.629 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-03-02T16:01:00.629 INFO:teuthology.results:subset: '111/120000'
2024-03-02T16:01:00.629 INFO:teuthology.results:seed: '1067'
2024-03-02T19:32:50.504 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-03-02T19:32:50.527 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2024-03-03T06:55:52.828 INFO:teuthology.results:Tests finished! gathering results...
2024-03-03T06:56:16.475 INFO:scrape:Found 294 jobs
2024-03-03T06:56:25.323 INFO:scrape:Found 8 distinct failure reasons
2024-03-03T06:56:25.323 INFO:scrape:Failure: "2024-03-02T17:00:00.000214+0000 mon.smithi117 (mon.0) 698 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded" in cluster log
2024-03-03T06:56:25.324 INFO:scrape:2 jobs: ['7579629', '7579908']
2024-03-03T06:56:25.324 INFO:scrape:suites intersection: ['0-nvme-loop']
2024-03-03T06:56:25.324 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', 'agent/on', 'fixed-2', 'mon_election/connectivity', 'rados/cephadm/osds/{0-distro/centos_9.stream', 'rados/cephadm/smoke/{0-distro/centos_9.stream', 'start}']
2024-03-03T06:56:25.324 INFO:scrape:
2024-03-03T06:56:25.324 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats'
2024-03-03T06:56:25.324 INFO:scrape:4 jobs: ['7579756', '7579902', '7579709', '7579854']
2024-03-03T06:56:25.324 INFO:scrape:suites intersection: ['rados']
2024-03-03T06:56:25.324 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/ceph-snapmapper', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}']
2024-03-03T06:56:25.324 INFO:scrape:
2024-03-03T06:56:25.324 INFO:scrape:Failure: Command failed on smithi119 with status 5: 'sudo systemctl stop ceph-e557dbec-d8b8-11ee-95c5-87774f69a715@mon.a'
2024-03-03T06:56:25.325 INFO:scrape:1 jobs: ['7579641']
2024-03-03T06:56:25.325 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/ubuntu_22.04', 'task/test_ca_signed_key}']
2024-03-03T06:56:25.325 INFO:scrape:
2024-03-03T06:56:25.325 INFO:scrape:Failure: valgrind error: Leak_StillReachable
operator new[](unsigned long)
UnknownInlinedFun
UnknownInlinedFun
2024-03-03T06:56:25.325 INFO:scrape:6 jobs: ['7579705', '7579767', '7579768', '7579900', '7579833', '7579635']
2024-03-03T06:56:25.325 INFO:scrape:suites intersection: []
2024-03-03T06:56:25.325 INFO:scrape:suites union: ['2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'validater/valgrind}']
2024-03-03T06:56:25.325 INFO:scrape:
2024-03-03T06:56:25.325 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh
2024-03-03T06:56:25.325 INFO:scrape:1 jobs: ['7579645']
2024-03-03T06:56:25.326 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/read', 'mon_election/connectivity', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/rados_api_tests}']
2024-03-03T06:56:25.326 INFO:scrape:
2024-03-03T06:56:25.326 INFO:scrape:Dead: b'2024-03-03T06:25:47.887 DEBUG:teuthology.exit:Finished running handlers'
2024-03-03T06:56:25.326 INFO:scrape:3 jobs: ['7579764', '7579670', '7579818']
2024-03-03T06:56:25.326 INFO:scrape:suites intersection: []
2024-03-03T06:56:25.326 INFO:scrape:suites union: ['0-nvme-loop', 'agent/on', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/cephadm/smoke/{0-distro/centos_9.stream_runc', 'rados/singleton-nomsgr/{all/admin_socket_output', 'start}', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}']
2024-03-03T06:56:25.326 INFO:scrape:
2024-03-03T06:56:25.326 INFO:scrape:Failure: failed to complete snap trimming before timeout
2024-03-03T06:56:25.326 INFO:scrape:2 jobs: ['7579672', '7579820']
2024-03-03T06:56:25.326 INFO:scrape:suites intersection: ['0-start', '1-tasks', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default']
2024-03-03T06:56:25.327 INFO:scrape:suites union: ['0-start', '1-tasks', 'mon_election/classic', 'mon_election/connectivity', 'rados/upgrade/parallel/{0-random-distro$/{centos_9.stream_runc}', 'rados/upgrade/parallel/{0-random-distro$/{ubuntu_22.04}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default']
2024-03-03T06:56:25.327 INFO:scrape:
2024-03-03T06:56:25.327 INFO:scrape:Failure: Command failed (workunit test scrub/osd-scrub-repair.sh) on smithi006 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a96b1c0427a378792255b04333efc5a5569fd416 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh'
2024-03-03T06:56:25.327 INFO:scrape:1 jobs: ['7579640']
2024-03-03T06:56:25.327 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{centos_latest}', 'workloads/scrub}']
2024-03-03T06:56:25.327 INFO:scrape:
2024-03-03T06:56:25.337 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/
failed:  17
dead:    3
running: 0
waiting: 0
queued:  0
passed:  274


Fail
=================================================================
[7579629]  rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add}
-----------------------------------------------------------------
time:   00:22:12
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579629/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579629/

    "2024-03-02T17:00:00.000214+0000 mon.smithi117 (mon.0) 698 : cluster 3
    [WRN] PG_DEGRADED: Degraded data redundancy: 2/6 objects degraded
    (33.333%), 1 pg degraded" in cluster log

[7579635]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind}
-----------------------------------------------------------------
time:   00:24:56
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579635/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579635/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6f08f655c3e841828957de5d0f3ee8f5

    valgrind error: Leak_StillReachable operator new[](unsigned long)
    UnknownInlinedFun UnknownInlinedFun

[7579640]  rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub}
-----------------------------------------------------------------
time:   01:34:38
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579640/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579640/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fcc1592e6cd54b5b95a409fecfa6dd7a

    Command failed (workunit test scrub/osd-scrub-repair.sh) on smithi006 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=a96b1c0427a378792255b04333efc5a5569fd416
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-
    repair.sh'

[7579641]  rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_ca_signed_key}
-----------------------------------------------------------------
time:   00:11:09
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579641/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579641/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c9362703c41f405191035cff472fcadf

    Command failed on smithi119 with status 5: 'sudo systemctl stop
    ceph-e557dbec-d8b8-11ee-95c5-87774f69a715@mon.a'

[7579645]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests}
-----------------------------------------------------------------
time:   03:37:08
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579645/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579645/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a2d3a3a6217840468ca085e9e62ca5e9

    Command failed (workunit test rados/test.sh) on smithi169 with status 124:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=a96b1c0427a378792255b04333efc5a5569fd416
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

[7579672]  rados/upgrade/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
-----------------------------------------------------------------
time:   00:50:59
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579672/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579672/
sentry: https://sentry.ceph.com/organizations/ceph/?query=95f916b7d1a9487d9f9cc04eff360982

    failed to complete snap trimming before timeout

[7579705]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}
-----------------------------------------------------------------
time:   01:04:59
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579705/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579705/

    valgrind error: Leak_StillReachable operator new[](unsigned long)
    UnknownInlinedFun UnknownInlinedFun

[7579709]  rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{centos_latest}}
-----------------------------------------------------------------
time:   00:08:04
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579709/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579709/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3022b168bd994d17821a36531d6783cf

    Command failed on smithi082 with status 1: 'sudo
    TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_snap_mapper'

[7579756]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_latest}}
-----------------------------------------------------------------
time:   00:07:35
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579756/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579756/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bc5e5d06067347609832b41733c0a029

    Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c
    ceph_test_lazy_omap_stats'

[7579767]  rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
-----------------------------------------------------------------
time:   00:21:22
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579767/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579767/

    valgrind error: Leak_StillReachable operator new[](unsigned long)
    UnknownInlinedFun UnknownInlinedFun

[7579768]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}
-----------------------------------------------------------------
time:   00:46:35
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579768/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579768/

    valgrind error: Leak_StillReachable operator new[](unsigned long)
    UnknownInlinedFun UnknownInlinedFun

[7579820]  rados/upgrade/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
-----------------------------------------------------------------
time:   00:40:49
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579820/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579820/
sentry: https://sentry.ceph.com/organizations/ceph/?query=edf48b8b3d6e4a8d9b9a03247327c14c

    failed to complete snap trimming before timeout

[7579833]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}
-----------------------------------------------------------------
time:   01:50:11
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579833/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579833/

    valgrind error: Leak_StillReachable operator new[](unsigned long)
    UnknownInlinedFun UnknownInlinedFun

[7579854]  rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:10:10
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579854/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579854/
sentry: https://sentry.ceph.com/organizations/ceph/?query=edb9c18c52604fcca04008d68f5640cf

    Command failed on smithi110 with status 1: 'sudo
    TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_snap_mapper'

[7579900]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind}
-----------------------------------------------------------------
time:   01:03:09
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579900/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579900/

    valgrind error: Leak_StillReachable operator new[](unsigned long)
    UnknownInlinedFun UnknownInlinedFun

[7579902]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:09:50
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579902/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579902/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ebc68d898c974fa5ae9bd789a68bfdae

    Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c
    ceph_test_lazy_omap_stats'

[7579908]  rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:15:16
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579908/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579908/

    "2024-03-02T19:50:00.000150+0000 mon.a (mon.0) 474 : cluster 3 [WRN]
    POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in
    cluster log



Dead
=================================================================
[7579670]  rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_latest}}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579670/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579670/

    hit max job timeout

[7579764]  rados/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579764/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579764/

    hit max job timeout

[7579818]  rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579818/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579818/

    hit max job timeout



Pass
=================================================================
[7579620] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache}
time:   00:18:19
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579620/

[7579621] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_recovery}
time:   00:11:58
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579621/

[7579622] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:27:02
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579622/

[7579623] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:22
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579623/

[7579624] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed}
time:   00:12:24
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579624/

[7579625] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:47
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579625/

[7579626] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{centos_latest}}
time:   00:16:13
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579626/

[7579627] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects}
time:   00:22:30
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579627/

[7579628] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api}
time:   00:23:57
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579628/

[7579630] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:18
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579630/

[7579631] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps}
time:   00:11:23
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579631/

[7579632] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:25:03
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579632/

[7579633] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:15:06
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579633/

[7579634] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite}
time:   00:15:43
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579634/

[7579636] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:13:34
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579636/

[7579637] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects}
time:   00:26:22
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579637/

[7579638] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:20:13
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579638/

[7579639] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:12:12
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579639/

[7579642] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_latest} tasks/workunits}
time:   00:09:15
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579642/

[7579643] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:40:32
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579643/

[7579644] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:40:36
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579644/

[7579646] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:32
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579646/

[7579647] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits}
time:   00:31:46
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579647/

[7579648] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:07:21
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579648/

[7579649] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency}
time:   00:43:35
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579649/

[7579650] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:10:19
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579650/

[7579651] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:27:01
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579651/

[7579652] rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm}
time:   00:14:07
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579652/

[7579653] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:26:19
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579653/

[7579654] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:32:25
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579654/

[7579655] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/radosbench}
time:   01:08:45
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579655/

[7579656] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:13:19
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579656/

[7579657] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/rados_api_tests}
time:   00:25:23
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579657/

[7579658] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:41:20
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579658/

[7579659] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:09:01
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579659/

[7579660] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:33:08
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579660/

[7579661] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect}
time:   00:17:07
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579661/

[7579662] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:06
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579662/

[7579663] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:30:36
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579663/

[7579664] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps}
time:   00:41:17
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579664/

[7579665] rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:13:53
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579665/

[7579666] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard}
time:   01:10:44
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579666/

[7579667] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/crash}
time:   00:12:51
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579667/

[7579668] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}}
time:   00:40:16
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579668/

[7579669] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}}
time:   00:12:20
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579669/

[7579671] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c}
time:   00:15:06
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579671/

[7579673] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
time:   00:19:04
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579673/

[7579674] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep}
time:   00:11:53
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579674/

[7579675] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests}
time:   00:16:34
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579675/

[7579676] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:12:02
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579676/

[7579677] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:15:29
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579677/

[7579678] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_set_object}
time:   00:13:47
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579678/

[7579679] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:09:15
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579679/

[7579680] rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:14:08
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579680/

[7579681] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:13:57
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579681/

[7579682] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects}
time:   00:37:53
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579682/

[7579683] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:52
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579683/

[7579684] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all}
time:   00:21:30
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579684/

[7579685] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read}
time:   00:13:46
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579685/

[7579686] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews}
time:   00:10:10
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579686/

[7579687] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:14:37
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579687/

[7579688] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:08:54
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579688/

[7579689] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:22:32
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579689/

[7579690] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:14:39
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579690/

[7579691] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced}
time:   00:32:48
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579691/

[7579692] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final}
time:   00:11:26
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579692/

[7579693] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:09
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579693/

[7579694] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
time:   00:27:06
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579694/

[7579695] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-localized}
time:   00:21:58
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579695/

[7579696] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:01
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579696/

[7579697] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:25:45
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579697/

[7579698] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/failover}
time:   00:12:53
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579698/

[7579699] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush}
time:   00:28:19
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579699/

[7579700] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
time:   00:14:08
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579700/

[7579701] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:11:52
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579701/

[7579702] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm_repos}
time:   00:05:53
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579702/

[7579703] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects}
time:   00:23:05
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579703/

[7579704] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench}
time:   01:30:49
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579704/

[7579706] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python}
time:   00:17:21
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579706/

[7579707] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:28
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579707/

[7579708] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:14
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579708/

[7579710] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:27:08
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579710/

[7579711] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:14:11
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579711/

[7579712] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}}
time:   00:09:46
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579712/

[7579713] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete}
time:   00:19:50
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579713/

[7579714] rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:18:55
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579714/

[7579715] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-localized}
time:   00:27:49
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579715/

[7579716] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:08:56
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579716/

[7579717] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:25:56
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579717/

[7579718] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:27:18
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579718/

[7579719] rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:15:39
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579719/

[7579720] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
time:   00:14:00
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579720/

[7579721] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects}
time:   00:28:20
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579721/

[7579722] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:07:30
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579722/

[7579723] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/insights}
time:   00:13:48
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579723/

[7579724] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch}
time:   00:21:15
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579724/

[7579725] rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_extra_daemon_features}
time:   00:19:33
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579725/

[7579726] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
time:   00:25:18
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579726/

[7579727] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
time:   00:14:25
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579727/

[7579728] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:20:25
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579728/

[7579729] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed}
time:   00:14:16
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579729/

[7579730] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code}
time:   01:34:39
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579730/

[7579731] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:24:01
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579731/

[7579732] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:09:30
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579732/

[7579733] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:30:21
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579733/

[7579734] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:40:47
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579734/

[7579735] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:22:22
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579735/

[7579736] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}
time:   00:21:19
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579736/

[7579737] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:11
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579737/

[7579738] rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:14:56
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579738/

[7579739] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls}
time:   00:31:48
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579739/

[7579740] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:09:29
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579740/

[7579741] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
time:   00:14:17
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579741/

[7579742] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big}
time:   00:17:26
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579742/

[7579743] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:14:43
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579743/

[7579744] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} tasks/e2e}
time:   00:22:56
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579744/

[7579745] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_5925}
time:   00:10:10
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579745/

[7579746] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small}
time:   00:18:36
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579746/

[7579747] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:08:45
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579747/

[7579748] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/rados_striper}
time:   00:07:55
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579748/

[7579749] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:36
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579749/

[7579750] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews}
time:   00:08:04
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579750/

[7579751] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:26:09
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579751/

[7579752] rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain}
time:   00:21:35
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579752/

[7579753] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/module_selftest}
time:   00:26:07
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579753/

[7579754] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:20:50
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579754/

[7579755] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}}
time:   00:16:08
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579755/

[7579757] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mgr}
time:   00:16:40
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579757/

[7579758] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:20:49
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579758/

[7579759] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-radosbench}
time:   01:33:46
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579759/

[7579760] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps}
time:   00:19:41
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579760/

[7579761] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write}
time:   00:12:09
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579761/

[7579762] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:25:18
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579762/

[7579763] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:31
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579763/

[7579765] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:17:58
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579765/

[7579766] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced}
time:   00:25:46
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579766/

[7579769] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:30:03
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579769/

[7579770] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:48
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579770/

[7579771] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:24
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579771/

[7579772] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_big}
time:   00:28:55
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579772/

[7579773] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps}
time:   00:29:03
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579773/

[7579774] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:40
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579774/

[7579775] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}}
time:   00:15:55
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579775/

[7579776] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects}
time:   00:36:01
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579776/

[7579777] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:17:56
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579777/

[7579778] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests}
time:   00:49:10
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579778/

[7579779] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache}
time:   00:24:23
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579779/

[7579780] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/per_module_finisher_stats}
time:   00:12:46
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579780/

[7579781] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write}
time:   00:23:40
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579781/

[7579782] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:11
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579782/

[7579783] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews}
time:   00:10:31
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579783/

[7579784] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:14:06
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579784/

[7579785] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-mixed}
time:   00:14:49
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579785/

[7579786] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:21:56
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579786/

[7579787] rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:13:04
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579787/

[7579788] rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc}
time:   01:05:20
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579788/

[7579789] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:34:42
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579789/

[7579790] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/dedup-io-snaps}
time:   00:13:47
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579790/

[7579791] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced}
time:   00:22:43
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579791/

[7579792] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:03
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579792/

[7579793] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:08:44
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579793/

[7579794] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mix}
time:   00:19:10
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579794/

[7579795] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_latest}}
time:   00:23:42
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579795/

[7579796] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:15:09
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579796/

[7579797] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects}
time:   00:29:39
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579797/

[7579798] rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic}
time:   00:25:37
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579798/

[7579799] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}
time:   00:33:14
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579799/

[7579800] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:00
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579800/

[7579801] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:15:42
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579801/

[7579802] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio}
time:   00:14:20
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579802/

[7579803] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}}
time:   00:14:38
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579803/

[7579804] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/rados_api_tests}
time:   00:28:03
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579804/

[7579805] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:30:28
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579805/

[7579806] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_latest} tasks/progress}
time:   00:19:27
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579806/

[7579807] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:00
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579807/

[7579808] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:19:44
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579808/

[7579809] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency}
time:   00:55:29
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579809/

[7579810] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_osdmap_prune}
time:   00:51:47
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579810/

[7579811] rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:19:21
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579811/

[7579812] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
time:   00:34:45
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579812/

[7579813] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:08:51
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579813/

[7579814] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/mon_recovery}
time:   00:15:21
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579814/

[7579815] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:24:22
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579815/

[7579816] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread}
time:   00:33:26
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579816/

[7579817] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/dashboard}
time:   01:12:17
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579817/

[7579819] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon-stretch}
time:   00:26:44
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579819/

[7579821] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/radosbench}
time:   01:08:43
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579821/

[7579822] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:04
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579822/

[7579823] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench}
time:   00:12:19
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579823/

[7579824] rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite}
time:   00:13:47
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579824/

[7579825] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect}
time:   00:18:39
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579825/

[7579826] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:27
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579826/

[7579827] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read}
time:   00:20:23
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579827/

[7579828] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:33:00
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579828/

[7579829] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:54
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579829/

[7579830] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests}
time:   00:10:53
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579830/

[7579831] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:09:09
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579831/

[7579832] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:30
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579832/

[7579834] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/prometheus}
time:   00:13:06
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579834/

[7579835] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   02:24:34
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579835/

[7579836] rados/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:24:41
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579836/

[7579837] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object}
time:   00:14:31
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579837/

[7579838] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_latest}}
time:   02:12:37
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579838/

[7579839] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/readwrite}
time:   00:15:06
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579839/

[7579840] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:05
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579840/

[7579841] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
time:   00:14:31
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579841/

[7579842] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/set-chunks-read}
time:   00:18:46
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579842/

[7579843] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:45:59
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579843/

[7579844] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits}
time:   00:31:45
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579844/

[7579845] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon}
time:   01:00:50
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579845/

[7579846] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final}
time:   00:20:08
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579846/

[7579847] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:11
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579847/

[7579848] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews}
time:   00:16:42
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579848/

[7579849] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:27:47
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579849/

[7579850] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps}
time:   00:34:34
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579850/

[7579851] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-balanced}
time:   00:23:44
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579851/

[7579852] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
time:   00:26:30
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579852/

[7579853] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:19:35
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579853/

[7579855] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/small-objects-localized}
time:   00:22:27
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579855/

[7579856] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:22:56
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579856/

[7579857] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:43:17
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579857/

[7579858] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:21:56
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579858/

[7579859] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations}
time:   00:15:41
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579859/

[7579860] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/repair_test}
time:   00:18:48
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579860/

[7579861] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/small-objects}
time:   00:24:42
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579861/

[7579862] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:14:43
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579862/

[7579863] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/workunits}
time:   00:11:13
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579863/

[7579864] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:01
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579864/

[7579865] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:44
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579865/

[7579866] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
time:   00:17:02
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579866/

[7579867] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep}
time:   00:11:42
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579867/

[7579868] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:38
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579868/

[7579869] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:23:19
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579869/

[7579870] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:07
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579870/

[7579871] rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:13:31
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579871/

[7579872] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:16:14
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579872/

[7579873] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized}
time:   00:28:42
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579873/

[7579874] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill}
time:   02:35:27
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579874/

[7579875] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:33:43
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579875/

[7579876] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete}
time:   00:19:23
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579876/

[7579877] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:27
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579877/

[7579878] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_latest}}
time:   00:06:44
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579878/

[7579879] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews}
time:   00:09:29
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579879/

[7579880] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:13:47
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579880/

[7579881] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects}
time:   00:29:10
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579881/

[7579882] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:18:45
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579882/

[7579883] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
time:   00:12:45
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579883/

[7579884] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/scrub_test}
time:   00:11:36
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579884/

[7579885] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key}
time:   00:19:57
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579885/

[7579886] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench}
time:   01:22:19
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579886/

[7579887] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:57
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579887/

[7579888] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed}
time:   00:13:45
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579888/

[7579889] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:30
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579889/

[7579890] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:14
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579890/

[7579891] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects}
time:   00:19:21
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579891/

[7579892] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} tasks/e2e}
time:   00:22:44
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579892/

[7579893] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/crash}
time:   00:13:01
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579893/

[7579894] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites}
time:   00:46:33
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579894/

[7579895] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:12:18
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579895/

[7579896] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:44
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579896/

[7579897] rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:20:32
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579897/

[7579898] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:20
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579898/

[7579899] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:44
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579899/

[7579901] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big}
time:   00:38:39
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579901/

[7579903] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:13:14
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579903/

[7579904] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}}
time:   00:09:17
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579904/

[7579905] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd}
time:   02:31:04
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579905/

[7579906] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite}
time:   00:15:40
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579906/

[7579907] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-agent-small}
time:   00:12:39
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579907/

[7579909] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925}
time:   00:12:41
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579909/

[7579910] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:16
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579910/

[7579911] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:45
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579911/

[7579912] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:22:38
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579912/

[7579913] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_recovery}
time:   00:13:38
info:   https://pulpito.ceph.com/yuriw-2024-03-02_15:59:16-rados-wip-yuri2-testing-2024-03-01-1606-distro-default-smithi/7579913/