2024-01-27T09:56:24.311 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-27T09:56:24.312 INFO:teuthology.results:subset: '111/120000'
2024-01-27T09:56:24.312 INFO:teuthology.results:seed: '3631'
2024-01-27T12:47:22.504 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-27T12:47:22.537 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2024-01-28T00:02:23.761 INFO:teuthology.results:Tests finished! gathering results...
2024-01-28T00:02:47.836 INFO:scrape:Found 317 jobs
2024-01-28T00:02:52.508 INFO:scrape:Found 7 distinct failure reasons
2024-01-28T00:02:52.509 INFO:scrape:Dead: b'2024-01-27T23:58:11.246 DEBUG:teuthology.exit:Finished running handlers'
2024-01-28T00:02:52.509 INFO:scrape:2 jobs: ['7534291', '7534132']
2024-01-28T00:02:52.509 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/admin_socket_output']
2024-01-28T00:02:52.509 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}']
2024-01-28T00:02:52.509 INFO:scrape:
2024-01-28T00:02:52.509 INFO:scrape:Failure: valgrind error: Leak_StillReachable
operator new[](unsigned long)
UnknownInlinedFun
UnknownInlinedFun
2024-01-28T00:02:52.509 INFO:scrape:6 jobs: ['7534094', '7534168', '7534236', '7534235', '7534307', '7534380']
2024-01-28T00:02:52.509 INFO:scrape:suites intersection: []
2024-01-28T00:02:52.509 INFO:scrape:suites union: ['2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'validater/valgrind}']
2024-01-28T00:02:52.510 INFO:scrape:
2024-01-28T00:02:52.510 INFO:scrape:Failure: No module named 'tasks'
2024-01-28T00:02:52.510 INFO:scrape:4 jobs: ['7534302', '7534303', '7534305', '7534301']
2024-01-28T00:02:52.510 INFO:scrape:suites intersection: []
2024-01-28T00:02:52.510 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/rmdir-reactivate}', 'ceph', 'clusters/{fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/many', 'msgr-failures/osd-dispatch-delay', 'msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun', 'rados/singleton-nomsgr/{all/cache-fs-trunc', 'rados/singleton/{all/test-noautoscale-flag', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'recovery-overrides/{more-async-recovery}', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'thrashers/careful', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}']
2024-01-28T00:02:52.510 INFO:scrape:
2024-01-28T00:02:52.510 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats'
2024-01-28T00:02:52.510 INFO:scrape:2 jobs: ['7534224', '7534381']
2024-01-28T00:02:52.510 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output']
2024-01-28T00:02:52.510 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}']
2024-01-28T00:02:52.511 INFO:scrape:
2024-01-28T00:02:52.511 INFO:scrape:Failure: reached maximum tries (51) after waiting for 300 seconds
2024-01-28T00:02:52.511 INFO:scrape:1 jobs: ['7534135']
2024-01-28T00:02:52.511 INFO:scrape:suites: ['2-inject-leak/mon', 'centos_latest}', 'rados/valgrind-leaks/{1-start']
2024-01-28T00:02:52.511 INFO:scrape:
2024-01-28T00:02:52.511 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm_timeout.py) on smithi100 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99a21c3b6c137f933ecc0074a260e59bd4ba2a7f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm_timeout.py'
2024-01-28T00:02:52.511 INFO:scrape:1 jobs: ['7534233']
2024-01-28T00:02:52.511 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm_timeout}']
2024-01-28T00:02:52.511 INFO:scrape:
2024-01-28T00:02:52.511 INFO:scrape:Failure: Command failed (workunit test scrub/osd-scrub-test.sh) on smithi115 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99a21c3b6c137f933ecc0074a260e59bd4ba2a7f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh'
2024-01-28T00:02:52.512 INFO:scrape:1 jobs: ['7534099']
2024-01-28T00:02:52.512 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{centos_latest}', 'workloads/scrub}']
2024-01-28T00:02:52.512 INFO:scrape:
2024-01-28T00:02:52.523 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/
failed:  15
dead:    2
running: 0
waiting: 0
queued:  0
passed:  300


Fail
=================================================================
[7534094]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind}
-----------------------------------------------------------------
time:   01:41:42
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534094/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534094/

    valgrind error: Leak_StillReachable operator new[](unsigned long)
    UnknownInlinedFun UnknownInlinedFun

[7534099]  rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub}
-----------------------------------------------------------------
time:   02:03:32
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534099/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534099/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cece33641fba4809867dcfc26628673b

    Command failed (workunit test scrub/osd-scrub-test.sh) on smithi115 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=99a21c3b6c137f933ecc0074a260e59bd4ba2a7f
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh'

[7534135]  rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
-----------------------------------------------------------------
time:   00:23:10
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534135/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534135/

    reached maximum tries (51) after waiting for 300 seconds

[7534168]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}
-----------------------------------------------------------------
time:   00:59:27
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534168/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534168/

    valgrind error: Leak_StillReachable operator new[](unsigned long)
    UnknownInlinedFun UnknownInlinedFun

[7534224]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:10:04
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534224/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534224/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d9fb2a09146e488da3294472e163c4a2

    Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c
    ceph_test_lazy_omap_stats'

[7534233]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_timeout}
-----------------------------------------------------------------
time:   00:15:06
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534233/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534233/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4aca2824d97848d4b431a984f03d3af9

    Command failed (workunit test cephadm/test_cephadm_timeout.py) on smithi100
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=99a21c3b6c137f933ecc0074a260e59bd4ba2a7f
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_cephadm_timeout.py'

[7534235]  rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
-----------------------------------------------------------------
time:   00:18:44
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534235/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534235/

    valgrind error: Leak_StillReachable operator new[](unsigned long)
    UnknownInlinedFun UnknownInlinedFun

[7534236]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}
-----------------------------------------------------------------
time:   00:28:05
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534236/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534236/

    valgrind error: Leak_StillReachable operator new[](unsigned long)
    UnknownInlinedFun UnknownInlinedFun

[7534301]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:08:51
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534301/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534301/
sentry: https://sentry.ceph.com/organizations/ceph/?query=40100544efc9440ea4f4e92092998413

    No module named 'tasks'

[7534302]  rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:08:45
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534302/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534302/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8e2901ed252a4fd9af639830b5796756

    No module named 'tasks'

[7534303]  rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
-----------------------------------------------------------------
time:   00:06:11
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534303/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534303/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0685972529104ccfa27a5ce7fb06265e

    No module named 'tasks'

[7534305]  rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_latest}}
-----------------------------------------------------------------
time:   00:06:20
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534305/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534305/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b7198c3abb7746f4ab3fb7fc0b840b9f

    No module named 'tasks'

[7534307]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}
-----------------------------------------------------------------
time:   01:47:28
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534307/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534307/

    valgrind error: Leak_StillReachable operator new[](unsigned long)
    UnknownInlinedFun UnknownInlinedFun

[7534380]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind}
-----------------------------------------------------------------
time:   00:55:42
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534380/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534380/

    valgrind error: Leak_StillReachable operator new[](unsigned long)
    UnknownInlinedFun UnknownInlinedFun

[7534381]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_latest}}
-----------------------------------------------------------------
time:   00:07:13
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534381/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534381/
sentry: https://sentry.ceph.com/organizations/ceph/?query=48da000c8acc4344b481a10b02a41e5a

    Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c
    ceph_test_lazy_omap_stats'



Dead
=================================================================
[7534132]  rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_latest}}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534132/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534132/

    hit max job timeout

[7534291]  rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534291/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534291/

    hit max job timeout



Pass
=================================================================
[7534092] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:15:35
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534092/

[7534093] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/libcephsqlite}
time:   00:11:45
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534093/

[7534095] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_extra_daemon_features}
time:   00:23:21
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534095/

[7534096] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:13:14
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534096/

[7534097] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:37
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534097/

[7534098] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:02
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534098/

[7534100] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/workunits}
time:   00:11:34
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534100/

[7534101] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:43:10
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534101/

[7534102] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed}
time:   00:10:41
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534102/

[7534103] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:18:09
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534103/

[7534104] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:23:33
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534104/

[7534105] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:08:45
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534105/

[7534106] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_host_drain}
time:   00:21:47
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534106/

[7534107] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits}
time:   00:30:48
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534107/

[7534108] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:07:03
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534108/

[7534109] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup-io-snaps}
time:   00:16:44
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534109/

[7534110] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews}
time:   00:07:33
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534110/

[7534111] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:27:43
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534111/

[7534112] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:23:03
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534112/

[7534113] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:37
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534113/

[7534114] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:32:45
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534114/

[7534115] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:14:28
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534115/

[7534116] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:12:54
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534116/

[7534117] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests}
time:   00:45:42
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534117/

[7534118] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects}
time:   00:25:47
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534118/

[7534119] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:23:04
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534119/

[7534120] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:09:07
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534120/

[7534121] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:12:57
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534121/

[7534122] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:33:36
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534122/

[7534123] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:20
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534123/

[7534124] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:30:03
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534124/

[7534125] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps}
time:   00:29:24
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534125/

[7534126] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_monitoring_stack_basic}
time:   00:20:14
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534126/

[7534127] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests}
time:   00:45:51
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534127/

[7534128] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} tasks/dashboard}
time:   01:21:50
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534128/

[7534129] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/crash}
time:   00:12:24
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534129/

[7534130] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}}
time:   00:39:38
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534130/

[7534131] rados/rest/{mgr-restful supported-random-distro$/{centos_latest}}
time:   00:09:43
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534131/

[7534133] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c}
time:   00:15:03
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534133/

[7534134] rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   01:58:23
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534134/

[7534136] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep}
time:   00:11:59
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534136/

[7534137] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:06
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534137/

[7534138] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:06
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534138/

[7534139] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:13:28
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534139/

[7534140] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency}
time:   00:42:38
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534140/

[7534141] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:28
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534141/

[7534142] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final}
time:   00:11:13
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534142/

[7534143] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:14:06
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534143/

[7534144] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects}
time:   00:35:00
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534144/

[7534145] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:37
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534145/

[7534146] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/rados_cls_all}
time:   00:15:31
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534146/

[7534147] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_orch_cli}
time:   00:23:51
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534147/

[7534148] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews}
time:   00:07:26
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534148/

[7534149] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:10:33
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534149/

[7534150] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:49
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534150/

[7534151] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench}
time:   00:26:24
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534151/

[7534152] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:19:50
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534152/

[7534153] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:12:55
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534153/

[7534154] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:12:34
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534154/

[7534155] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:08:22
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534155/

[7534156] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli_mon}
time:   00:32:03
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534156/

[7534157] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect}
time:   00:13:45
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534157/

[7534158] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
time:   00:29:11
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534158/

[7534159] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:35
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534159/

[7534160] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:29:00
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534160/

[7534161] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/failover}
time:   00:15:02
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534161/

[7534162] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:13:46
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534162/

[7534163] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush}
time:   00:22:51
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534163/

[7534164] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
time:   00:13:12
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534164/

[7534165] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:07:17
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534165/

[7534166] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests}
time:   00:16:38
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534166/

[7534167] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench}
time:   01:14:14
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534167/

[7534169] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_rgw_multisite}
time:   00:19:01
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534169/

[7534170] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/rados_python}
time:   00:13:39
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534170/

[7534171] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:09:48
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534171/

[7534172] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:32
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534172/

[7534173] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_set_mon_crush_locations}
time:   00:16:59
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534173/

[7534174] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:09:55
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534174/

[7534175] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/redirect_set_object}
time:   00:12:55
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534175/

[7534176] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:16:33
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534176/

[7534177] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}}
time:   00:09:47
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534177/

[7534178] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:20:02
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534178/

[7534179] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete}
time:   00:17:33
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534179/

[7534180] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:09:17
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534180/

[7534181] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/mon_recovery}
time:   00:23:14
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534181/

[7534182] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:24:49
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534182/

[7534183] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption}
time:   00:11:36
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534183/

[7534184] rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}}
time:   00:13:04
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534184/

[7534185] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read}
time:   00:17:55
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534185/

[7534186] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
time:   00:13:45
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534186/

[7534187] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:20:51
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534187/

[7534188] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:09:43
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534188/

[7534189] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/insights}
time:   00:13:35
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534189/

[7534190] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch}
time:   00:21:08
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534190/

[7534191] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
time:   00:22:54
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534191/

[7534192] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:18:53
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534192/

[7534193] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:20:00
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534193/

[7534194] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced}
time:   00:21:48
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534194/

[7534195] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_ca_signed_key}
time:   00:23:23
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534195/

[7534196] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code}
time:   01:28:37
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534196/

[7534197] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:23:55
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534197/

[7534198] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:22
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534198/

[7534199] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:18:27
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534199/

[7534200] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:30:47
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534200/

[7534201] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:22:47
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534201/

[7534202] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}
time:   00:16:42
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534202/

[7534203] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-localized}
time:   00:21:05
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534203/

[7534204] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:07
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534204/

[7534205] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm}
time:   00:23:03
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534205/

[7534206] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls}
time:   00:20:01
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534206/

[7534207] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:05
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534207/

[7534208] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
time:   00:14:12
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534208/

[7534209] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}}
time:   00:11:25
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534209/

[7534210] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:18:18
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534210/

[7534211] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/e2e}
time:   00:24:14
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534211/

[7534212] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects}
time:   00:22:02
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534212/

[7534213] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925}
time:   00:12:24
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534213/

[7534214] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:49
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534214/

[7534215] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos}
time:   00:07:12
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534215/

[7534216] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/rados_striper}
time:   00:07:39
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534216/

[7534217] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:07:57
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534217/

[7534218] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:09:42
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534218/

[7534219] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:27:14
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534219/

[7534220] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/module_selftest}
time:   00:25:43
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534220/

[7534221] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final}
time:   00:12:10
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534221/

[7534222] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:31:16
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534222/

[7534223] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}}
time:   00:15:33
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534223/

[7534225] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mgr}
time:   00:14:23
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534225/

[7534226] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:15:52
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534226/

[7534227] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:16:30
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534227/

[7534228] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench}
time:   01:42:39
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534228/

[7534229] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write}
time:   00:12:22
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534229/

[7534230] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:25:13
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534230/

[7534231] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized}
time:   00:24:13
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534231/

[7534232] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:04
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534232/

[7534234] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:17:39
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534234/

[7534237] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:23:55
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534237/

[7534238] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:32:03
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534238/

[7534239] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:39
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534239/

[7534240] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:19:45
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534240/

[7534241] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects}
time:   00:27:12
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534241/

[7534242] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big}
time:   00:32:52
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534242/

[7534243] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_extra_daemon_features}
time:   00:14:43
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534243/

[7534244] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:06
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534244/

[7534245] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects}
time:   00:32:26
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534245/

[7534246] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:26
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534246/

[7534247] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_host_drain}
time:   00:23:53
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534247/

[7534248] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests}
time:   00:29:10
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534248/

[7534249] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed}
time:   00:13:44
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534249/

[7534250] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/per_module_finisher_stats}
time:   00:11:02
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534250/

[7534251] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write}
time:   00:22:32
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534251/

[7534252] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}}
time:   00:17:04
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534252/

[7534253] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews}
time:   00:07:22
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534253/

[7534254] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:10:26
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534254/

[7534255] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:18:35
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534255/

[7534256] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:10
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534256/

[7534257] rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc}
time:   01:03:45
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534257/

[7534258] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:13:12
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534258/

[7534259] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:13:35
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534259/

[7534260] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
time:   00:32:09
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534260/

[7534261] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced}
time:   00:19:01
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534261/

[7534262] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:25:38
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534262/

[7534263] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:14:03
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534263/

[7534264] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:07:52
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534264/

[7534265] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix}
time:   00:22:55
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534265/

[7534266] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_latest}}
time:   00:23:10
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534266/

[7534267] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big}
time:   00:17:59
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534267/

[7534268] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:12:39
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534268/

[7534269] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic}
time:   00:24:18
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534269/

[7534270] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}
time:   00:24:44
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534270/

[7534271] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:31
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534271/

[7534272] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:10:39
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534272/

[7534273] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio}
time:   00:14:04
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534273/

[7534274] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:12:43
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534274/

[7534275] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}}
time:   00:15:17
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534275/

[7534276] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-agent-small}
time:   00:11:19
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534276/

[7534277] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:30:31
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534277/

[7534278] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/progress}
time:   00:21:29
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534278/

[7534279] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:13:09
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534279/

[7534280] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:08:50
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534280/

[7534281] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:19:26
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534281/

[7534282] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_osdmap_prune}
time:   00:53:04
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534282/

[7534283] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
time:   00:19:04
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534283/

[7534284] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:08:16
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534284/

[7534285] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:25:54
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534285/

[7534286] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli}
time:   00:16:24
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534286/

[7534287] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:17:16
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534287/

[7534288] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:24:44
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534288/

[7534289] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread}
time:   00:25:55
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534289/

[7534290] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/dashboard}
time:   01:22:23
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534290/

[7534292] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon-stretch}
time:   00:25:21
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534292/

[7534293] rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   01:58:08
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534293/

[7534294] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli_mon}
time:   00:22:49
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534294/

[7534295] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:10:00
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534295/

[7534296] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps}
time:   00:25:39
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534296/

[7534297] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench}
time:   00:12:15
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534297/

[7534298] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final}
time:   00:17:11
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534298/

[7534299] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:09:27
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534299/

[7534300] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read}
time:   00:19:17
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534300/

[7534304] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced}
time:   00:21:43
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534304/

[7534306] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:17
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534306/

[7534308] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:19:31
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534308/

[7534309] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/prometheus}
time:   00:13:18
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534309/

[7534310] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   01:56:18
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534310/

[7534311] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}}
time:   02:30:46
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534311/

[7534312] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_rgw_multisite}
time:   00:22:15
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534312/

[7534313] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-snaps}
time:   00:17:49
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534313/

[7534314] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/readwrite}
time:   00:10:49
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534314/

[7534315] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:39
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534315/

[7534316] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
time:   00:14:37
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534316/

[7534317] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:46:59
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534317/

[7534318] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_set_mon_crush_locations}
time:   00:25:03
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534318/

[7534319] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/one workloads/rados_mon_workunits}
time:   00:28:39
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534319/

[7534320] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon}
time:   01:09:33
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534320/

[7534321] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache}
time:   00:10:42
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534321/

[7534322] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:09:38
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534322/

[7534323] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews}
time:   00:07:41
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534323/

[7534324] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:24:31
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534324/

[7534325] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps}
time:   00:29:26
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534325/

[7534326] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption}
time:   00:10:36
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534326/

[7534327] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:21:40
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534327/

[7534328] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:21:51
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534328/

[7534329] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:12:34
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534329/

[7534330] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:07:37
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534330/

[7534331] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup-io-mixed}
time:   00:17:19
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534331/

[7534332] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:25:44
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534332/

[7534333] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:19:52
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534333/

[7534334] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:18:40
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534334/

[7534335] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:18:01
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534335/

[7534336] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/repair_test}
time:   00:18:27
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534336/

[7534337] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:14:06
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534337/

[7534338] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/workunits}
time:   00:11:06
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534338/

[7534339] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:46
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534339/

[7534340] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_ca_signed_key}
time:   00:13:02
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534340/

[7534341] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/dedup-io-snaps}
time:   00:15:35
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534341/

[7534342] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:29
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534342/

[7534343] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
time:   00:22:09
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534343/

[7534344] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep}
time:   00:11:24
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534344/

[7534345] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}}
time:   00:08:12
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534345/

[7534346] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm}
time:   00:15:16
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534346/

[7534347] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:09:49
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534347/

[7534348] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects}
time:   00:33:34
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534348/

[7534349] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:24:48
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534349/

[7534350] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:09:56
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534350/

[7534351] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd-backfill}
time:   02:27:14
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534351/

[7534352] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:33:54
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534352/

[7534353] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete}
time:   00:16:10
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534353/

[7534354] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:16:55
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534354/

[7534355] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:08:02
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534355/

[7534356] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}}
time:   00:08:33
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534356/

[7534357] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews}
time:   00:07:04
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534357/

[7534358] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:10:22
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534358/

[7534359] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests}
time:   00:28:49
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534359/

[7534360] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:12
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534360/

[7534361] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
time:   00:12:52
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534361/

[7534362] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm_repos}
time:   00:10:45
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534362/

[7534363] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test}
time:   00:13:08
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534363/

[7534364] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench}
time:   01:26:58
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534364/

[7534365] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:09:32
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534365/

[7534366] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_timeout}
time:   00:18:58
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534366/

[7534367] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:09
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534367/

[7534368] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency}
time:   00:24:50
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534368/

[7534369] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:24:52
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534369/

[7534370] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects}
time:   00:19:05
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534370/

[7534371] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/e2e}
time:   00:24:57
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534371/

[7534372] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/crash}
time:   00:12:41
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534372/

[7534373] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites}
time:   00:26:07
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534373/

[7534374] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:13:45
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534374/

[7534375] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:08:40
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534375/

[7534376] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:16
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534376/

[7534377] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:23
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534377/

[7534378] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/radosbench}
time:   01:05:00
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534378/

[7534379] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final}
time:   00:18:18
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534379/

[7534382] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:12:58
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534382/

[7534383] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:14:25
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534383/

[7534384] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:25
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534384/

[7534385] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd}
time:   02:42:19
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534385/

[7534386] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite}
time:   00:16:11
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534386/

[7534387] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect}
time:   00:14:53
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534387/

[7534388] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_extra_daemon_features}
time:   00:18:09
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534388/

[7534389] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_5925}
time:   00:10:17
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534389/

[7534390] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:24
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534390/

[7534391] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:51
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534391/

[7534392] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_host_drain}
time:   00:15:58
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534392/

[7534393] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_recovery}
time:   00:12:27
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534393/

[7534394] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:26:15
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534394/

[7534395] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests}
time:   00:15:16
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534395/

[7534396] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:19:46
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534396/

[7534397] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/failover}
time:   00:15:38
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534397/

[7534398] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:14:00
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534398/

[7534399] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:17:50
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534399/

[7534400] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/reef backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls}
time:   00:18:54
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534400/

[7534401] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:00
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534401/

[7534402] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{centos_latest}}
time:   00:07:02
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534402/

[7534403] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:23:26
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534403/

[7534404] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:15:32
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534404/

[7534405] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:13:07
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534405/

[7534406] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object}
time:   00:19:40
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534406/

[7534407] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:18:31
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534407/

[7534408] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:43:19
info:   https://pulpito.ceph.com/yuriw-2024-01-26_15:00:21-rados-main-distro-default-smithi/7534408/