2023-07-28T23:33:49.632 INFO:root:teuthology version: 0.0.1.dev172+g6114016
2023-07-28T23:33:49.633 INFO:teuthology.results:subset: '111/120000'
2023-07-28T23:33:49.633 INFO:teuthology.results:seed: '5363'
2023-07-29T13:45:16.267 INFO:root:teuthology version: 0.0.1.dev172+g6114016
2023-07-29T13:45:16.290 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-07-29T16:03:29.977 INFO:teuthology.results:Tests finished! gathering results...
2023-07-29T16:03:55.601 INFO:scrape:Found 305 jobs
2023-07-29T16:03:55.605 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355905/teuthology.log
2023-07-29T16:03:58.015 WARNING:scrape:Misunderstood line: 
2023-07-29T16:03:58.496 WARNING:scrape:Misunderstood line: 
2023-07-29T16:04:08.665 INFO:scrape:Found 10 distinct failure reasons
2023-07-29T16:04:08.666 INFO:scrape:Dead: None
2023-07-29T16:04:08.666 INFO:scrape:10 jobs: ['7355905', '7355908', '7355875', '7355974', '7356013', '7355925', '7356505', '7355911', '7355975', '7355926']
2023-07-29T16:04:08.667 INFO:scrape:
2023-07-29T16:04:08.667 INFO:scrape:Failure: "2023-07-29T04:13:45.640972+0000 mon.a (mon.0) 606 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log
2023-07-29T16:04:08.667 INFO:scrape:3 jobs: ['7356088', '7356467', '7356625']
2023-07-29T16:04:08.668 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'validater/valgrind}']
2023-07-29T16:04:08.668 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'validater/valgrind}']
2023-07-29T16:04:08.668 INFO:scrape:
2023-07-29T16:04:08.670 INFO:scrape:Failure: ['/dev/vg_nvme: already exists in filesystem', "Creating volume group 'vg_nvme' failed", "Run `vgcreate --help' for more information."]
2023-07-29T16:04:08.671 INFO:scrape:1 jobs: ['7355872']
2023-07-29T16:04:08.671 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/none', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'rados', 'rados/singleton/{all/dump-stuck', 'supported-random-distro$/{centos_8}}']
2023-07-29T16:04:08.671 INFO:scrape:
2023-07-29T16:04:08.672 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi012 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'
2023-07-29T16:04:08.672 INFO:scrape:2 jobs: ['7356602', '7356195']
2023-07-29T16:04:08.672 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}']
2023-07-29T16:04:08.673 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-bitmap}', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'tasks/e2e}']
2023-07-29T16:04:08.673 INFO:scrape:
2023-07-29T16:04:08.673 INFO:scrape:Failure: No module named 'tasks'
2023-07-29T16:04:08.674 INFO:scrape:2 jobs: ['7356572', '7356558']
2023-07-29T16:04:08.674 INFO:scrape:suites intersection: []
2023-07-29T16:04:08.674 INFO:scrape:suites union: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/watch-notify-same-primary', 'rados/standalone/{supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'workloads/osd-backfill}']
2023-07-29T16:04:08.675 INFO:scrape:
2023-07-29T16:04:08.675 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats'
2023-07-29T16:04:08.676 INFO:scrape:1 jobs: ['7356623']
2023-07-29T16:04:08.676 INFO:scrape:suites: ['mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{centos_latest}}']
2023-07-29T16:04:08.677 INFO:scrape:
2023-07-29T16:04:08.677 INFO:scrape:Valgrind: mon (Leak_StillReachable)
2023-07-29T16:04:08.677 INFO:scrape:2 jobs: ['7356275', '7356278']
2023-07-29T16:04:08.678 INFO:scrape:suites intersection: []
2023-07-29T16:04:08.678 INFO:scrape:suites union: ['2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'validater/valgrind}']
2023-07-29T16:04:08.679 INFO:scrape:
2023-07-29T16:04:08.679 INFO:scrape:Failure: reached maximum tries (801) after waiting for 4800 seconds
2023-07-29T16:04:08.679 INFO:scrape:1 jobs: ['7356250']
2023-07-29T16:04:08.680 INFO:scrape:suites: ['clusters/{fixed-2', 'fast/normal', 'mon_election/connectivity', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashosds-health', 'workloads/ec-radosbench}']
2023-07-29T16:04:08.680 INFO:scrape:
2023-07-29T16:04:08.680 INFO:scrape:Dead: b'2023-07-29T13:21:01.154 DEBUG:teuthology.exit:Finished running handlers'
2023-07-29T16:04:08.681 INFO:scrape:1 jobs: ['7355972']
2023-07-29T16:04:08.681 INFO:scrape:suites: ['clusters/{fixed-2', 'fast/fast', 'mon_election/classic', 'msgr-failures/osd-delay', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-async-recovery}', 'supported-random-distro$/{centos_latest}', 'thrashers/minsize_recovery', 'thrashosds-health', 'workloads/ec-rados-plugin=clay-k=4-m=2}']
2023-07-29T16:04:08.681 INFO:scrape:
2023-07-29T16:04:08.681 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi043.front.sepia.ceph.com: ['type=AVC msg=audit(1690632279.499:20751): avc:  denied  { ioctl } for  pid=113019 comm="iptables" path="/var/lib/containers/storage/overlay/9d6d5b58b9aa956de4795add88609db2e6ec8c63dfc54c5afc6facdfce7e9cd6/merged" dev="overlay" ino=3408726 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1690632279.378:20748): avc:  denied  { ioctl } for  pid=113002 comm="iptables" path="/var/lib/containers/storage/overlay/9d6d5b58b9aa956de4795add88609db2e6ec8c63dfc54c5afc6facdfce7e9cd6/merged" dev="overlay" ino=3408726 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']
2023-07-29T16:04:08.682 INFO:scrape:1 jobs: ['7356560']
2023-07-29T16:04:08.682 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_cephadm}']
2023-07-29T16:04:08.683 INFO:scrape:
2023-07-29T16:04:08.694 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/
failed:  12
dead:    12
running: 0
waiting: 0
queued:  0
passed:  281


Fail
=================================================================
[7356088]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}
-----------------------------------------------------------------
time:   01:03:54
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356088/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356088/

    "2023-07-29T04:13:45.640972+0000 mon.a (mon.0) 606 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[7356195]  rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} tasks/e2e}
-----------------------------------------------------------------
time:   00:34:43
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356195/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356195/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3b3679d3547a43629948393e3171842a

    Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi049
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

[7356250]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench}
-----------------------------------------------------------------
time:   02:02:50
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356250/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356250/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ce69b704c33748439c6257437ef4dd92

    reached maximum tries (801) after waiting for 4800 seconds

[7356275]  rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
-----------------------------------------------------------------
time:   00:43:49
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356275/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356275/

    saw valgrind issues

[7356278]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}
-----------------------------------------------------------------
time:   00:43:45
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356278/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356278/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a46881864fd5463f9b87ff00549bf287

    reached maximum tries (51) after waiting for 300 seconds

[7356467]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}
-----------------------------------------------------------------
time:   02:32:24
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356467/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356467/

    "2023-07-29T11:38:24.748080+0000 mon.a (mon.0) 623 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[7356558]  rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:12:57
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356558/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356558/
sentry: https://sentry.ceph.com/organizations/ceph/?query=85b9719489b94eba990e1a425812455f

    No module named 'tasks.ceph'

[7356560]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:20:18
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356560/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356560/

    SELinux denials found on ubuntu@smithi043.front.sepia.ceph.com: ['type=AVC
    msg=audit(1690632279.499:20751): avc:  denied  { ioctl } for  pid=113019
    comm="iptables" path="/var/lib/containers/storage/overlay/9d6d5b58b9aa956de
    4795add88609db2e6ec8c63dfc54c5afc6facdfce7e9cd6/merged" dev="overlay"
    ino=3408726 scontext=system_u:system_r:iptables_t:s0
    tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir
    permissive=1', 'type=AVC msg=audit(1690632279.378:20748): avc:  denied  {
    ioctl } for  pid=113002 comm="iptables" path="/var/lib/containers/storage/o
    verlay/9d6d5b58b9aa956de4795add88609db2e6ec8c63dfc54c5afc6facdfce7e9cd6/mer
    ged" dev="overlay" ino=3408726 scontext=system_u:system_r:iptables_t:s0
    tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir
    permissive=1']

[7356572]  rados/standalone/{supported-random-distro$/{centos_8} workloads/osd-backfill}
-----------------------------------------------------------------
time:   00:11:19
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356572/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356572/
sentry: https://sentry.ceph.com/organizations/ceph/?query=932fa2e811974c8ba5775dd464704379

    No module named 'tasks'

[7356602]  rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/e2e}
-----------------------------------------------------------------
time:   00:29:17
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356602/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356602/
sentry: https://sentry.ceph.com/organizations/ceph/?query=33d8232177264359be5a0038376f78ba

    Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi012
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

[7356623]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_latest}}
-----------------------------------------------------------------
time:   00:10:04
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356623/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356623/
sentry: https://sentry.ceph.com/organizations/ceph/?query=efee97d438724af29bfbbdcc472c0c7b

    Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c
    ceph_test_lazy_omap_stats'

[7356625]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind}
-----------------------------------------------------------------
time:   01:11:40
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356625/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356625/

    "2023-07-29T13:39:28.628828+0000 mon.a (mon.0) 1527 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log



Dead
=================================================================
[7355872]  rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:03:11
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355872/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355872/
sentry: https://sentry.ceph.com/organizations/ceph/?query=43f1f9a6f24d4498931118db560e1210

    ['/dev/vg_nvme: already exists in filesystem', "Creating volume group
    'vg_nvme' failed", "Run `vgcreate --help' for more information."]

[7355875]  rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355875/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355875/

    Error reimaging machines: Expected smithi150's OS to be ubuntu 22.04 but
    found ubuntu 20.04

[7355905]  rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355905/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355905/

    Error reimaging machines: 'wait for sentinel on smithi081' reached maximum
    tries (35) after waiting for 1800 seconds

[7355908]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355908/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355908/

    Error reimaging machines: Expected smithi115's OS to be centos 9 but found
    ubuntu 22.04

[7355911]  rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355911/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355911/

    Error reimaging machines: Failed to power on smithi129

[7355925]  rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355925/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355925/

    Error reimaging machines: Failed to power on smithi169

[7355926]  rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355926/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355926/

    Error reimaging machines: Expected smithi103's OS to be ubuntu 20.04 but
    found ubuntu 22.04

[7355972]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355972/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355972/

    hit max job timeout

[7355974]  rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355974/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355974/

    Error reimaging machines: Expected smithi146's OS to be centos 9 but found
    rhel 8.6

[7355975]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355975/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355975/

    Error reimaging machines: Failed to power on smithi122

[7356013]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356013/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356013/

    Error reimaging machines: Expected smithi016's OS to be centos 8 but found
    rhel 8.6

[7356505]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356505/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356505/

    Error reimaging machines: Failed to power on smithi046



Pass
=================================================================
[7355862] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:19:37
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355862/

[7355865] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:24:10
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355865/

[7355867] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:17:54
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355867/

[7355869] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/cache-snaps}
time:   00:24:08
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355869/

[7355878] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:24:58
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355878/

[7355881] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects}
time:   00:27:18
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355881/

[7355884] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:24:56
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355884/

[7355887] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:02
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355887/

[7355890] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache}
time:   00:16:54
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355890/

[7355894] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:17:47
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355894/

[7355897] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
time:   00:22:05
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355897/

[7355900] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/libcephsqlite}
time:   00:27:10
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355900/

[7355903] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:22:46
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355903/

[7355914] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:15:05
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355914/

[7355917] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub}
time:   02:43:36
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355917/

[7355920] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_latest} tasks/workunits}
time:   00:16:24
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355920/

[7355929] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed}
time:   00:16:51
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355929/

[7355933] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:27:39
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355933/

[7355937] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:12:39
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355937/

[7355940] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits}
time:   00:38:48
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355940/

[7355942] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs}
time:   00:42:27
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355942/

[7355946] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:11:35
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355946/

[7355949] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-snaps}
time:   00:26:08
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355949/

[7355952] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews}
time:   00:20:41
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355952/

[7355955] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:33:19
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355955/

[7355957] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:24:47
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355957/

[7355959] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:35:36
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355959/

[7355961] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:15:52
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355961/

[7355963] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests}
time:   00:52:42
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355963/

[7355965] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects}
time:   00:44:25
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355965/

[7355967] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli}
time:   00:22:55
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355967/

[7355968] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
time:   00:23:02
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355968/

[7355970] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:32:14
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355970/

[7355977] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:44:27
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355977/

[7355979] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:14:47
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355979/

[7355983] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:44:55
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355983/

[7355986] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/rados_api_tests}
time:   00:42:40
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355986/

[7355989] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} tasks/dashboard}
time:   01:11:52
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355989/

[7355991] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_8} tasks/crash}
time:   00:19:18
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355991/

[7355994] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}}
time:   00:47:07
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355994/

[7355997] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}}
time:   00:20:04
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7355997/

[7356000] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:19:29
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356000/

[7356003] rados/standalone/{supported-random-distro$/{rhel_8} workloads/c2c}
time:   00:18:00
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356003/

[7356006] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   01:37:06
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356006/

[7356007] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
time:   00:38:20
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356007/

[7356010] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep}
time:   00:21:00
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356010/

[7356015] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:18:24
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356015/

[7356017] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:14:48
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356017/

[7356019] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency}
time:   00:34:50
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356019/

[7356021] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:16:01
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356021/

[7356023] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:14:57
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356023/

[7356025] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:14:46
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356025/

[7356027] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects}
time:   00:36:50
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356027/

[7356030] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:14:53
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356030/

[7356032] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/rados_cls_all}
time:   00:21:18
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356032/

[7356034] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final}
time:   00:12:58
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356034/

[7356036] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews}
time:   00:15:22
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356036/

[7356038] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/radosbench}
time:   00:29:13
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356038/

[7356040] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:38:19
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356040/

[7356043] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:52
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356043/

[7356044] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:14:08
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356044/

[7356046] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:14:03
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356046/

[7356050] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect}
time:   00:15:37
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356050/

[7356053] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:15:32
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356053/

[7356055] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
time:   00:37:28
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356055/

[7356058] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_rgw_multisite}
time:   00:22:54
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356058/

[7356063] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:58
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356063/

[7356065] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:31:16
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356065/

[7356067] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/failover}
time:   00:15:44
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356067/

[7356070] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush}
time:   00:26:25
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356070/

[7356073] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:14:25
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356073/

[7356076] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
time:   00:13:35
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356076/

[7356079] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:15:11
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356079/

[7356082] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:57
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356082/

[7356084] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests}
time:   00:20:42
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356084/

[7356086] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps}
time:   00:33:18
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356086/

[7356091] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python}
time:   00:18:15
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356091/

[7356094] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:12:45
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356094/

[7356096] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:30:01
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356096/

[7356098] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_set_mon_crush_locations}
time:   00:33:18
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356098/

[7356100] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:11:14
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356100/

[7356102] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect_set_object}
time:   00:22:51
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356102/

[7356104] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:21:33
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356104/

[7356106] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}}
time:   00:11:48
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356106/

[7356108] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/sync-many workloads/pool-create-delete}
time:   00:18:11
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356108/

[7356111] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:18:12
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356111/

[7356113] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} tasks/mon_recovery}
time:   00:23:47
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356113/

[7356115] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:09:15
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356115/

[7356117] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_adoption}
time:   00:21:36
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356117/

[7356120] rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
time:   00:18:45
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356120/

[7356124] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/set-chunks-read}
time:   00:25:52
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356124/

[7356127] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
time:   00:15:08
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356127/

[7356129] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/insights}
time:   00:25:18
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356129/

[7356132] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:18:50
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356132/

[7356135] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} tasks/rados_stress_watch}
time:   00:19:23
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356135/

[7356138] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:18:57
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356138/

[7356141] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
time:   00:37:22
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356141/

[7356144] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
time:   00:19:29
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356144/

[7356147] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:27:38
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356147/

[7356151] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced}
time:   00:32:37
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356151/

[7356153] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code}
time:   01:34:14
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356153/

[7356156] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:36
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356156/

[7356159] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm}
time:   00:19:14
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356159/

[7356162] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:32:15
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356162/

[7356166] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:36:08
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356166/

[7356168] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:23:56
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356168/

[7356171] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:11:27
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356171/

[7356173] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}
time:   00:31:22
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356173/

[7356177] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/small-objects-localized}
time:   00:31:08
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356177/

[7356179] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:15:03
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356179/

[7356182] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:23:45
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356182/

[7356186] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
time:   00:16:17
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356186/

[7356189] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}}
time:   00:27:50
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356189/

[7356192] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:18:26
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356192/

[7356198] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:22:31
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356198/

[7356201] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench}
time:   01:30:55
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356201/

[7356204] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects}
time:   00:25:57
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356204/

[7356207] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925}
time:   00:15:21
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356207/

[7356210] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_repos}
time:   00:15:13
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356210/

[7356215] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/rados_striper}
time:   00:13:58
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356215/

[7356218] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:13:35
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356218/

[7356219] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} tasks/mon_clock_no_skews}
time:   00:12:49
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356219/

[7356222] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:15:26
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356222/

[7356226] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_20.04} tasks/module_selftest}
time:   00:29:17
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356226/

[7356229] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:33:24
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356229/

[7356232] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}}
time:   00:19:31
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356232/

[7356236] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final}
time:   00:15:13
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356236/

[7356239] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr}
time:   00:23:12
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356239/

[7356242] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}}
time:   00:18:22
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356242/

[7356245] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:29:37
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356245/

[7356252] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:16:47
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356252/

[7356256] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write}
time:   00:13:15
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356256/

[7356258] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:30:55
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356258/

[7356262] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-localized}
time:   00:39:14
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356262/

[7356265] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:15:10
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356265/

[7356268] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}}
time:   00:21:47
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356268/

[7356271] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:23:48
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356271/

[7356274] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:22:45
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356274/

[7356281] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:33:31
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356281/

[7356284] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:35
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356284/

[7356287] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects}
time:   00:32:39
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356287/

[7356289] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big}
time:   00:36:03
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356289/

[7356292] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:24:25
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356292/

[7356295] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:11:27
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356295/

[7356296] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:26:35
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356296/

[7356300] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_nfs}
time:   00:34:27
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356300/

[7356302] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests}
time:   00:40:49
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356302/

[7356307] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed}
time:   00:23:28
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356307/

[7356309] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/per_module_finisher_stats}
time:   00:12:45
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356309/

[7356312] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write}
time:   00:25:50
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356312/

[7356315] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
time:   00:29:27
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356315/

[7356318] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews}
time:   00:11:50
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356318/

[7356321] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:21:11
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356321/

[7356323] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:18:49
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356323/

[7356327] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls}
time:   00:25:10
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356327/

[7356330] rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc}
time:   01:10:14
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356330/

[7356332] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:30:13
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356332/

[7356335] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
time:   00:29:36
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356335/

[7356336] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:15:14
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356336/

[7356340] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:09:49
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356340/

[7356344] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced}
time:   00:28:18
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356344/

[7356347] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   01:02:24
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356347/

[7356350] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix}
time:   00:25:55
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356350/

[7356353] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_latest}}
time:   00:25:41
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356353/

[7356356] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli}
time:   00:18:59
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356356/

[7356359] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big}
time:   00:22:37
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356359/

[7356362] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}}
time:   00:21:57
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356362/

[7356365] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:35:39
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356365/

[7356366] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:33:51
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356366/

[7356371] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}
time:   00:33:27
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356371/

[7356374] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:05
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356374/

[7356377] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio}
time:   00:15:41
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356377/

[7356378] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:14:52
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356378/

[7356381] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}}
time:   00:22:34
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356381/

[7356385] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-agent-small}
time:   00:15:17
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356385/

[7356386] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}}
time:   00:39:01
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356386/

[7356389] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_20.04} tasks/progress}
time:   00:25:07
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356389/

[7356391] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli_mon}
time:   00:37:50
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356391/

[7356393] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:22:35
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356393/

[7356395] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:23:50
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356395/

[7356396] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/many workloads/rados_mon_osdmap_prune}
time:   00:55:19
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356396/

[7356398] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:07
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356398/

[7356401] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:23:05
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356401/

[7356403] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:14:48
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356403/

[7356405] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery}
time:   00:21:09
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356405/

[7356407] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread}
time:   00:28:35
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356407/

[7356412] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/dashboard}
time:   01:14:30
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356412/

[7356414] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:20:11
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356414/

[7356416] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon-stretch}
time:   00:20:09
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356416/

[7356421] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   01:29:37
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356421/

[7356424] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_rgw_multisite}
time:   00:20:17
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356424/

[7356429] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}}
time:   00:11:16
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356429/

[7356432] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps}
time:   00:32:01
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356432/

[7356435] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench}
time:   00:13:19
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356435/

[7356438] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:16:16
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356438/

[7356441] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read}
time:   00:22:20
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356441/

[7356444] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:12
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356444/

[7356447] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final}
time:   00:16:48
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356447/

[7356452] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:17:53
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356452/

[7356454] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
time:   00:38:03
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356454/

[7356456] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:19:02
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356456/

[7356457] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced}
time:   00:31:46
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356457/

[7356459] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:14:38
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356459/

[7356461] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:17:34
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356461/

[7356464] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:13:35
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356464/

[7356469] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{rhel_8} tasks/prometheus}
time:   00:18:56
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356469/

[7356471] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   01:13:24
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356471/

[7356475] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:19:32
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356475/

[7356479] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_8}}
time:   02:13:30
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356479/

[7356482] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps}
time:   00:24:56
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356482/

[7356485] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/readwrite}
time:   00:15:12
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356485/

[7356488] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:16:09
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356488/

[7356491] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
time:   00:17:13
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356491/

[7356494] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}}
time:   00:37:26
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356494/

[7356497] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_set_mon_crush_locations}
time:   00:24:07
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356497/

[7356499] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/one workloads/rados_mon_workunits}
time:   00:33:11
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356499/

[7356502] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon}
time:   01:14:04
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356502/

[7356508] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:11:13
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356508/

[7356513] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_adoption}
time:   00:18:22
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356513/

[7356516] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:12:21
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356516/

[7356519] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04}}
time:   00:21:37
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356519/

[7356522] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:29:31
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356522/

[7356524] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:13:14
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356524/

[7356528] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed}
time:   00:19:15
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356528/

[7356530] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:28:01
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356530/

[7356531] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:23:51
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356531/

[7356533] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:15:28
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356533/

[7356535] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:21:26
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356535/

[7356537] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:17:28
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356537/

[7356539] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} tasks/repair_test}
time:   00:17:28
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356539/

[7356541] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:27:10
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356541/

[7356543] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:15:25
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356543/

[7356546] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_8} tasks/workunits}
time:   00:13:30
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356546/

[7356548] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/dedup-io-snaps}
time:   00:25:59
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356548/

[7356550] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:26
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356550/

[7356552] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:14:12
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356552/

[7356554] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
time:   00:21:16
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356554/

[7356556] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep}
time:   00:16:05
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356556/

[7356562] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api}
time:   00:19:11
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356562/

[7356564] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects}
time:   00:28:59
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356564/

[7356566] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:25:24
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356566/

[7356568] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:58
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356568/

[7356569] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:14:52
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356569/

[7356574] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:33:02
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356574/

[7356576] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/sync-many workloads/pool-create-delete}
time:   00:17:55
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356576/

[7356578] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:18:09
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356578/

[7356579] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_latest}}
time:   00:11:07
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356579/

[7356581] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews}
time:   00:10:17
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356581/

[7356583] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests}
time:   00:29:47
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356583/

[7356585] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:25:19
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356585/

[7356586] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:13:28
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356586/

[7356589] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
time:   00:13:18
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356589/

[7356591] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test}
time:   00:14:16
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356591/

[7356593] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos}
time:   00:07:06
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356593/

[7356595] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}}
time:   00:13:30
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356595/

[7356596] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency}
time:   00:28:24
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356596/

[7356598] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:14
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356598/

[7356600] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects}
time:   00:24:10
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356600/

[7356604] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/crash}
time:   00:23:13
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356604/

[7356607] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:30
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356607/

[7356609] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:17:08
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356609/

[7356611] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites}
time:   00:25:08
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356611/

[7356613] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:12:18
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356613/

[7356616] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:15:04
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356616/

[7356617] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}}
time:   00:14:18
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356617/

[7356620] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:21:09
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356620/

[7356622] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench}
time:   00:56:20
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356622/

[7356627] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final}
time:   00:13:14
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356627/

[7356629] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:13:51
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356629/

[7356632] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}}
time:   00:11:17
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356632/

[7356634] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/osd}
time:   02:40:01
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356634/

[7356636] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/libcephsqlite}
time:   00:18:18
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356636/

[7356638] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:14:50
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356638/

[7356639] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/redirect}
time:   00:12:57
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356639/

[7356641] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:16:38
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356641/

[7356644] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925}
time:   00:14:42
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356644/

[7356646] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps}
time:   00:31:10
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356646/

[7356647] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:15:21
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356647/

[7356650] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_recovery}
time:   00:17:00
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356650/

[7356652] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_nfs}
time:   00:28:11
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356652/

[7356654] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:20:26
info:   http://pulpito.ceph.com/yuriw-2023-07-28_23:11:59-rados-reef-release-distro-default-smithi/7356654/