2023-12-16T16:51:24.797 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-16T16:51:24.797 INFO:teuthology.results:subset: '111/120000'
2023-12-16T16:51:24.798 INFO:teuthology.results:seed: '2894'
2023-12-16T19:43:30.942 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-16T19:43:30.967 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-12-17T07:17:32.224 INFO:teuthology.results:Tests finished! gathering results...
2023-12-17T07:17:56.894 INFO:scrape:Found 310 jobs
2023-12-17T07:18:04.094 INFO:scrape:Found 9 distinct failure reasons
2023-12-17T07:18:04.095 INFO:scrape:Failure: Command failed (workunit test rbd/test_librbd_python.sh) on smithi002 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh'
2023-12-17T07:18:04.095 INFO:scrape:2 jobs: ['7494656', '7494500']
2023-12-17T07:18:04.095 INFO:scrape:suites intersection: ['0-start', '1-tasks', 'rados/upgrade/parallel/{0-random-distro$/{centos_9.stream}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default']
2023-12-17T07:18:04.095 INFO:scrape:suites union: ['0-start', '1-tasks', 'mon_election/classic', 'mon_election/connectivity', 'rados/upgrade/parallel/{0-random-distro$/{centos_9.stream}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default']
2023-12-17T07:18:04.095 INFO:scrape:
2023-12-17T07:18:04.095 INFO:scrape:Failure: Command failed (workunit test post-file.sh) on smithi173 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c7586e95519b7be76f3b6e3a4b333888baf46bc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh'
2023-12-17T07:18:04.096 INFO:scrape:2 jobs: ['7494685', '7494531']
2023-12-17T07:18:04.096 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/ceph-post-file', 'supported-random-distro$/{centos_latest}}']
2023-12-17T07:18:04.096 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/ceph-post-file', 'supported-random-distro$/{centos_latest}}']
2023-12-17T07:18:04.096 INFO:scrape:
2023-12-17T07:18:04.096 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=nautilus
2023-12-17T07:18:04.096 INFO:scrape:6 jobs: ['7494485', '7494620', '7494533', '7494708', '7494575', '7494444']
2023-12-17T07:18:04.096 INFO:scrape:suites intersection: ['ceph', 'clusters/{openstack', 'rados', 'rados/thrash-old-clients/{0-distro$/{centos_9.stream}', 'thrashosds-health', 'three-plus-one}']
2023-12-17T07:18:04.096 INFO:scrape:suites union: ['0-size-min-size-overrides/2-size-2-min-size', '0-size-min-size-overrides/3-size-2-min-size', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-install/octopus', '1-install/pacific', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/thrash-old-clients/{0-distro$/{centos_9.stream}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}']
2023-12-17T07:18:04.096 INFO:scrape:
2023-12-17T07:18:04.096 INFO:scrape:Failure: valgrind error: Leak_StillReachable
operator new[](unsigned long)
allocate
allocate
2023-12-17T07:18:04.096 INFO:scrape:5 jobs: ['7494601', '7494670', '7494600', '7494461', '7494534']
2023-12-17T07:18:04.097 INFO:scrape:suites intersection: []
2023-12-17T07:18:04.097 INFO:scrape:suites union: ['2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'validater/valgrind}']
2023-12-17T07:18:04.097 INFO:scrape:
2023-12-17T07:18:04.097 INFO:scrape:Failure: Command failed on smithi088 with status 5: 'sudo systemctl stop ceph-b28c3a36-9c3c-11ee-95a5-87774f69a715@mon.a'
2023-12-17T07:18:04.097 INFO:scrape:1 jobs: ['7494487']
2023-12-17T07:18:04.097 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/ubuntu_22.04', 'task/test_ca_signed_key}']
2023-12-17T07:18:04.097 INFO:scrape:
2023-12-17T07:18:04.097 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats'
2023-12-17T07:18:04.097 INFO:scrape:2 jobs: ['7494431', '7494588']
2023-12-17T07:18:04.097 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{ubuntu_latest}}']
2023-12-17T07:18:04.098 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{ubuntu_latest}}']
2023-12-17T07:18:04.098 INFO:scrape:
2023-12-17T07:18:04.098 INFO:scrape:Dead: b'2023-12-17T07:13:44.105 DEBUG:teuthology.exit:Finished running handlers'
2023-12-17T07:18:04.098 INFO:scrape:2 jobs: ['7494654', '7494498']
2023-12-17T07:18:04.098 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'supported-random-distro$/{ubuntu_latest}}']
2023-12-17T07:18:04.098 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'supported-random-distro$/{ubuntu_latest}}']
2023-12-17T07:18:04.098 INFO:scrape:
2023-12-17T07:18:04.098 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi106 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c7586e95519b7be76f3b6e3a4b333888baf46bc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'
2023-12-17T07:18:04.098 INFO:scrape:2 jobs: ['7494420', '7494574']
2023-12-17T07:18:04.098 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}']
2023-12-17T07:18:04.098 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-lz4}', 'random-objectstore$/{bluestore-comp-snappy}', 'tasks/e2e}']
2023-12-17T07:18:04.098 INFO:scrape:
2023-12-17T07:18:04.099 INFO:scrape:Failure: Test failure: test_osd_came_back (tasks.mgr.test_progress.TestProgress)
2023-12-17T07:18:04.099 INFO:scrape:1 jobs: ['7494642']
2023-12-17T07:18:04.099 INFO:scrape:suites: ['debug/mgr', 'mgr_ttl_cache/enable', 'mon_election/connectivity', 'rados/mgr/{clusters/{2-node-mgr}', 'random-objectstore$/{bluestore-comp-snappy}', 'supported-random-distro$/{centos_latest}', 'tasks/progress}']
2023-12-17T07:18:04.099 INFO:scrape:
2023-12-17T07:18:04.108 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/
failed:  21
dead:    2
running: 0
waiting: 0
queued:  0
passed:  287


Fail
=================================================================
[7494420]  rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/e2e}
-----------------------------------------------------------------
time:   00:13:21
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494420/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494420/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2484e966bf8a4bf8b7094058247cf7e2

    Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi106
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=c7586e95519b7be76f3b6e3a4b333888baf46bc9
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

[7494431]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:11:19
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494431/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494431/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f1a773c0cf874476baf082d34a8e8be5

    Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c
    ceph_test_lazy_omap_stats'

[7494444]  rados/thrash-old-clients/{0-distro$/{centos_9.stream} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:05:52
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494444/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494444/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d10eb34500f040b889b1173c0289b782

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=naut
    ilus

[7494461]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind}
-----------------------------------------------------------------
time:   01:46:24
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494461/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494461/

    valgrind error: Leak_StillReachable operator new[](unsigned long) allocate
    allocate

[7494485]  rados/thrash-old-clients/{0-distro$/{centos_9.stream} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:05:50
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494485/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494485/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ff6897f5d5f24c9ea87df1ce6f9c043f

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=naut
    ilus

[7494487]  rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_ca_signed_key}
-----------------------------------------------------------------
time:   00:11:53
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494487/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494487/
sentry: https://sentry.ceph.com/organizations/ceph/?query=006dc2bc9a91494e8b5fde0ac19081b6

    Command failed on smithi088 with status 5: 'sudo systemctl stop
    ceph-b28c3a36-9c3c-11ee-95a5-87774f69a715@mon.a'

[7494500]  rados/upgrade/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
-----------------------------------------------------------------
time:   01:12:59
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494500/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494500/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2f29bd7bdfc4461a91b115ebf9f4f9fd

    Command failed (workunit test rbd/test_librbd_python.sh) on smithi071 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph"
    CEPH_ID="0" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep
    htest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh'

[7494531]  rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_latest}}
-----------------------------------------------------------------
time:   00:08:50
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494531/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494531/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f830d424b9d240af814bcc9bf3738aea

    Command failed (workunit test post-file.sh) on smithi156 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=c7586e95519b7be76f3b6e3a4b333888baf46bc9
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh'

[7494533]  rados/thrash-old-clients/{0-distro$/{centos_9.stream} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:05:44
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494533/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494533/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2aee84f2aa3e4b2cbafd1f174e3b98b6

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=naut
    ilus

[7494534]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}
-----------------------------------------------------------------
time:   00:47:38
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494534/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494534/

    valgrind error: Leak_StillReachable operator new[](unsigned long) allocate
    allocate

[7494574]  rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/e2e}
-----------------------------------------------------------------
time:   00:16:49
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494574/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494574/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4374e5591b194547b36dbed4b5b50db9

    Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi088
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=c7586e95519b7be76f3b6e3a4b333888baf46bc9
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

[7494575]  rados/thrash-old-clients/{0-distro$/{centos_9.stream} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench}
-----------------------------------------------------------------
time:   00:05:58
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494575/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494575/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b8711186ebfc46319013ad9d13e720e1

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=octo
    pus

[7494588]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:11:56
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494588/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494588/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3db058938f494ea09a37c7960549400a

    Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c
    ceph_test_lazy_omap_stats'

[7494600]  rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
-----------------------------------------------------------------
time:   00:19:52
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494600/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494600/

    valgrind error: Leak_StillReachable operator new[](unsigned long) allocate
    allocate

[7494601]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}
-----------------------------------------------------------------
time:   00:40:21
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494601/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494601/

    valgrind error: Leak_StillReachable operator new[](unsigned long) allocate
    allocate

[7494620]  rados/thrash-old-clients/{0-distro$/{centos_9.stream} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls}
-----------------------------------------------------------------
time:   00:06:00
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494620/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494620/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cf7b7f75671641f6a8e7c11cf732f662

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=paci
    fic

[7494642]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/progress}
-----------------------------------------------------------------
time:   00:13:38
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494642/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494642/
sentry: https://sentry.ceph.com/organizations/ceph/?query=64a464d72c90498594dc70c645c8e6e7

    Test failure: test_osd_came_back (tasks.mgr.test_progress.TestProgress)

[7494656]  rados/upgrade/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
-----------------------------------------------------------------
time:   01:14:04
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494656/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494656/
sentry: https://sentry.ceph.com/organizations/ceph/?query=50e5264e703b488999d4b25a8a8651ec

    Command failed (workunit test rbd/test_librbd_python.sh) on smithi002 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph"
    CEPH_ID="0" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep
    htest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh'

[7494670]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}
-----------------------------------------------------------------
time:   01:48:21
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494670/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494670/

    valgrind error: Leak_StillReachable operator new[](unsigned long) allocate
    allocate

[7494685]  rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_latest}}
-----------------------------------------------------------------
time:   00:08:39
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494685/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494685/
sentry: https://sentry.ceph.com/organizations/ceph/?query=95fb6fdef4404c9db695e4a3dbecb2c9

    Command failed (workunit test post-file.sh) on smithi173 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=c7586e95519b7be76f3b6e3a4b333888baf46bc9
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh'

[7494708]  rados/thrash-old-clients/{0-distro$/{centos_9.stream} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:05:52
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494708/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494708/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dc6ae56c0a6f457db3360f64bab150ca

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=naut
    ilus



Dead
=================================================================
[7494498]  rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494498/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494498/

    hit max job timeout

[7494654]  rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494654/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494654/

    hit max job timeout



Pass
=================================================================
[7494412] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:09:00
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494412/

[7494413] rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_monitoring_stack_basic}
time:   00:18:40
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494413/

[7494414] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/repair_test}
time:   00:19:48
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494414/

[7494415] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-small}
time:   00:15:44
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494415/

[7494416] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:55
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494416/

[7494417] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:35:25
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494417/

[7494418] rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:21:02
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494418/

[7494419] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}}
time:   00:16:50
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494419/

[7494421] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:23:05
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494421/

[7494422] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:15:25
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494422/

[7494423] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:46
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494423/

[7494424] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:31
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494424/

[7494425] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:19:59
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494425/

[7494426] rados/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:12:55
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494426/

[7494427] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites}
time:   00:25:09
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494427/

[7494428] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
time:   00:11:30
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494428/

[7494429] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep}
time:   00:25:51
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494429/

[7494430] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final}
time:   00:11:50
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494430/

[7494432] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:15:30
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494432/

[7494433] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps}
time:   00:25:05
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494433/

[7494434] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd}
time:   02:28:30
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494434/

[7494435] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:34
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494435/

[7494436] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_orch_cli}
time:   00:13:00
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494436/

[7494437] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/scrub_test}
time:   00:11:47
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494437/

[7494438] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_latest} tasks/prometheus}
time:   00:12:10
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494438/

[7494439] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune}
time:   00:44:09
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494439/

[7494440] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:13:00
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494440/

[7494441] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced}
time:   00:23:56
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494441/

[7494442] rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_orch_cli_mon}
time:   00:38:12
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494442/

[7494443] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
time:   00:13:39
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494443/

[7494445] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:28
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494445/

[7494446] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_recovery}
time:   00:13:11
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494446/

[7494447] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:24:55
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494447/

[7494448] rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:11:59
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494448/

[7494449] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:15:53
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494449/

[7494450] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps}
time:   00:20:57
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494450/

[7494451] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:11:06
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494451/

[7494452] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{centos_latest}}
time:   00:08:36
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494452/

[7494453] rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite}
time:   00:13:27
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494453/

[7494454] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects}
time:   00:22:34
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494454/

[7494455] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:19:23
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494455/

[7494456] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:49
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494456/

[7494457] rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:11:57
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494457/

[7494458] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache}
time:   00:13:48
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494458/

[7494459] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:21:22
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494459/

[7494460] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/libcephsqlite}
time:   00:13:29
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494460/

[7494462] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:14:15
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494462/

[7494463] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:21:31
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494463/

[7494464] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations}
time:   00:15:40
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494464/

[7494465] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:55
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494465/

[7494466] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub}
time:   02:54:43
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494466/

[7494467] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_latest} tasks/workunits}
time:   00:10:11
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494467/

[7494468] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:34:23
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494468/

[7494469] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed}
time:   00:14:39
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494469/

[7494470] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:26:09
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494470/

[7494471] rados/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:25:15
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494471/

[7494472] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:09:23
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494472/

[7494473] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_workunits}
time:   00:29:42
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494473/

[7494474] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:08:34
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494474/

[7494475] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_adoption}
time:   00:10:13
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494475/

[7494476] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/dedup-io-snaps}
time:   00:16:37
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494476/

[7494477] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:10:48
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494477/

[7494478] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:26:59
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494478/

[7494479] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:26:33
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494479/

[7494480] rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:21:42
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494480/

[7494481] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:32:41
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494481/

[7494482] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:14:28
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494482/

[7494483] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/rados_api_tests}
time:   00:26:52
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494483/

[7494484] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects}
time:   00:27:46
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494484/

[7494486] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:23:33
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494486/

[7494488] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:12:03
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494488/

[7494489] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:35:19
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494489/

[7494490] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:28
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494490/

[7494491] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:30:57
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494491/

[7494492] rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm}
time:   00:13:58
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494492/

[7494493] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests}
time:   00:33:24
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494493/

[7494494] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard}
time:   01:09:31
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494494/

[7494495] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_latest} tasks/crash}
time:   00:12:24
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494495/

[7494496] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}}
time:   00:41:41
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494496/

[7494497] rados/rest/{mgr-restful supported-random-distro$/{centos_latest}}
time:   00:14:35
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494497/

[7494499] rados/standalone/{supported-random-distro$/{centos_latest} workloads/c2c}
time:   00:16:08
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494499/

[7494501] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
time:   00:19:32
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494501/

[7494502] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep}
time:   00:13:54
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494502/

[7494503] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:15:01
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494503/

[7494504] rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:11:40
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494504/

[7494505] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:16
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494505/

[7494506] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency}
time:   00:41:15
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494506/

[7494507] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:45
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494507/

[7494508] rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:12:56
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494508/

[7494509] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:14:41
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494509/

[7494510] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects}
time:   00:36:14
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494510/

[7494511] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}}
time:   00:12:53
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494511/

[7494512] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all}
time:   00:22:50
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494512/

[7494513] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final}
time:   00:19:24
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494513/

[7494514] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews}
time:   00:09:06
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494514/

[7494515] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:13:54
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494515/

[7494516] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:11:49
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494516/

[7494517] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench}
time:   00:27:28
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494517/

[7494518] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:23:34
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494518/

[7494519] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:14:09
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494519/

[7494520] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm_repos}
time:   00:07:22
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494520/

[7494521] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:10:32
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494521/

[7494522] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/redirect}
time:   00:12:46
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494522/

[7494523] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
time:   00:27:32
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494523/

[7494524] rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_extra_daemon_features}
time:   00:20:17
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494524/

[7494525] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:12:06
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494525/

[7494526] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:28:33
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494526/

[7494527] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/failover}
time:   00:15:40
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494527/

[7494528] rados/standalone/{supported-random-distro$/{centos_latest} workloads/crush}
time:   00:20:50
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494528/

[7494529] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
time:   00:14:19
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494529/

[7494530] rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:12:31
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494530/

[7494532] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests}
time:   00:12:40
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494532/

[7494535] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/rados_python}
time:   00:15:07
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494535/

[7494536] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:11:29
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494536/

[7494537] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:15:06
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494537/

[7494538] rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain}
time:   00:14:29
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494538/

[7494539] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:37
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494539/

[7494540] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object}
time:   00:17:30
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494540/

[7494541] rados/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:13:26
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494541/

[7494542] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:15:21
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494542/

[7494543] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_latest}}
time:   00:09:13
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494543/

[7494544] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete}
time:   00:20:03
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494544/

[7494545] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:33
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494545/

[7494546] rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:21:02
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494546/

[7494547] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:25:43
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494547/

[7494548] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:25:54
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494548/

[7494549] rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:15:01
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494549/

[7494550] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read}
time:   00:23:25
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494550/

[7494551] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
time:   00:15:45
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494551/

[7494552] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}}
time:   00:13:24
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494552/

[7494553] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:56
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494553/

[7494554] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_latest} tasks/insights}
time:   00:13:17
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494554/

[7494555] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/rados_stress_watch}
time:   00:16:13
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494555/

[7494556] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
time:   00:27:27
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494556/

[7494557] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:25
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494557/

[7494558] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:21:56
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494558/

[7494559] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced}
time:   00:21:29
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494559/

[7494560] rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic}
time:   00:25:59
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494560/

[7494561] rados/standalone/{supported-random-distro$/{centos_latest} workloads/erasure-code}
time:   01:21:40
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494561/

[7494562] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:25:29
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494562/

[7494563] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:09:37
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494563/

[7494564] rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:11:53
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494564/

[7494565] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:34:28
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494565/

[7494566] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:20:10
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494566/

[7494567] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}
time:   00:18:10
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494567/

[7494568] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/small-objects-localized}
time:   00:19:38
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494568/

[7494569] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:41
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494569/

[7494570] rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_orch_cli}
time:   00:12:37
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494570/

[7494571] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:10:39
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494571/

[7494572] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
time:   00:17:11
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494572/

[7494573] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}}
time:   00:13:15
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494573/

[7494576] rados/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:25:18
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494576/

[7494577] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/small-objects}
time:   00:21:53
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494577/

[7494578] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_5925}
time:   00:11:52
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494578/

[7494579] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:14:07
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494579/

[7494580] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper}
time:   00:12:01
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494580/

[7494581] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:10:13
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494581/

[7494582] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:10:57
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494582/

[7494583] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:31:12
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494583/

[7494584] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final}
time:   00:20:20
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494584/

[7494585] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_latest} tasks/module_selftest}
time:   00:25:44
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494585/

[7494586] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:31:25
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494586/

[7494587] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_latest}}
time:   00:13:59
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494587/

[7494589] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_orch_cli_mon}
time:   00:21:19
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494589/

[7494590] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr}
time:   00:19:53
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494590/

[7494591] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:17:27
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494591/

[7494592] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench}
time:   01:53:34
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494592/

[7494593] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write}
time:   00:12:55
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494593/

[7494594] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:23:32
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494594/

[7494595] rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:12:54
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494595/

[7494596] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized}
time:   00:27:47
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494596/

[7494597] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:16:30
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494597/

[7494598] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:18:57
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494598/

[7494599] rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_rgw_multisite}
time:   00:21:27
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494599/

[7494602] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:36:45
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494602/

[7494603] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:15:55
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494603/

[7494604] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:58
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494604/

[7494605] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects}
time:   00:27:46
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494605/

[7494606] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_big}
time:   00:32:01
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494606/

[7494607] rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_set_mon_crush_locations}
time:   00:16:06
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494607/

[7494608] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:09:43
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494608/

[7494609] rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:19:32
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494609/

[7494610] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:21:42
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494610/

[7494611] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests}
time:   00:28:49
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494611/

[7494612] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed}
time:   00:17:40
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494612/

[7494613] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/per_module_finisher_stats}
time:   00:10:39
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494613/

[7494614] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write}
time:   00:24:01
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494614/

[7494615] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}}
time:   00:19:00
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494615/

[7494616] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews}
time:   00:10:55
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494616/

[7494617] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:14:32
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494617/

[7494618] rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_adoption}
time:   00:10:14
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494618/

[7494619] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:21:13
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494619/

[7494621] rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc}
time:   01:06:17
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494621/

[7494622] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:14:45
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494622/

[7494623] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
time:   00:33:36
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494623/

[7494624] rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:13:31
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494624/

[7494625] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced}
time:   00:23:14
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494625/

[7494626] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:25:07
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494626/

[7494627] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:09:58
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494627/

[7494628] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix}
time:   00:23:44
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494628/

[7494629] rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:11:46
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494629/

[7494630] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_latest}}
time:   00:24:30
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494630/

[7494631] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big}
time:   00:17:53
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494631/

[7494632] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:13:29
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494632/

[7494633] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_ca_signed_key}
time:   00:11:24
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494633/

[7494634] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}
time:   00:26:56
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494634/

[7494635] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:39
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494635/

[7494636] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:26:53
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494636/

[7494637] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio}
time:   00:15:30
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494637/

[7494638] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:52
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494638/

[7494639] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small}
time:   00:15:01
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494639/

[7494640] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:34:53
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494640/

[7494641] rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_cephadm}
time:   00:20:05
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494641/

[7494643] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:14:38
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494643/

[7494644] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:23:06
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494644/

[7494645] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_osdmap_prune}
time:   00:56:14
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494645/

[7494646] rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:12:28
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494646/

[7494647] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:28
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494647/

[7494648] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:24:20
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494648/

[7494649] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:18:11
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494649/

[7494650] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:28:04
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494650/

[7494651] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread}
time:   00:25:48
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494651/

[7494652] rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_cephadm_repos}
time:   00:07:17
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494652/

[7494653] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/dashboard}
time:   01:11:53
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494653/

[7494655] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon-stretch}
time:   00:24:16
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494655/

[7494657] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:59
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494657/

[7494658] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps}
time:   00:28:10
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494658/

[7494659] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench}
time:   00:13:25
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494659/

[7494660] rados/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:13:13
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494660/

[7494661] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:10:50
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494661/

[7494662] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read}
time:   00:20:57
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494662/

[7494663] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:59
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494663/

[7494664] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:09:59
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494664/

[7494665] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final}
time:   00:10:51
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494665/

[7494666] rados/thrash-old-clients/{0-distro$/{centos_9.stream} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
time:   00:32:53
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494666/

[7494667] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced}
time:   00:20:21
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494667/

[7494668] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:11:47
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494668/

[7494669] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:12:48
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494669/

[7494671] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_extra_daemon_features}
time:   00:13:38
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494671/

[7494672] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/prometheus}
time:   00:14:01
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494672/

[7494673] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   01:54:35
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494673/

[7494674] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}}
time:   02:33:59
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494674/

[7494675] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-snaps}
time:   00:20:04
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494675/

[7494676] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/readwrite}
time:   00:12:30
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494676/

[7494677] rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:20:18
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494677/

[7494678] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:10:05
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494678/

[7494679] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
time:   00:15:42
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494679/

[7494680] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:41:07
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494680/

[7494681] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits}
time:   00:31:54
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494681/

[7494682] rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_host_drain}
time:   00:25:02
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494682/

[7494683] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon}
time:   01:13:29
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494683/

[7494684] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache}
time:   00:14:36
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494684/

[7494686] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews}
time:   00:09:13
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494686/

[7494687] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:26:23
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494687/

[7494688] rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}}
time:   00:12:50
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494688/

[7494689] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:23:31
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494689/

[7494690] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:20:49
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494690/

[7494691] rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:13:02
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494691/

[7494692] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:09:10
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494692/

[7494693] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/dedup-io-mixed}
time:   00:13:26
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494693/

[7494694] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:28:13
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494694/

[7494695] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:21:34
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494695/

[7494696] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:20:26
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494696/

[7494697] rados/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:26:28
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494697/

[7494698] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/repair_test}
time:   00:20:06
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494698/

[7494699] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:15:08
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494699/

[7494700] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/workunits}
time:   00:11:57
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494700/

[7494701] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:13
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494701/

[7494702] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/dedup-io-snaps}
time:   00:17:05
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494702/

[7494703] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:12:25
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494703/

[7494704] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
time:   00:18:07
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494704/

[7494705] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep}
time:   00:12:47
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494705/

[7494706] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:14
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494706/

[7494707] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_monitoring_stack_basic}
time:   00:18:40
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494707/

[7494709] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:44
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494709/

[7494710] rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:12:05
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494710/

[7494711] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects}
time:   00:26:39
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494711/

[7494712] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:08:56
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494712/

[7494713] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd-backfill}
time:   02:26:56
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494713/

[7494714] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:32:12
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494714/

[7494715] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete}
time:   00:15:38
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494715/

[7494716] rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_orch_cli}
time:   00:20:22
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494716/

[7494717] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:09:44
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494717/

[7494718] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}}
time:   00:09:45
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494718/

[7494719] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews}
time:   00:10:33
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494719/

[7494720] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:15:07
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494720/

[7494721] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests}
time:   00:28:57
info:   https://pulpito.ceph.com/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494721/