2024-04-15T02:43:45.880 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-04-15T02:43:45.880 INFO:teuthology.results:subset: '27837/100000'
2024-04-15T02:43:45.880 INFO:teuthology.results:seed: '9704'
2024-04-15T09:22:21.070 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-04-15T09:22:21.119 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2024-04-15T11:50:35.547 INFO:teuthology.results:Tests finished! gathering results...
2024-04-15T11:50:58.237 INFO:scrape:Found 297 jobs
2024-04-15T11:50:58.482 WARNING:scrape:Misunderstood line: 
2024-04-15T11:51:01.857 WARNING:scrape:Misunderstood line: 
2024-04-15T11:51:02.500 WARNING:scrape:Misunderstood line: 
2024-04-15T11:51:05.722 WARNING:scrape:Misunderstood line: 
2024-04-15T11:51:08.890 WARNING:scrape:Misunderstood line: 
2024-04-15T11:51:09.561 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656942/teuthology.log
2024-04-15T11:51:10.143 WARNING:scrape:Misunderstood line: 
2024-04-15T11:51:11.418 INFO:scrape:Found 8 distinct failure reasons
2024-04-15T11:51:11.419 INFO:scrape:Valgrind: mon (Leak_StillReachable)
2024-04-15T11:51:11.419 INFO:scrape:6 jobs: ['7656825', '7656788', '7656855', '7656919', '7656719', '7656656']
2024-04-15T11:51:11.419 INFO:scrape:suites intersection: []
2024-04-15T11:51:11.419 INFO:scrape:suites union: ['2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'thrashosds-health}', 'validater/valgrind}']
2024-04-15T11:51:11.419 INFO:scrape:
2024-04-15T11:51:11.419 INFO:scrape:Failure: Command failed (workunit test cephtool/test.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'
2024-04-15T11:51:11.420 INFO:scrape:5 jobs: ['7656721', '7656796', '7656865', '7656938', '7656652']
2024-04-15T11:51:11.420 INFO:scrape:suites intersection: ['rados', 'rados/singleton-bluestore/{all/cephtool']
2024-04-15T11:51:11.420 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/none', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'rados', 'rados/singleton-bluestore/{all/cephtool', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_20.04}}', 'supported-random-distro$/{ubuntu_latest}}']
2024-04-15T11:51:11.420 INFO:scrape:
2024-04-15T11:51:11.420 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats'
2024-04-15T11:51:11.420 INFO:scrape:3 jobs: ['7656804', '7656842', '7656657']
2024-04-15T11:51:11.420 INFO:scrape:suites intersection: ['rados']
2024-04-15T11:51:11.420 INFO:scrape:suites union: ['0-size-min-size-overrides/3-size-2-min-size', '1-install/octopus', 'backoff/normal', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}', 'thrashers/morepggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/rbd_cls}']
2024-04-15T11:51:11.421 INFO:scrape:
2024-04-15T11:51:11.421 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi027 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'
2024-04-15T11:51:11.421 INFO:scrape:2 jobs: ['7656710', '7656843']
2024-04-15T11:51:11.421 INFO:scrape:suites intersection: ['agent/off', 'task/test_cephadm}']
2024-04-15T11:51:11.421 INFO:scrape:suites union: ['agent/off', 'mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_cephadm}']
2024-04-15T11:51:11.421 INFO:scrape:
2024-04-15T11:51:11.421 INFO:scrape:Dead: None
2024-04-15T11:51:11.421 INFO:scrape:1 jobs: ['7656942']
2024-04-15T11:51:11.421 INFO:scrape:
2024-04-15T11:51:11.421 INFO:scrape:Failure: ['The following modules failed to execute: ansible.legacy.setup']
2024-04-15T11:51:11.422 INFO:scrape:1 jobs: ['7656662']
2024-04-15T11:51:11.422 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'fast/fast', 'mon_election/classic', 'msgr-failures/fastclose', 'openstack}', 'rados', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'recovery-overrides/{more-async-partial-recovery}', 'supported-random-distro$/{centos_8}', 'thrashers/default', 'thrashosds-health', 'workloads/ec-small-objects-fast-read-overwrites}']
2024-04-15T11:51:11.422 INFO:scrape:
2024-04-15T11:51:11.422 INFO:scrape:Failure: ['E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 6598 (apt-get)']
2024-04-15T11:51:11.422 INFO:scrape:1 jobs: ['7656687']
2024-04-15T11:51:11.422 INFO:scrape:suites: ['mon_election/connectivity', 'objectstore/bluestore-comp', 'openstack', 'rados/perf/{ceph', 'scheduler/dmclock_default_shards', 'settings/optimized', 'ubuntu_latest', 'workloads/fio_4K_rand_read}']
2024-04-15T11:51:11.422 INFO:scrape:
2024-04-15T11:51:11.422 INFO:scrape:Failure: Command failed (workunit test mon/osd-erasure-code-profile.sh) on smithi150 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh'
2024-04-15T11:51:11.422 INFO:scrape:1 jobs: ['7656902']
2024-04-15T11:51:11.423 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{centos_8}', 'workloads/mon}']
2024-04-15T11:51:11.423 INFO:scrape:
2024-04-15T11:51:11.433 INFO:teuthology.results:Sending results to ceph-qa@ceph.com: Test Run: teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/
failed:  17
dead:    3
running: 0
waiting: 0
queued:  0
passed:  277


Fail
=================================================================
[7656652]  rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}}
-----------------------------------------------------------------
time:   00:27:59
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656652/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656652/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bb2bfe80468a4fa691c62bbf3bd31a85

    Command failed (workunit test cephtool/test.sh) on smithi072 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

[7656656]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind}
-----------------------------------------------------------------
time:   00:32:36
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656656/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656656/

    saw valgrind issues

[7656657]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:10:26
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656657/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656657/
sentry: https://sentry.ceph.com/organizations/ceph/?query=78bd4fb3c2a14b3ea5eacbdc39ff5992

    Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c
    ceph_test_lazy_omap_stats'

[7656710]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:21:18
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656710/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656710/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0f7bf81c36614cfc87f6ead6ac3499d3

    Command failed (workunit test cephadm/test_cephadm.sh) on smithi027 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

[7656719]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind}
-----------------------------------------------------------------
time:   02:00:39
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656719/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656719/

    saw valgrind issues

[7656721]  rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:30:50
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656721/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656721/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f542b5fdec1346d9827122c24dc15686

    Command failed (workunit test cephtool/test.sh) on smithi064 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

[7656788]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}
-----------------------------------------------------------------
time:   01:02:48
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656788/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656788/

    saw valgrind issues

[7656796]  rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
-----------------------------------------------------------------
time:   00:26:59
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656796/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656796/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b03f0debaf4c4109a163ea2d1a73db52

    Command failed (workunit test cephtool/test.sh) on smithi087 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

[7656804]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_latest}}
-----------------------------------------------------------------
time:   00:08:40
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656804/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656804/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3d2df8a80f6e4a9688135a3e59d2f7e1

    Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c
    ceph_test_lazy_omap_stats'

[7656825]  rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
-----------------------------------------------------------------
time:   00:18:06
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656825/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656825/

    saw valgrind issues

[7656842]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/rbd_cls}
-----------------------------------------------------------------
time:   00:25:03
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656842/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656842/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7b19729d4a70468888e1a2357db1ec6f

    Command failed on smithi203 with status 1: "sudo
    TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_cls_rbd --gtest_filter=-Te
    stClsRbd.get_features:TestClsRbd.parents:TestClsRbd.mirror'"

[7656843]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm}
-----------------------------------------------------------------
time:   00:11:29
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656843/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656843/
sentry: https://sentry.ceph.com/organizations/ceph/?query=55257e3cd34644acbd1285dd59ef016d

    Command failed (workunit test cephadm/test_cephadm.sh) on smithi097 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

[7656855]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}
-----------------------------------------------------------------
time:   00:29:02
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656855/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656855/

    saw valgrind issues

[7656865]  rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:30:06
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656865/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656865/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2994f29d70a749d1bb7ea73284575d17

    Command failed (workunit test cephtool/test.sh) on smithi066 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

[7656902]  rados/standalone/{supported-random-distro$/{centos_8} workloads/mon}
-----------------------------------------------------------------
time:   00:48:20
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656902/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656902/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9f08dc21732741508717788efcb1f5c0

    Command failed (workunit test mon/osd-erasure-code-profile.sh) on smithi150
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-
    profile.sh'

[7656919]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}
-----------------------------------------------------------------
time:   02:05:57
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656919/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656919/

    saw valgrind issues

[7656938]  rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:28:48
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656938/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656938/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5082322916ce40ca93b9dc945feee783

    Command failed (workunit test cephtool/test.sh) on smithi057 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=e3fb05d5e6da84b5c44db3f3051c4d242f9809c1
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'



Dead
=================================================================
[7656662]  rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
-----------------------------------------------------------------
time:   00:24:30
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656662/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656662/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d5858aaf37f24000baaed069b7d2cc64

    ['The following modules failed to execute: ansible.legacy.setup']

[7656687]  rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
-----------------------------------------------------------------
time:   00:03:18
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656687/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656687/
sentry: https://sentry.ceph.com/organizations/ceph/?query=98e2b37c4e994482a5345e083349e57e

    ['E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process
    6598 (apt-get)']

[7656942]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656942/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656942/

    Error reimaging machines: reached maximum tries (241) after waiting for
    3600 seconds



Pass
=================================================================
[7656653] rados/multimon/{clusters/6 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews}
time:   00:10:13
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656653/

[7656654] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:30:54
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656654/

[7656655] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:23:44
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656655/

[7656658] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   01:09:44
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656658/

[7656659] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}}
time:   00:17:47
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656659/

[7656660] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/repair_test}
time:   01:40:39
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656660/

[7656661] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final}
time:   00:16:56
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656661/

[7656663] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/many workloads/snaps-few-objects}
time:   00:35:19
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656663/

[7656664] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd}
time:   02:29:13
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656664/

[7656665] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}}
time:   01:00:37
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656665/

[7656666] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:15:13
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656666/

[7656667] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:18:27
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656667/

[7656668] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench}
time:   00:12:42
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656668/

[7656669] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps}
time:   00:28:05
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656669/

[7656670] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read}
time:   00:21:01
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656670/

[7656671] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_latest} tasks/per_module_finisher_stats}
time:   00:10:21
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656671/

[7656672] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_rgw_multisite}
time:   01:09:18
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656672/

[7656673] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}}
time:   00:57:10
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656673/

[7656674] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:13:59
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656674/

[7656675] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects}
time:   00:59:03
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656675/

[7656676] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:36:20
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656676/

[7656677] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced}
time:   00:24:34
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656677/

[7656678] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test}
time:   00:13:26
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656678/

[7656679] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{centos_latest}}
time:   00:07:16
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656679/

[7656680] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}}
time:   00:25:26
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656680/

[7656681] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:21:02
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656681/

[7656682] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:25:58
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656682/

[7656683] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:21:47
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656683/

[7656684] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_set_mon_crush_locations}
time:   00:24:21
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656684/

[7656685] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_recovery}
time:   00:23:44
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656685/

[7656686] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:13:54
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656686/

[7656688] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep}
time:   00:25:47
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656688/

[7656689] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}}
time:   00:32:12
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656689/

[7656690] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps}
time:   00:28:43
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656690/

[7656691] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:18:14
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656691/

[7656692] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:08
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656692/

[7656693] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub}
time:   02:48:37
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656693/

[7656694] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/one workloads/pool-create-delete}
time:   00:23:10
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656694/

[7656695] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_ca_signed_key}
time:   00:24:53
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656695/

[7656696] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:15:04
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656696/

[7656697] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{rhel_8} tasks/progress}
time:   00:33:57
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656697/

[7656698] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:30:55
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656698/

[7656699] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache}
time:   00:22:11
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656699/

[7656700] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:24:23
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656700/

[7656701] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:17:40
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656701/

[7656702] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:22:01
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656702/

[7656703] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite}
time:   00:20:51
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656703/

[7656704] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
time:   00:29:37
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656704/

[7656705] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:21:45
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656705/

[7656706] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:14:50
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656706/

[7656707] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:16:42
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656707/

[7656708] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed}
time:   00:15:19
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656708/

[7656709] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}}
time:   00:20:32
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656709/

[7656711] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:23:57
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656711/

[7656712] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:23:59
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656712/

[7656713] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:39
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656713/

[7656714] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/test_rbd_api}
time:   00:24:31
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656714/

[7656715] rados/multimon/{clusters/21 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews}
time:   00:08:17
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656715/

[7656716] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:37:29
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656716/

[7656717] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}}
time:   00:11:27
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656717/

[7656718] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:21:46
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656718/

[7656720] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-snaps}
time:   00:24:57
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656720/

[7656722] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/dashboard}
time:   01:23:22
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656722/

[7656723] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_20.04}}
time:   00:41:06
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656723/

[7656724] rados/rest/{mgr-restful supported-random-distro$/{centos_8}}
time:   00:14:57
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656724/

[7656725] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:11
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656725/

[7656726] rados/standalone/{supported-random-distro$/{centos_8} workloads/c2c}
time:   00:15:38
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656726/

[7656727] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   01:33:35
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656727/

[7656728] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
time:   00:16:52
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656728/

[7656729] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_20.04} tasks/prometheus}
time:   00:11:41
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656729/

[7656730] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/rados_api_tests}
time:   00:26:58
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656730/

[7656731] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_cephadm_repos}
time:   00:07:23
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656731/

[7656732] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/rados_5925}
time:   00:10:13
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656732/

[7656733] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
time:   00:12:46
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656733/

[7656734] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
time:   00:15:39
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656734/

[7656735] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:32
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656735/

[7656736] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:15:04
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656736/

[7656737] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects}
time:   00:27:14
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656737/

[7656738] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects}
time:   00:23:18
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656738/

[7656739] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   01:24:54
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656739/

[7656740] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final}
time:   00:15:58
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656740/

[7656741] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:18:39
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656741/

[7656742] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/rados_api_tests}
time:   00:29:12
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656742/

[7656743] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:30:03
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656743/

[7656744] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites}
time:   00:23:19
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656744/

[7656745] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:17:06
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656745/

[7656746] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:11:38
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656746/

[7656747] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:13:06
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656747/

[7656748] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:29:56
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656748/

[7656749] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:12:48
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656749/

[7656750] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all}
time:   00:21:43
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656750/

[7656751] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews}
time:   00:07:52
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656751/

[7656752] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_extra_daemon_features}
time:   00:15:28
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656752/

[7656753] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}}
time:   00:21:13
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656753/

[7656754] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:21:18
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656754/

[7656755] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush}
time:   00:29:16
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656755/

[7656756] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{rhel_8} tasks/workunits}
time:   00:20:22
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656756/

[7656757] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep}
time:   00:13:11
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656757/

[7656758] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency}
time:   00:32:58
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656758/

[7656759] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:08:50
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656759/

[7656760] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:15:38
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656760/

[7656761] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/cache-snaps}
time:   00:43:32
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656761/

[7656762] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:22:22
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656762/

[7656763] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_api_tests}
time:   00:40:51
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656763/

[7656764] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_host_drain}
time:   00:26:56
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656764/

[7656765] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:16:12
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656765/

[7656766] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/radosbench}
time:   00:26:29
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656766/

[7656767] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_latest}}
time:   00:08:38
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656767/

[7656768] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
time:   00:16:37
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656768/

[7656769] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:48:44
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656769/

[7656770] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:13:17
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656770/

[7656771] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:25:46
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656771/

[7656772] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_python}
time:   00:18:42
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656772/

[7656773] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:21
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656773/

[7656774] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:08:14
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656774/

[7656775] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:27:02
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656775/

[7656776] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect}
time:   00:22:55
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656776/

[7656777] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/crash}
time:   00:13:04
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656777/

[7656778] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:42
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656778/

[7656779] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:23:09
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656779/

[7656780] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:01
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656780/

[7656781] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:17:59
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656781/

[7656782] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code}
time:   01:28:13
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656782/

[7656783] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
time:   00:29:58
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656783/

[7656784] rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} tasks/mon_recovery}
time:   00:12:06
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656784/

[7656785] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:28:45
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656785/

[7656786] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests}
time:   00:12:50
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656786/

[7656787] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:47:59
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656787/

[7656789] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:18:04
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656789/

[7656790] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:11:20
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656790/

[7656791] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:14:55
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656791/

[7656792] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:55
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656792/

[7656793] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/force-sync-many workloads/rados_mon_osdmap_prune}
time:   00:38:49
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656793/

[7656794] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_rgw_multisite}
time:   00:21:05
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656794/

[7656795] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} tasks/rados_stress_watch}
time:   00:19:22
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656795/

[7656797] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/redirect_set_object}
time:   00:15:49
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656797/

[7656798] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/e2e}
time:   00:27:13
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656798/

[7656799] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:09:26
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656799/

[7656800] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:22:28
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656800/

[7656801] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:17:48
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656801/

[7656802] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/radosbench}
time:   01:13:38
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656802/

[7656803] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
time:   00:23:27
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656803/

[7656805] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final}
time:   00:19:19
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656805/

[7656806] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:10:01
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656806/

[7656807] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read}
time:   00:15:21
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656807/

[7656808] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_20.04}}
time:   00:13:46
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656808/

[7656809] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{rhel_8} tasks/failover}
time:   00:24:15
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656809/

[7656810] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
time:   00:13:07
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656810/

[7656811] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_set_mon_crush_locations}
time:   00:20:57
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656811/

[7656812] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mgr}
time:   00:15:34
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656812/

[7656813] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:36:48
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656813/

[7656814] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:50
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656814/

[7656815] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}
time:   00:11:54
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656815/

[7656816] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:14:05
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656816/

[7656817] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews}
time:   00:18:42
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656817/

[7656818] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} tasks/rados_striper}
time:   00:10:25
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656818/

[7656819] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:12:10
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656819/

[7656820] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:16:44
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656820/

[7656821] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/small-objects-balanced}
time:   00:20:52
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656821/

[7656822] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}
time:   00:17:01
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656822/

[7656823] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}}
time:   00:18:27
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656823/

[7656824] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:18:22
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656824/

[7656826] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_ca_signed_key}
time:   00:14:39
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656826/

[7656827] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/many workloads/rados_mon_workunits}
time:   00:35:08
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656827/

[7656828] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:31:09
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656828/

[7656829] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}}
time:   00:33:44
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656829/

[7656830] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized}
time:   00:22:38
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656830/

[7656831] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
time:   00:13:51
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656831/

[7656832] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:20:19
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656832/

[7656833] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:30:02
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656833/

[7656834] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
time:   00:37:45
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656834/

[7656835] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:22:32
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656835/

[7656836] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_20.04} tasks/insights}
time:   00:12:45
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656836/

[7656837] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:08:16
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656837/

[7656838] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:19:07
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656838/

[7656839] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big}
time:   00:35:57
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656839/

[7656840] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/small-objects}
time:   00:20:54
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656840/

[7656841] rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc}
time:   01:03:10
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656841/

[7656844] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:33:13
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656844/

[7656845] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:10
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656845/

[7656846] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:44
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656846/

[7656847] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:11:40
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656847/

[7656848] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:17:04
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656848/

[7656849] rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews}
time:   00:10:05
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656849/

[7656850] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:29:02
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656850/

[7656851] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_latest}}
time:   00:24:06
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656851/

[7656852] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
time:   00:13:45
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656852/

[7656853] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:29:45
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656853/

[7656854] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}}
time:   00:31:09
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656854/

[7656856] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:18:17
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656856/

[7656857] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:12:04
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656857/

[7656858] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects}
time:   00:32:45
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656858/

[7656859] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:07
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656859/

[7656860] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm_repos}
time:   00:14:54
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656860/

[7656861] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized}
time:   00:27:36
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656861/

[7656862] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix}
time:   00:23:34
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656862/

[7656863] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:13:42
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656863/

[7656864] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/module_selftest}
time:   00:25:34
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656864/

[7656866] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench}
time:   01:12:54
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656866/

[7656867] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_extra_daemon_features}
time:   00:23:42
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656867/

[7656868] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:12:48
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656868/

[7656869] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:31:08
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656869/

[7656870] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write}
time:   00:12:10
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656870/

[7656871] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/dashboard}
time:   01:21:52
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656871/

[7656872] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:19:46
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656872/

[7656873] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon-stretch}
time:   00:23:18
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656873/

[7656874] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   01:32:13
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656874/

[7656875] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
time:   00:32:32
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656875/

[7656876] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:15:28
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656876/

[7656877] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:46
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656877/

[7656878] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:24:24
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656878/

[7656879] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:23:44
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656879/

[7656880] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:25:11
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656880/

[7656881] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:12:30
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656881/

[7656882] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery}
time:   00:22:57
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656882/

[7656883] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed}
time:   00:24:13
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656883/

[7656884] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:23:36
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656884/

[7656885] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/snaps-few-objects}
time:   00:35:09
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656885/

[7656886] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:10
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656886/

[7656887] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread}
time:   00:25:23
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656887/

[7656888] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final}
time:   00:18:40
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656888/

[7656889] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}
time:   00:25:09
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656889/

[7656890] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:21:14
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656890/

[7656891] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_host_drain}
time:   00:22:46
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656891/

[7656892] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete}
time:   00:16:12
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656892/

[7656893] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:54
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656893/

[7656894] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write}
time:   00:23:59
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656894/

[7656895] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{rhel_8} tasks/per_module_finisher_stats}
time:   00:21:38
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656895/

[7656896] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_20.04}}
time:   02:11:51
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656896/

[7656897] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:16:37
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656897/

[7656898] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:47
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656898/

[7656899] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:15:08
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656899/

[7656900] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced}
time:   00:23:49
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656900/

[7656901] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}}
time:   00:15:04
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656901/

[7656903] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:17:06
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656903/

[7656904] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:07:34
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656904/

[7656905] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-agent-big}
time:   00:17:44
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656905/

[7656906] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/readwrite}
time:   00:19:01
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656906/

[7656907] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}}
time:   00:19:54
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656907/

[7656908] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:17:02
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656908/

[7656909] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:22:24
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656909/

[7656910] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:22:34
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656910/

[7656911] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites}
time:   00:26:00
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656911/

[7656912] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio}
time:   00:14:45
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656912/

[7656913] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:20:26
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656913/

[7656914] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}}
time:   00:18:06
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656914/

[7656915] rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews}
time:   00:08:02
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656915/

[7656916] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-small}
time:   00:23:05
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656916/

[7656917] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_rgw_multisite}
time:   00:16:56
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656917/

[7656918] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:29:17
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656918/

[7656920] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_8} tasks/progress}
time:   00:23:23
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656920/

[7656921] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:10:44
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656921/

[7656922] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
time:   00:16:35
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656922/

[7656923] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:20:53
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656923/

[7656924] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:31:42
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656924/

[7656925] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925}
time:   00:12:43
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656925/

[7656926] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
time:   00:24:15
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656926/

[7656927] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:25:33
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656927/

[7656928] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:18:10
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656928/

[7656929] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:09:35
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656929/

[7656930] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/repair_test}
time:   00:21:59
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656930/

[7656931] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:15:54
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656931/

[7656932] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd-backfill}
time:   02:25:06
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656932/

[7656933] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read}
time:   00:31:28
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656933/

[7656934] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench}
time:   00:12:40
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656934/

[7656935] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_set_mon_crush_locations}
time:   00:29:25
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656935/

[7656936] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{rhel_8}}
time:   00:17:35
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656936/

[7656937] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps}
time:   00:42:12
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656937/

[7656939] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}}
time:   00:10:08
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656939/

[7656940] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:38
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656940/

[7656941] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:21:04
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656941/

[7656943] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:36
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656943/

[7656944] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/e2e}
time:   00:26:19
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656944/

[7656945] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_latest}}
time:   00:09:02
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656945/

[7656946] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:18:15
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656946/

[7656947] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:18:33
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656947/

[7656948] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps-balanced}
time:   00:21:05
info:   https://pulpito.ceph.com/teuthology-2024-04-14_22:00:03-rados-reef-distro-default-smithi/7656948/