2023-04-30T10:15:14.179 INFO:root:teuthology version: 0.0.1.dev98+g69caab8
2023-04-30T10:15:14.180 INFO:teuthology.results:subset: '111/12000'
2023-04-30T10:15:14.180 INFO:teuthology.results:seed: '327'
2023-04-30T20:02:49.898 INFO:root:teuthology version: 0.0.1.dev98+g69caab8
2023-04-30T20:02:49.928 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-05-01T08:03:03.405 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2023-05-01T08:03:33.718 INFO:scrape:Found 387 jobs
2023-05-05T20:20:31.468 INFO:scrape:Found 10 distinct failure reasons
2023-05-05T20:20:31.591 INFO:scrape:Failure: {'smithi123.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools': Yum repo downloading error: Downloading error(s): repodata/69a3295a8d3db9c2703fe48d401683b8fcc82597463ff8178028c252baf2c602-filelists.xml.gz - Cannot download, all mirrors were already tried without success; repodata/38c2c78c3f89e4d347f07263805d33d8ae17df60ebab2e8a259218c57bcae2fb-comps-PowerTools.x86_64.xml - Cannot download, all mirrors were already tried without success", 'rc': 1, 'results': []}}
2023-05-05T20:20:31.591 INFO:scrape:3 jobs: ['7256832', '7257028', '7256855']
2023-05-05T20:20:31.591 INFO:scrape:suites intersection: []
2023-05-05T20:20:31.592 INFO:scrape:suites union: ['0-nvme-loop', '1-pg-log-overrides/short_pg_log', '1-start', '2-ops/rm-zap-flag}', '2-recovery-overrides/{more-active-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'agent/off', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/osd-dispatch-delay', 'msgr/async-v2only', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/cephadm/osds/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'start}', 'supported-random-distro$/{centos_8}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/redirect}']
2023-05-05T20:20:31.592 INFO:scrape:
2023-05-05T20:20:31.593 INFO:scrape:Failure: Command failed on smithi193 with status 1: 'sudo yum install -y kernel'
2023-05-05T20:20:31.593 INFO:scrape:8 jobs: ['7257051', '7256941', '7257004', '7256844', '7257053', '7257037', '7257134', '7256835']
2023-05-05T20:20:31.593 INFO:scrape:suites intersection: []
2023-05-05T20:20:31.594 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'agent/on', 'ceph', 'cluster/1-node', 'cluster/3-node', 'clusters/{fixed-2', 'debug/mgr', 'fast/fast', 'fixed-2', 'k8s/1.21', 'mgr_ttl_cache/enable', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/osd-dispatch-delay', 'net/calico', 'net/flannel', 'net/host', 'openstack}', 'rados', 'rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'random-objectstore$/{bluestore-comp-snappy}', 'recovery-overrides/{more-async-recovery}', 'rook/1.7.2}', 'rook/master}', 'start}', 'supported-random-distro$/{centos_8}', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'tasks/prometheus}', 'test_iscsi_pids_limit}}', 'thrashers/careful', 'thrashosds-health', 'workloads/ec-pool-snaps-few-objects-overwrites}']
2023-05-05T20:20:31.594 INFO:scrape:
2023-05-05T20:20:31.594 INFO:scrape:Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi150 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=565a0d716c29a28798d290d0d9f387d35c9531f3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'
2023-05-05T20:20:31.595 INFO:scrape:2 jobs: ['7256949', '7257003']
2023-05-05T20:20:31.595 INFO:scrape:suites intersection: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'rados', 'supported-random-distro$/{ubuntu_20.04}}', 'test_envlibrados_for_rocksdb}']
2023-05-05T20:20:31.595 INFO:scrape:suites union: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest', 'supported-random-distro$/{ubuntu_20.04}}', 'test_envlibrados_for_rocksdb}']
2023-05-05T20:20:31.595 INFO:scrape:
2023-05-05T20:20:31.596 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi047 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=565a0d716c29a28798d290d0d9f387d35c9531f3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'
2023-05-05T20:20:31.596 INFO:scrape:2 jobs: ['7256940', '7257132']
2023-05-05T20:20:31.596 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}']
2023-05-05T20:20:31.597 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-bitmap}', 'random-objectstore$/{bluestore-comp-lz4}', 'tasks/e2e}']
2023-05-05T20:20:31.597 INFO:scrape:
2023-05-05T20:20:31.597 INFO:scrape:Failure: "1682887190.0419579 osd.5 (osd.5) 36 : cluster [WRN] WaitReplicas::react(const DigestUpdate&): Unexpected DigestUpdate event" in cluster log
2023-05-05T20:20:31.598 INFO:scrape:2 jobs: ['7257178', '7256822']
2023-05-05T20:20:31.598 INFO:scrape:suites intersection: ['rados', 'supported-random-distro$/{ubuntu_latest}}']
2023-05-05T20:20:31.598 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/multi-backfill-reject', 'rados/singleton-nomsgr/{all/recovery-unfound-found', 'supported-random-distro$/{ubuntu_latest}}']
2023-05-05T20:20:31.598 INFO:scrape:
2023-05-05T20:20:31.599 INFO:scrape:Failure: Test failure: test_cluster_set_user_config_with_non_existing_clusterid (tasks.cephfs.test_nfs.TestNFS)
2023-05-05T20:20:31.599 INFO:scrape:1 jobs: ['7256913']
2023-05-05T20:20:31.599 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'task/test_nfs}']
2023-05-05T20:20:31.599 INFO:scrape:
2023-05-05T20:20:31.600 INFO:scrape:Dead: b'2023-04-30T17:13:07.846 INFO:teuthology.orchestra.run.smithi177.stdout:                "events": ['
2023-05-05T20:20:31.600 INFO:scrape:1 jobs: ['7256986']
2023-05-05T20:20:31.600 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', '3-scrub-overrides/{default}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_8}', 'thrashers/careful', 'thrashosds-health', 'workloads/cache-pool-snaps}']
2023-05-05T20:20:31.601 INFO:scrape:
2023-05-05T20:20:31.601 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi148.front.sepia.ceph.com: ['type=AVC msg=audit(1682856566.780:20105): avc:  denied  { ioctl } for  pid=110941 comm="iptables" path="/var/lib/containers/storage/overlay/48e3be761e3b9b1b49a3ca41f5a0b32ba839a3d025ca0c29aaf8cb06e7970d13/merged" dev="overlay" ino=3280851 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']
2023-05-05T20:20:31.601 INFO:scrape:1 jobs: ['7256839']
2023-05-05T20:20:31.602 INFO:scrape:suites: ['agent/off', 'mon_election/classic', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_cephadm}']
2023-05-05T20:20:31.602 INFO:scrape:
2023-05-05T20:20:31.602 INFO:scrape:Failure: reached maximum tries (800) after waiting for 4800 seconds
2023-05-05T20:20:31.602 INFO:scrape:1 jobs: ['7257013']
2023-05-05T20:20:31.603 INFO:scrape:suites: ['clusters/{fixed-2', 'fast/normal', 'mon_election/connectivity', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{default}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashosds-health', 'workloads/ec-radosbench}']
2023-05-05T20:20:31.603 INFO:scrape:
2023-05-05T20:20:31.603 INFO:scrape:Failure: No module named 'tasks'
2023-05-05T20:20:31.604 INFO:scrape:1 jobs: ['7256848']
2023-05-05T20:20:31.604 INFO:scrape:suites: ['2-inject-leak/mon', 'centos_latest}', 'rados/valgrind-leaks/{1-start']
2023-05-05T20:20:31.604 INFO:scrape:
2023-05-05T20:20:31.624 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/
failed:  18
dead:    3
running: 1
waiting: 0
queued:  0
passed:  365


Fail
=================================================================
[7256822]  rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:41:45
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256822/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256822/

    "1682854429.4917862 osd.1 (osd.1) 2 : cluster [WRN]
    WaitReplicas::react(const DigestUpdate&): Unexpected DigestUpdate event" in
    cluster log

[7256835]  rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
-----------------------------------------------------------------
time:   01:13:03
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256835/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256835/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e9f9fbb1a90446ab931063881f15937c

    Command failed on smithi099 with status 1: 'sudo yum -y install cephfs-
    java'

[7256839]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm}
-----------------------------------------------------------------
time:   00:33:19
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256839/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256839/

    SELinux denials found on ubuntu@smithi148.front.sepia.ceph.com: ['type=AVC
    msg=audit(1682856566.780:20105): avc:  denied  { ioctl } for  pid=110941
    comm="iptables" path="/var/lib/containers/storage/overlay/48e3be761e3b9b1b4
    9a3ca41f5a0b32ba839a3d025ca0c29aaf8cb06e7970d13/merged" dev="overlay"
    ino=3280851 scontext=system_u:system_r:iptables_t:s0
    tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir
    permissive=1']

[7256844]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2}
-----------------------------------------------------------------
time:   00:06:30
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256844/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256844/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8949971b7a94407bb276c9529c8658b8

    Command failed on smithi133 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7256848]  rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
-----------------------------------------------------------------
time:   01:35:05
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256848/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256848/
sentry: https://sentry.ceph.com/organizations/ceph/?query=87c25e1c400743f6a6a1c692a1ea302f

    No module named 'tasks'

[7256913]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs}
-----------------------------------------------------------------
time:   01:37:37
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256913/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256913/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2a0bd0eb391644a0bdfbd8a4e7521c4e

    Test failure: test_cluster_set_user_config_with_non_existing_clusterid
    (tasks.cephfs.test_nfs.TestNFS)

[7256940]  rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/e2e}
-----------------------------------------------------------------
time:   02:13:37
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256940/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256940/
sentry: https://sentry.ceph.com/organizations/ceph/?query=845f1b4173bf4bc3b738a073f52d66b8

    Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi047
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=565a0d716c29a28798d290d0d9f387d35c9531f3
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

[7256941]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master}
-----------------------------------------------------------------
time:   00:06:32
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256941/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256941/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c58ab5d5feab4b4d81041f868c734466

    Command failed on smithi064 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7256949]  rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}}
-----------------------------------------------------------------
time:   00:09:38
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256949/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256949/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1618e9703fb34bb09da4053fa28f4279

    Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on
    smithi150 with status 2: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=565a0d716c29a28798d290d0d9f387d35c9531f3
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'

[7257003]  rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04}}
-----------------------------------------------------------------
time:   00:09:51
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257003/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257003/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c1ae4e7b980944ef932d16002d39ed45

    Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on
    smithi005 with status 2: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=565a0d716c29a28798d290d0d9f387d35c9531f3
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'

[7257004]  rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257004/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257004/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c58f1dfbf81a474ba95020507143cf96

    Command failed on smithi038 with status 1: 'sudo yum install -y kernel'

[7257013]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench}
-----------------------------------------------------------------
time:   01:42:57
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257013/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257013/
sentry: https://sentry.ceph.com/organizations/ceph/?query=60120e0adb4a434db96f045874e4b115

    reached maximum tries (800) after waiting for 4800 seconds

[7257037]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2}
-----------------------------------------------------------------
time:   00:06:16
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257037/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257037/
sentry: https://sentry.ceph.com/organizations/ceph/?query=94dde20a7c4649cb9d33fed37008516d

    Command failed on smithi174 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7257051]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/prometheus}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257051/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257051/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2d115029a36245d38a22bb2ac14f8966

    Command failed on smithi193 with status 1: 'sudo yum install -y kernel'

[7257053]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257053/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257053/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9b8f1dba84914370b154d8a51a8949f3

    Command failed on smithi032 with status 1: 'sudo yum install -y kernel'

[7257132]  rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} tasks/e2e}
-----------------------------------------------------------------
time:   02:04:34
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257132/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257132/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e513c4eb22d040728d474cf71ec99bad

    Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi159
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=565a0d716c29a28798d290d0d9f387d35c9531f3
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

[7257134]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master}
-----------------------------------------------------------------
time:   00:06:21
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257134/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257134/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fe949a5a3bfc4f61a89f93439c9e19db

    Command failed on smithi017 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7257178]  rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:35:01
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257178/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257178/

    "1682887190.0419579 osd.5 (osd.5) 36 : cluster [WRN]
    WaitReplicas::react(const DigestUpdate&): Unexpected DigestUpdate event" in
    cluster log



Dead
=================================================================
[7256832]  rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
-----------------------------------------------------------------
time:   00:40:51
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256832/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256832/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4ed24162143f4a7683f00c9dd8a803d0

    {'smithi123.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed':
    False, 'invocation': {'module_args': {'allow_downgrade': False,
    'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file':
    None, 'disable_excludes': None, 'disable_gpg_check': False,
    'disable_plugin': [], 'disablerepo': [], 'download_dir': None,
    'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude':
    [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot':
    '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'],
    'releasever': None, 'security': False, 'skip_broken': False, 'state':
    'present', 'update_cache': False, 'update_only': False, 'validate_certs':
    True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools':
    Yum repo downloading error: Downloading error(s): repodata/69a3295a8d3db9c2
    703fe48d401683b8fcc82597463ff8178028c252baf2c602-filelists.xml.gz - Cannot
    download, all mirrors were already tried without success;
    repodata/38c2c78c3f89e4d347f07263805d33d8ae17df60ebab2e8a259218c57bcae2fb-
    comps-PowerTools.x86_64.xml - Cannot download, all mirrors were already
    tried without success", 'rc': 1, 'results': []}}

[7256855]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect}
-----------------------------------------------------------------
time:   00:40:23
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256855/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256855/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1025dcbbb8454fbb833befcbaa6da2c5

    {'smithi125.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed':
    False, 'invocation': {'module_args': {'allow_downgrade': False,
    'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file':
    None, 'disable_excludes': None, 'disable_gpg_check': False,
    'disable_plugin': [], 'disablerepo': [], 'download_dir': None,
    'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude':
    [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot':
    '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'],
    'releasever': None, 'security': False, 'skip_broken': False, 'state':
    'present', 'update_cache': False, 'update_only': False, 'validate_certs':
    True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools':
    Yum repo downloading error: Downloading error(s): repodata/655edd281b923f12
    af44ba71f23c34741aa8dae0a29e712e75d96be8787f7115-modules.yaml.xz - Cannot
    download, all mirrors were already tried without success", 'rc': 1,
    'results': []}}

[7257028]  rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:21:46
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257028/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257028/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b0e8cf49fd8d48c497ba9ee79d0a76fe

    {'smithi137.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed':
    False, 'invocation': {'module_args': {'allow_downgrade': False,
    'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file':
    None, 'disable_excludes': None, 'disable_gpg_check': False,
    'disable_plugin': [], 'disablerepo': [], 'download_dir': None,
    'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude':
    [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot':
    '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'],
    'releasever': None, 'security': False, 'skip_broken': False, 'state':
    'present', 'update_cache': False, 'update_only': False, 'validate_certs':
    True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools':
    Yum repo downloading error: Downloading error(s): repodata/6648b75c134e77a9
    3f86cc6c5e3c2f4c966436521b60be704e240505f1242a1d-primary.xml.gz - Cannot
    download, all mirrors were already tried without success; repodata/69a3295a
    8d3db9c2703fe48d401683b8fcc82597463ff8178028c252baf2c602-filelists.xml.gz -
    Cannot download, all mirrors were already tried without success", 'rc': 1,
    'results': []}, 'smithi063.front.sepia.ceph.com': {'_ansible_no_log':
    False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade':
    False, 'allowerasing': False, 'autoremove': False, 'bugfix': False,
    'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False,
    'disable_plugin': [], 'disablerepo': [], 'download_dir': None,
    'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude':
    [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot':
    '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'],
    'releasever': None, 'security': False, 'skip_broken': False, 'state':
    'present', 'update_cache': False, 'update_only': False, 'validate_certs':
    True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools':
    Yum repo downloading error: Downloading error(s): repodata/6648b75c134e77a9
    3f86cc6c5e3c2f4c966436521b60be704e240505f1242a1d-primary.xml.gz - Cannot
    download, all mirrors were already tried without success; repodata/69a3295a
    8d3db9c2703fe48d401683b8fcc82597463ff8178028c252baf2c602-filelists.xml.gz -
    Cannot download, all mirrors were already tried without success", 'rc': 1,
    'results': []}}



Running
=================================================================
[7256986] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps}
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256986/



Pass
=================================================================
[7256796] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects}
time:   00:26:58
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256796/

[7256797] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed}
time:   00:21:52
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256797/

[7256798] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
time:   00:23:53
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256798/

[7256799] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:23:31
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256799/

[7256800] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub}
time:   02:59:09
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256800/

[7256801] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:17:45
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256801/

[7256802] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_8} tasks/workunits}
time:   01:26:01
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256802/

[7256803] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests}
time:   01:38:50
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256803/

[7256804] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:31:29
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256804/

[7256805] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-big}
time:   00:35:57
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256805/

[7256806] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:33:38
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256806/

[7256807] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:12:39
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256807/

[7256808] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:10:54
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256808/

[7256809] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small}
time:   00:20:51
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256809/

[7256810] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
time:   00:32:13
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256810/

[7256811] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:18:27
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256811/

[7256812] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:13:43
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256812/

[7256813] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:14:31
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256813/

[7256814] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:25:52
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256814/

[7256815] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_recovery}
time:   00:30:35
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256815/

[7256816] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}
time:   01:42:24
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256816/

[7256817] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps}
time:   00:22:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256817/

[7256818] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix}
time:   01:16:27
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256818/

[7256819] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption}
time:   00:15:03
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256819/

[7256820] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}}
time:   02:27:33
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256820/

[7256821] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced}
time:   00:27:18
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256821/

[7256823] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps}
time:   00:35:40
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256823/

[7256824] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/cache}
time:   00:11:52
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256824/

[7256825] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:23:57
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256825/

[7256826] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}}
time:   01:30:05
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256826/

[7256827] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed}
time:   00:15:54
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256827/

[7256828] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits}
time:   00:31:36
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256828/

[7256829] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:19:30
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256829/

[7256830] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps}
time:   00:15:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256830/

[7256831] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
time:   00:11:12
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256831/

[7256833] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
time:   01:28:47
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256833/

[7256834] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects}
time:   00:28:47
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256834/

[7256836] rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:47
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256836/

[7256837] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests}
time:   00:31:42
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256837/

[7256838] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency}
time:   01:59:35
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256838/

[7256840] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/dashboard}
time:   02:26:08
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256840/

[7256841] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/crash}
time:   00:13:26
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256841/

[7256842] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}}
time:   01:59:09
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256842/

[7256843] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}}
time:   00:17:35
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256843/

[7256845] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:23:13
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256845/

[7256846] rados/standalone/{supported-random-distro$/{rhel_8} workloads/c2c}
time:   00:22:49
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256846/

[7256847] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   02:46:43
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256847/

[7256849] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects}
time:   00:23:00
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256849/

[7256850] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench}
time:   01:05:38
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256850/

[7256851] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} tasks/rados_workunit_loadgen_mostlyread}
time:   00:29:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256851/

[7256852] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:19:12
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256852/

[7256853] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   01:45:22
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256853/

[7256854] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:12:20
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256854/

[7256856] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:50:05
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256856/

[7256857] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests}
time:   00:18:02
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256857/

[7256858] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:27:31
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256858/

[7256859] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   01:30:26
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256859/

[7256860] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_set_object}
time:   01:33:56
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256860/

[7256861] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}}
time:   00:19:06
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256861/

[7256862] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} tasks/mon_clock_no_skews}
time:   00:08:47
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256862/

[7256863] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}
time:   01:48:06
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256863/

[7256864] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/set-chunks-read}
time:   00:14:58
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256864/

[7256865] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final}
time:   00:17:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256865/

[7256866] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
time:   00:10:52
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256866/

[7256867] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-balanced}
time:   01:52:58
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256867/

[7256868] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:20:46
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256868/

[7256869] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-localized}
time:   00:27:35
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256869/

[7256870] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}}
time:   00:08:52
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256870/

[7256871] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos}
time:   00:06:53
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256871/

[7256872] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects}
time:   01:39:27
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256872/

[7256873] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/snaps-few-objects}
time:   01:48:43
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256873/

[7256874] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:27:38
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256874/

[7256875] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:09:47
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256875/

[7256876] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/snaps-few-objects-localized}
time:   00:25:19
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256876/

[7256877] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:46:16
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256877/

[7256878] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/readwrite}
time:   00:15:10
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256878/

[7256879] rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}}
time:   01:34:13
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256879/

[7256880] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/snaps-few-objects}
time:   00:28:50
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256880/

[7256881] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed}
time:   00:16:16
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256881/

[7256882] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:50:25
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256882/

[7256883] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_20.04} tasks/failover}
time:   00:13:15
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256883/

[7256884] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}}
time:   00:22:02
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256884/

[7256885] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
time:   01:50:36
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256885/

[7256886] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:21:22
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256886/

[7256887] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush}
time:   01:40:14
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256887/

[7256888] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:30:39
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256888/

[7256889] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:24:46
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256889/

[7256890] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps}
time:   01:39:19
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256890/

[7256891] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
time:   00:10:56
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256891/

[7256892] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big}
time:   00:55:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256892/

[7256893] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:57
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256893/

[7256894] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:35
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256894/

[7256895] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:30:23
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256895/

[7256896] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small}
time:   01:34:36
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256896/

[7256897] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
time:   01:36:05
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256897/

[7256898] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   01:37:55
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256898/

[7256899] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:16:24
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256899/

[7256900] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:21:20
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256900/

[7256901] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:14:11
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256901/

[7256902] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}}
time:   00:17:18
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256902/

[7256903] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps}
time:   00:31:32
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256903/

[7256904] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews}
time:   00:19:28
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256904/

[7256905] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}
time:   01:45:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256905/

[7256906] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:18:19
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256906/

[7256907] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced}
time:   00:26:38
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256907/

[7256908] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}}
time:   02:04:22
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256908/

[7256909] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/repair_test}
time:   00:19:09
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256909/

[7256910] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps}
time:   01:42:15
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256910/

[7256911] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}}
time:   01:30:50
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256911/

[7256912] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache}
time:   00:17:04
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256912/

[7256914] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/dedup-io-mixed}
time:   00:29:11
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256914/

[7256915] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write}
time:   00:11:04
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256915/

[7256916] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/pool-create-delete}
time:   00:17:13
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256916/

[7256917] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04}}
time:   00:09:40
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256917/

[7256918] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/dedup-io-snaps}
time:   00:14:57
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256918/

[7256919] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:23:19
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256919/

[7256920] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:14:30
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256920/

[7256921] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects}
time:   00:29:28
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256921/

[7256922] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/rados_api_tests}
time:   01:56:17
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256922/

[7256923] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04}}
time:   00:10:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256923/

[7256924] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_20.04} tasks/insights}
time:   00:13:17
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256924/

[7256925] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:16:20
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256925/

[7256926] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency}
time:   01:55:44
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256926/

[7256927] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
time:   00:29:10
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256927/

[7256928] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:10:27
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256928/

[7256929] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code}
time:   01:30:22
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256929/

[7256930] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench}
time:   00:29:35
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256930/

[7256931] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:29:40
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256931/

[7256932] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:21
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256932/

[7256933] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect}
time:   01:32:42
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256933/

[7256934] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}}
time:   00:13:46
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256934/

[7256935] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli}
time:   00:19:00
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256935/

[7256936] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} tasks/scrub_test}
time:   00:12:12
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256936/

[7256937] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/redirect_promote_tests}
time:   00:12:06
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256937/

[7256938] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench}
time:   02:30:07
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256938/

[7256939] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:27:53
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256939/

[7256942] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:17
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256942/

[7256943] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object}
time:   00:24:08
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256943/

[7256944] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write}
time:   00:26:24
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256944/

[7256945] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:17:55
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256945/

[7256946] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/set-chunks-read}
time:   01:33:43
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256946/

[7256947] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:17:01
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256947/

[7256948] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}
time:   03:24:08
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256948/

[7256950] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}
time:   01:43:36
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256950/

[7256951] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-balanced}
time:   00:33:34
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256951/

[7256952] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized}
time:   01:44:02
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256952/

[7256953] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}}
time:   01:30:07
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256953/

[7256954] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final}
time:   00:16:25
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256954/

[7256955] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects}
time:   00:22:44
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256955/

[7256956] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
time:   01:04:21
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256956/

[7256957] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}}
time:   01:30:24
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256957/

[7256958] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:24:59
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256958/

[7256959] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_5925}
time:   00:13:14
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256959/

[7256960] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon}
time:   00:40:29
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256960/

[7256961] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized}
time:   00:27:46
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256961/

[7256962] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:23:56
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256962/

[7256963] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
time:   00:41:18
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256963/

[7256964] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects}
time:   00:31:04
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256964/

[7256965] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/libcephsqlite}
time:   01:09:23
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256965/

[7256966] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed}
time:   01:39:28
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256966/

[7256967] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/module_selftest}
time:   00:35:42
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256967/

[7256968] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio}
time:   00:12:31
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256968/

[7256969] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:18:54
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256969/

[7256970] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests}
time:   01:35:33
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256970/

[7256971] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
time:   00:27:39
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256971/

[7256972] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:28:50
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256972/

[7256973] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr}
time:   00:19:49
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256973/

[7256974] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
time:   01:38:13
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256974/

[7256975] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:22:05
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256975/

[7256976] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/cache-agent-big}
time:   00:18:49
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256976/

[7256977] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:28:26
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256977/

[7256978] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:21:12
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256978/

[7256979] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:23:42
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256979/

[7256980] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/cache-agent-small}
time:   00:12:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256980/

[7256981] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}}
time:   01:53:21
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256981/

[7256982] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:21:57
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256982/

[7256983] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:13:51
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256983/

[7256984] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}}
time:   01:42:38
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256984/

[7256985] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:26:42
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256985/

[7256987] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption}
time:   00:09:55
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256987/

[7256988] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews}
time:   01:34:57
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256988/

[7256989] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep}
time:   01:35:04
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256989/

[7256990] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/cache-snaps-balanced}
time:   00:23:52
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256990/

[7256991] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls}
time:   01:44:08
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256991/

[7256992] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps}
time:   01:41:45
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256992/

[7256993] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:58
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256993/

[7256994] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:18:13
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256994/

[7256995] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256995/

[7256996] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache}
time:   00:13:54
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256996/

[7256997] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests}
time:   00:30:14
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256997/

[7256998] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench}
time:   00:11:06
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256998/

[7256999] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/dedup-io-mixed}
time:   00:14:00
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7256999/

[7257000] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_api_tests}
time:   00:39:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257000/

[7257001] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-snaps}
time:   00:14:33
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257001/

[7257002] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites}
time:   00:26:43
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257002/

[7257005] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects}
time:   00:31:38
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257005/

[7257006] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:09:33
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257006/

[7257007] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rados_api_tests}
time:   00:30:21
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257007/

[7257008] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{rhel_8} tasks/progress}
time:   00:32:06
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257008/

[7257009] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_20.04}}
time:   00:30:58
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257009/

[7257010] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm}
time:   01:39:23
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257010/

[7257011] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency}
time:   01:46:25
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257011/

[7257012] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:08:43
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257012/

[7257014] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/radosbench}
time:   00:38:24
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257014/

[7257015] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:31:55
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257015/

[7257016] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc}
time:   01:12:54
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257016/

[7257017] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect}
time:   01:46:54
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257017/

[7257018] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:28:37
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257018/

[7257019] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:18:40
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257019/

[7257020] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:46:21
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257020/

[7257021] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests}
time:   00:23:04
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257021/

[7257022] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}}
time:   00:21:11
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257022/

[7257023] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
time:   00:12:42
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257023/

[7257024] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:27:02
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257024/

[7257025] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} tasks/rados_cls_all}
time:   00:20:42
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257025/

[7257026] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_set_object}
time:   00:19:25
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257026/

[7257027] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:11:40
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257027/

[7257029] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/set-chunks-read}
time:   00:15:13
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257029/

[7257030] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} tasks/mon_clock_with_skews}
time:   00:08:32
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257030/

[7257031] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind}
time:   02:03:53
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257031/

[7257032] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
time:   00:19:26
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257032/

[7257033] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced}
time:   01:38:43
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257033/

[7257034] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/small-objects-localized}
time:   00:20:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257034/

[7257035] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos}
time:   00:43:07
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257035/

[7257036] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/dashboard}
time:   02:29:13
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257036/

[7257038] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:18:36
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257038/

[7257039] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   01:31:23
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257039/

[7257040] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects}
time:   00:21:57
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257040/

[7257041] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
time:   01:52:42
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257041/

[7257042] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}}
time:   00:10:08
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257042/

[7257043] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced}
time:   01:49:10
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257043/

[7257044] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_osdmap_prune}
time:   01:09:16
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257044/

[7257045] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final}
time:   00:14:58
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257045/

[7257046] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized}
time:   00:26:28
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257046/

[7257047] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:10:18
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257047/

[7257048] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/snaps-few-objects}
time:   00:30:18
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257048/

[7257049] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:12:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257049/

[7257050] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}}
time:   01:28:06
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257050/

[7257052] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed}
time:   01:39:31
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257052/

[7257054] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_python}
time:   01:14:40
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257054/

[7257055] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:33:28
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257055/

[7257056] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced}
time:   01:44:59
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257056/

[7257057] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:54:38
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257057/

[7257058] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-big}
time:   00:18:28
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257058/

[7257059] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:16:17
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257059/

[7257060] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon}
time:   01:23:18
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257060/

[7257061] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:03
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257061/

[7257062] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:28:23
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257062/

[7257063] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:08
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257063/

[7257064] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:47:55
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257064/

[7257065] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-small}
time:   00:16:06
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257065/

[7257066] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:32:19
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257066/

[7257067] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{rhel_8}}
time:   02:28:51
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257067/

[7257068] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:11:32
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257068/

[7257069] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps}
time:   00:44:14
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257069/

[7257070] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:18:06
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257070/

[7257071] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04}}
time:   00:45:47
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257071/

[7257072] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:13:47
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257072/

[7257073] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced}
time:   01:42:26
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257073/

[7257074] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:14:33
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257074/

[7257075] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep}
time:   01:35:58
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257075/

[7257076] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:34:09
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257076/

[7257077] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps}
time:   00:29:55
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257077/

[7257078] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
time:   00:12:38
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257078/

[7257079] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs}
time:   00:31:09
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257079/

[7257080] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache}
time:   00:17:24
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257080/

[7257081] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:44:46
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257081/

[7257082] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:12
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257082/

[7257083] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed}
time:   01:31:12
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257083/

[7257084] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch}
time:   00:27:43
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257084/

[7257085] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_workunits}
time:   00:31:29
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257085/

[7257086] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/dedup-io-snaps}
time:   00:14:27
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257086/

[7257087] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:46:10
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257087/

[7257088] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects}
time:   01:50:52
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257088/

[7257089] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:08:09
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257089/

[7257090] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:09:36
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257090/

[7257091] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api}
time:   01:37:40
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257091/

[7257092] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests}
time:   00:45:36
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257092/

[7257093] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_20.04} tasks/workunits}
time:   00:09:52
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257093/

[7257094] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:20:07
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257094/

[7257095] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency}
time:   00:39:51
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257095/

[7257096] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read}
time:   01:38:18
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257096/

[7257097] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}
time:   01:55:35
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257097/

[7257098] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/radosbench}
time:   00:44:42
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257098/

[7257099] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:08:47
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257099/

[7257100] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/osd-backfill}
time:   03:31:29
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257100/

[7257101] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect}
time:   01:32:40
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257101/

[7257102] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
time:   01:38:21
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257102/

[7257103] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:12:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257103/

[7257104] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli}
time:   00:20:01
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257104/

[7257105] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:24:54
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257105/

[7257106] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   01:33:56
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257106/

[7257107] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests}
time:   00:26:40
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257107/

[7257108] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
time:   01:15:35
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257108/

[7257109] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object}
time:   00:14:52
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257109/

[7257110] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:27:42
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257110/

[7257111] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:23:30
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257111/

[7257112] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:25:20
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257112/

[7257113] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read}
time:   00:16:55
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257113/

[7257114] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} tasks/rados_striper}
time:   00:09:55
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257114/

[7257115] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}}
time:   01:29:40
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257115/

[7257116] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced}
time:   01:38:34
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257116/

[7257117] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} tasks/mon_clock_no_skews}
time:   00:08:52
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257117/

[7257118] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep}
time:   01:31:10
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257118/

[7257119] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:33
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257119/

[7257120] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-localized}
time:   00:21:43
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257120/

[7257121] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:16:56
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257121/

[7257122] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_20.04}}
time:   00:07:28
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257122/

[7257123] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/small-objects}
time:   00:21:08
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257123/

[7257124] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:16:46
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257124/

[7257125] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:27:54
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257125/

[7257126] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}}
time:   00:12:26
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257126/

[7257127] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync workloads/snaps-few-objects}
time:   01:47:01
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257127/

[7257128] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon}
time:   01:49:21
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257128/

[7257129] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized}
time:   00:29:33
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257129/

[7257130] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:12:32
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257130/

[7257131] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects}
time:   00:28:26
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257131/

[7257133] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/crash}
time:   00:13:11
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257133/

[7257135] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:17
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257135/

[7257136] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed}
time:   00:21:08
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257136/

[7257137] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:48:32
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257137/

[7257138] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:14:11
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257138/

[7257139] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:21:37
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257139/

[7257140] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:22:21
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257140/

[7257141] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} tasks/rados_workunit_loadgen_big}
time:   00:31:16
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257141/

[7257142] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big}
time:   00:37:10
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257142/

[7257143] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps}
time:   01:47:00
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257143/

[7257144] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final}
time:   00:20:17
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257144/

[7257145] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   01:25:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257145/

[7257146] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd}
time:   03:00:12
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257146/

[7257147] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:13
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257147/

[7257148] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:12:28
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257148/

[7257149] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small}
time:   00:20:28
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257149/

[7257150] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:00
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257150/

[7257151] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:23:31
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257151/

[7257152] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   01:31:14
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257152/

[7257153] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps}
time:   01:42:32
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257153/

[7257154] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption}
time:   01:34:40
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257154/

[7257155] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}}
time:   01:33:59
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257155/

[7257156] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced}
time:   00:32:59
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257156/

[7257157] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:10:52
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257157/

[7257158] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:12
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257158/

[7257159] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews}
time:   01:26:12
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257159/

[7257160] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind}
time:   02:21:20
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257160/

[7257161] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps}
time:   01:41:20
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257161/

[7257162] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:22:52
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257162/

[7257163] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache}
time:   00:20:25
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257163/

[7257164] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:22:39
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257164/

[7257165] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed}
time:   01:32:36
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257165/

[7257166] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:14:50
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257166/

[7257167] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}}
time:   00:32:43
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257167/

[7257168] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:19:09
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257168/

[7257169] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/dedup-io-snaps}
time:   00:18:05
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257169/

[7257170] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_cephadm}
time:   00:22:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257170/

[7257171] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/pool-create-delete}
time:   00:22:04
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257171/

[7257172] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix}
time:   00:23:41
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257172/

[7257173] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects}
time:   01:45:27
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257173/

[7257174] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}
time:   01:36:30
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257174/

[7257175] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_20.04} tasks/failover}
time:   00:13:16
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257175/

[7257176] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{ubuntu_latest}}
time:   00:10:20
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257176/

[7257177] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/rados_api_tests}
time:   00:25:55
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257177/

[7257179] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:52:21
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257179/

[7257180] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency}
time:   01:59:25
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257180/

[7257181] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects}
time:   00:22:33
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257181/

[7257182] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/radosbench}
time:   00:47:10
info:   http://pulpito.ceph.com/yuriw-2023-04-28_18:52:31-rados-reef-distro-default-smithi/7257182/