2023-06-30T22:43:05.218 INFO:root:teuthology version: 0.0.1.dev138+g8dce2fc 2023-06-30T22:43:05.219 INFO:teuthology.results:subset: '111/120000' 2023-06-30T22:43:05.220 INFO:teuthology.results:seed: '287' 2023-07-01T05:15:39.713 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-01T05:15:39.739 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-07-01T08:01:56.584 INFO:teuthology.results:Tests finished! gathering results... 2023-07-01T08:02:19.399 INFO:scrape:Found 307 jobs 2023-07-01T08:02:20.645 INFO:scrape:Found 4 distinct failure reasons 2023-07-01T08:02:20.646 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi162 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e0eff22ec7bdb679a2fe274cc1427a1b9c6818aa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-07-01T08:02:20.647 INFO:scrape:2 jobs: ['7323750', '7323517'] 2023-07-01T08:02:20.647 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}'] 2023-07-01T08:02:20.647 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-bitmap}', 'random-objectstore$/{bluestore-comp-zstd}', 'tasks/e2e}'] 2023-07-01T08:02:20.648 INFO:scrape: 2023-07-01T08:02:20.648 INFO:scrape:Failure: Test failure: test_daemon_restart (tasks.cephadm_cases.test_cli.TestCephadmCLI) 2023-07-01T08:02:20.648 INFO:scrape:1 jobs: ['7323244'] 2023-07-01T08:02:20.648 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_orch_cli}'] 2023-07-01T08:02:20.649 INFO:scrape: 2023-07-01T08:02:20.649 INFO:scrape:Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi143 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e0eff22ec7bdb679a2fe274cc1427a1b9c6818aa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' 2023-07-01T08:02:20.649 INFO:scrape:2 jobs: ['7323680', '7323727'] 2023-07-01T08:02:20.650 INFO:scrape:suites intersection: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'rados', 'supported-random-distro$/{ubuntu_20.04}}', 'test_envlibrados_for_rocksdb}'] 2023-07-01T08:02:20.650 INFO:scrape:suites union: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest', 'supported-random-distro$/{ubuntu_20.04}}', 'test_envlibrados_for_rocksdb}'] 2023-07-01T08:02:20.650 INFO:scrape: 2023-07-01T08:02:20.650 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' 2023-07-01T08:02:20.651 INFO:scrape:1 jobs: ['7323760'] 2023-07-01T08:02:20.651 INFO:scrape:suites: ['mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{ubuntu_latest}}'] 2023-07-01T08:02:20.651 INFO:scrape: 2023-07-01T08:02:20.663 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 301 Fail ================================================================= [7323244] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:18:54 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323244/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323244/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6dbec3b4063441de92df10b47c7b78f3 Test failure: test_daemon_restart (tasks.cephadm_cases.test_cli.TestCephadmCLI) [7323517] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/e2e} ----------------------------------------------------------------- time: 00:27:01 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323517/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323517/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fa4f23ff4beb49ea8e2ba18492bc4c91 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi005 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e0eff22ec7bdb679a2fe274cc1427a1b9c6818aa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7323680] rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}} ----------------------------------------------------------------- time: 00:10:34 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323680/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323680/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e27285ad47374bf682cfc8bd5b1429b7 Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi143 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e0eff22ec7bdb679a2fe274cc1427a1b9c6818aa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7323727] rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04}} ----------------------------------------------------------------- time: 00:10:20 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323727/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323727/ sentry: https://sentry.ceph.com/organizations/ceph/?query=76bb07c4894a401bb646da86bab898ff Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi120 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e0eff22ec7bdb679a2fe274cc1427a1b9c6818aa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7323750] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/e2e} ----------------------------------------------------------------- time: 00:27:11 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323750/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323750/ sentry: https://sentry.ceph.com/organizations/ceph/?query=01a5832bb12c492bb0c1024833af1f3b Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi162 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e0eff22ec7bdb679a2fe274cc1427a1b9c6818aa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7323760] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:00 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323760/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323760/ sentry: https://sentry.ceph.com/organizations/ceph/?query=46c4dbfd96514c5c83b7155b953256a7 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' Pass ================================================================= [7323135] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:51:57 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323135/ [7323137] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:28:13 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323137/ [7323139] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:19:09 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323139/ [7323141] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:13:35 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323141/ [7323143] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:37:22 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323143/ [7323145] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos} time: 00:15:32 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323145/ [7323147] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:21:26 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323147/ [7323149] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:18:44 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323149/ [7323151] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:19:14 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323151/ [7323153] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:42 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323153/ [7323155] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:28:52 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323155/ [7323157] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{ubuntu_latest}} time: 00:10:15 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323157/ [7323159] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:26:35 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323159/ [7323161] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:21:06 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323161/ [7323163] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:24:47 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323163/ [7323165] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:19:04 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323165/ [7323167] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:01 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323167/ [7323169] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache} time: 00:13:27 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323169/ [7323171] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:08 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323171/ [7323173] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} tasks/libcephsqlite} time: 00:15:02 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323173/ [7323176] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:17:24 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323176/ [7323179] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:24:57 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323179/ [7323182] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} time: 02:08:47 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323182/ [7323185] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:13:37 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323185/ [7323188] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:34:34 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323188/ [7323191] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:17:05 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323191/ [7323194] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/scrub} time: 02:47:11 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323194/ [7323197] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_8} tasks/workunits} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323197/ [7323200] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:20:20 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323200/ [7323203] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} time: 00:12:02 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323203/ [7323206] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:31 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323206/ [7323209] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:36 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323209/ [7323211] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:10:07 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323211/ [7323214] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} time: 00:32:01 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323214/ [7323217] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs} time: 00:32:24 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323217/ [7323220] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/dedup-io-snaps} time: 00:14:10 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323220/ [7323223] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:18:02 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323223/ [7323226] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:29:45 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323226/ [7323229] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04}} time: 00:28:28 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323229/ [7323232] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:24:22 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323232/ [7323235] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323235/ [7323238] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:29:23 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323238/ [7323241] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:29:31 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323241/ [7323247] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:24:30 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323247/ [7323250] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:33:01 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323250/ [7323253] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:21 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323253/ [7323256] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:27:05 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323256/ [7323260] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:45:05 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323260/ [7323263] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:57 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323263/ [7323266] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:20 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323266/ [7323269] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:22 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323269/ [7323272] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:32:02 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323272/ [7323275] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}} time: 00:08:56 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323275/ [7323278] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/dashboard} time: 01:07:21 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323278/ [7323281] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_20.04} tasks/crash} time: 00:11:50 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323281/ [7323284] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:43:46 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323284/ [7323286] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:16:05 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323286/ [7323290] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:20:39 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323290/ [7323293] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/c2c} time: 00:14:05 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323293/ [7323297] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:30:37 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323297/ [7323300] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:23:43 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323300/ [7323303] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:15:56 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323303/ [7323306] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} time: 00:28:20 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323306/ [7323309] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:44 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323309/ [7323312] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:17:34 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323312/ [7323315] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:38:06 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323315/ [7323318] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:17:46 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323318/ [7323321] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:14:38 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323321/ [7323324] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:14:37 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323324/ [7323327] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/one workloads/snaps-few-objects} time: 00:35:26 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323327/ [7323330] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:23:04 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323330/ [7323333] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:16:21 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323333/ [7323336] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:12:48 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323336/ [7323339] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} tasks/mon_clock_with_skews} time: 00:09:09 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323339/ [7323342] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench} time: 00:28:09 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323342/ [7323345] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:27:42 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323345/ [7323348] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:11:43 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323348/ [7323351] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:06 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323351/ [7323354] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:18:41 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323354/ [7323357] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:20:05 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323357/ [7323360] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:45 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323360/ [7323363] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:29:28 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323363/ [7323366] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_rgw_multisite} time: 00:20:15 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323366/ [7323369] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:49 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323369/ [7323372] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:15:40 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323372/ [7323375] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:13:09 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323375/ [7323378] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} time: 00:33:15 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323378/ [7323381] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:23 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323381/ [7323384] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:13:42 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323384/ [7323387] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:24 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323387/ [7323390] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:14:24 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323390/ [7323393] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:15:48 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323393/ [7323396] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:35:42 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323396/ [7323399] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:50:43 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323399/ [7323402] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:17:42 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323402/ [7323405] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:25:55 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323405/ [7323408] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}} time: 00:15:18 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323408/ [7323411] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_set_mon_crush_locations} time: 00:29:41 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323411/ [7323414] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:37 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323414/ [7323417] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:14:01 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323417/ [7323420] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:14:12 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323420/ [7323423] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:14:40 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323423/ [7323427] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/sync-many workloads/pool-create-delete} time: 00:18:37 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323427/ [7323430] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:21:03 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323430/ [7323433] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} tasks/mon_recovery} time: 00:23:37 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323433/ [7323436] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:55 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323436/ [7323439] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_adoption} time: 00:16:04 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323439/ [7323442] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:18:07 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323442/ [7323445] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:14:36 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323445/ [7323448] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:20:59 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323448/ [7323451] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:15:13 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323451/ [7323454] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:34 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323454/ [7323457] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:18:21 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323457/ [7323460] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:29 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323460/ [7323463] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:25:52 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323463/ [7323466] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:24:32 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323466/ [7323469] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:26:46 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323469/ [7323472] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:23:23 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323472/ [7323475] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} time: 01:27:50 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323475/ [7323478] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:50 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323478/ [7323481] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm} time: 00:19:36 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323481/ [7323484] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:49 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323484/ [7323487] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:38:53 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323487/ [7323490] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}} time: 00:16:07 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323490/ [7323493] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:34 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323493/ [7323496] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:24:08 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323496/ [7323499] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:21:54 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323499/ [7323502] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:30 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323502/ [7323505] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:18:55 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323505/ [7323508] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:14:53 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323508/ [7323511] rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:33 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323511/ [7323514] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:44 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323514/ [7323520] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:40 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323520/ [7323523] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 01:45:42 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323523/ [7323526] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:30:46 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323526/ [7323529] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_5925} time: 00:19:15 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323529/ [7323532] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:09:01 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323532/ [7323534] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} tasks/rados_striper} time: 00:10:02 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323534/ [7323536] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:17:09 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323536/ [7323538] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:10:41 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323538/ [7323540] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:15:33 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323540/ [7323542] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:28:39 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323542/ [7323544] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:34:08 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323544/ [7323546] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:20:33 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323546/ [7323548] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:17:44 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323548/ [7323551] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:16:48 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323551/ [7323554] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/mgr} time: 00:16:42 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323554/ [7323557] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:13:17 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323557/ [7323560] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 01:46:04 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323560/ [7323564] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:58 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323564/ [7323567] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:13:14 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323567/ [7323570] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:54 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323570/ [7323573] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:27:17 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323573/ [7323576] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:22:43 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323576/ [7323579] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:19:36 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323579/ [7323582] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:16:05 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323582/ [7323585] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:20:34 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323585/ [7323588] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:23:31 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323588/ [7323591] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:37:25 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323591/ [7323594] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:34:39 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323594/ [7323597] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:24:33 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323597/ [7323600] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:28:07 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323600/ [7323603] rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:16:46 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323603/ [7323605] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:37:01 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323605/ [7323607] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:20 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323607/ [7323609] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:24:08 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323609/ [7323611] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_nfs} time: 00:34:58 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323611/ [7323613] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:34:21 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323613/ [7323615] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}} time: 00:22:19 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323615/ [7323617] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:31:34 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323617/ [7323619] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{rhel_8} tasks/per_module_finisher_stats} time: 00:16:34 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323619/ [7323621] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:24:40 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323621/ [7323623] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:21:05 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323623/ [7323625] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:24:27 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323625/ [7323627] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:19:07 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323627/ [7323629] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:17:28 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323629/ [7323631] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:20:59 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323631/ [7323633] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/misc} time: 01:07:47 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323633/ [7323635] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 00:14:57 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323635/ [7323637] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:12 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323637/ [7323639] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:11 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323639/ [7323641] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:22:54 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323641/ [7323643] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:34 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323643/ [7323645] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}} time: 00:20:32 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323645/ [7323647] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:23:50 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323647/ [7323649] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:29:45 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323649/ [7323651] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli} time: 00:20:49 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323651/ [7323652] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:21:38 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323652/ [7323653] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:34:55 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323653/ [7323654] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:32:47 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323654/ [7323655] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:28:53 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323655/ [7323656] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:16:31 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323656/ [7323657] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:27 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323657/ [7323658] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:15:40 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323658/ [7323659] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:06 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323659/ [7323660] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:15:09 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323660/ [7323661] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:40:49 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323661/ [7323662] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/progress} time: 00:27:38 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323662/ [7323663] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:37:31 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323663/ [7323664] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:13:56 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323664/ [7323665] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:12:07 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323665/ [7323666] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:48 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323666/ [7323667] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 01:00:05 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323667/ [7323668] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:27:49 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323668/ [7323669] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:02 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323669/ [7323670] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:56 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323670/ [7323671] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:25:11 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323671/ [7323672] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} tasks/rados_workunit_loadgen_mostlyread} time: 00:30:03 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323672/ [7323673] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/dashboard} time: 01:07:34 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323673/ [7323674] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:21:39 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323674/ [7323675] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon-stretch} time: 00:21:48 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323675/ [7323676] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:38:28 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323676/ [7323677] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_rgw_multisite} time: 00:18:46 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323677/ [7323678] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:26:46 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323678/ [7323679] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:13:31 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323679/ [7323681] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:26 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323681/ [7323682] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:30:21 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323682/ [7323683] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:41 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323683/ [7323684] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:17:19 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323684/ [7323685] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:40:41 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323685/ [7323686] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:17:05 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323686/ [7323687] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:56:20 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323687/ [7323688] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:26:58 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323688/ [7323689] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:14:43 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323689/ [7323690] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:49 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323690/ [7323691] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:13:52 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323691/ [7323692] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:07:47 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323692/ [7323693] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:14:09 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323693/ [7323694] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}} time: 00:33:54 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323694/ [7323695] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:43 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323695/ [7323696] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} time: 02:41:54 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323696/ [7323697] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:29:00 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323697/ [7323698] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:15:41 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323698/ [7323699] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:55 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323699/ [7323700] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:15:47 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323700/ [7323701] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:18:31 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323701/ [7323702] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} time: 00:37:02 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323702/ [7323703] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:25:43 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323703/ [7323704] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} time: 01:11:09 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323704/ [7323705] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} time: 00:14:43 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323705/ [7323706] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} tasks/mon_clock_no_skews} time: 00:09:18 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323706/ [7323707] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_adoption} time: 00:24:33 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323707/ [7323708] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:48 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323708/ [7323709] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:51 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323709/ [7323710] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:23:11 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323710/ [7323711] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:14:12 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323711/ [7323712] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup-io-mixed} time: 00:15:14 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323712/ [7323713] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:16 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323713/ [7323714] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:30:16 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323714/ [7323715] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:02 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323715/ [7323716] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:14:12 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323716/ [7323717] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:40 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323717/ [7323718] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/repair_test} time: 00:19:09 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323718/ [7323719] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:46 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323719/ [7323720] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:15:30 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323720/ [7323721] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_20.04} tasks/workunits} time: 00:10:03 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323721/ [7323722] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-snaps} time: 00:30:20 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323722/ [7323723] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:27 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323723/ [7323724] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:01 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323724/ [7323725] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:27:55 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323725/ [7323726] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:20:23 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323726/ [7323728] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm} time: 00:22:11 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323728/ [7323729] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:19:15 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323729/ [7323730] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:27:26 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323730/ [7323731] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:50 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323731/ [7323732] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:48 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323732/ [7323733] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:36 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323733/ [7323734] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd-backfill} time: 02:36:53 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323734/ [7323735] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:43:01 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323735/ [7323736] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:17:42 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323736/ [7323737] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:18 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323737/ [7323738] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_8}} time: 00:13:16 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323738/ [7323739] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} tasks/mon_clock_with_skews} time: 00:08:49 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323739/ [7323740] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:32:37 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323740/ [7323741] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:26:39 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323741/ [7323742] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:13:51 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323742/ [7323743] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:13:49 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323743/ [7323744] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:14:15 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323744/ [7323745] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos} time: 00:07:15 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323745/ [7323746] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:18:15 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323746/ [7323747] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:27:05 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323747/ [7323748] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:03 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323748/ [7323749] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:24:58 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323749/ [7323751] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_20.04} tasks/crash} time: 00:11:50 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323751/ [7323752] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:11 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323752/ [7323753] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:18:30 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323753/ [7323754] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:24:47 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323754/ [7323755] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:23 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323755/ [7323756] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:12:38 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323756/ [7323757] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:15:22 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323757/ [7323758] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:22 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323758/ [7323759] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench} time: 00:50:17 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323759/ [7323761] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 00:50:45 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323761/ [7323762] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:18:16 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323762/ [7323763] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:21:08 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323763/ [7323764] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:13:58 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323764/ [7323765] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/osd} time: 02:37:21 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323765/ [7323766] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} tasks/libcephsqlite} time: 00:15:34 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323766/ [7323767] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:14:49 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323767/ [7323768] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect} time: 00:18:32 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323768/ [7323769] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:17:21 info: http://pulpito.ceph.com/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323769/