2024-01-12T16:49:49.980 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-12T16:49:49.980 INFO:teuthology.results:subset: '111/120000' 2024-01-12T16:49:49.980 INFO:teuthology.results:seed: '3650' 2024-01-13T01:18:26.091 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-13T01:18:26.119 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-01-13T09:41:12.776 INFO:teuthology.results:Tests finished! gathering results... 2024-01-13T09:41:38.154 INFO:scrape:Found 317 jobs 2024-01-13T09:41:43.216 INFO:scrape:Found 7 distinct failure reasons 2024-01-13T09:41:43.217 INFO:scrape:Failure: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-01-13T09:41:43.217 INFO:scrape:5 jobs: ['7514421', '7514504', '7514505', '7514274', '7514794'] 2024-01-13T09:41:43.217 INFO:scrape:suites intersection: [] 2024-01-13T09:41:43.217 INFO:scrape:suites union: ['2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'validater/valgrind}'] 2024-01-13T09:41:43.217 INFO:scrape: 2024-01-13T09:41:43.217 INFO:scrape:Failure: Command failed on smithi157 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 2.36 deep_scrub' 2024-01-13T09:41:43.217 INFO:scrape:2 jobs: ['7514583', '7514385'] 2024-01-13T09:41:43.217 INFO:scrape:suites intersection: ['rados', 'supported-random-distro$/{ubuntu_latest}}'] 2024-01-13T09:41:43.217 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'msgr-failures/many', 'msgr/async-v1only', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton-nomsgr/{all/cache-fs-trunc', 'rados/singleton/{all/recovery-preemption', 'supported-random-distro$/{ubuntu_latest}}'] 2024-01-13T09:41:43.218 INFO:scrape: 2024-01-13T09:41:43.218 INFO:scrape:Failure: reached maximum tries (51) after waiting for 300 seconds 2024-01-13T09:41:43.218 INFO:scrape:1 jobs: ['7514648'] 2024-01-13T09:41:43.218 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_cls_all', 'validater/valgrind}'] 2024-01-13T09:41:43.218 INFO:scrape: 2024-01-13T09:41:43.218 INFO:scrape:Dead: b'2024-01-13T05:52:17.572 DEBUG:teuthology.exit:Finished running handlers' 2024-01-13T09:41:43.218 INFO:scrape:2 jobs: ['7514349', '7514616'] 2024-01-13T09:41:43.218 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'supported-random-distro$/{centos_latest}}'] 2024-01-13T09:41:43.218 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'supported-random-distro$/{centos_latest}}'] 2024-01-13T09:41:43.218 INFO:scrape: 2024-01-13T09:41:43.218 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' 2024-01-13T09:41:43.219 INFO:scrape:2 jobs: ['7514493', '7514796'] 2024-01-13T09:41:43.219 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{ubuntu_latest}}'] 2024-01-13T09:41:43.219 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{ubuntu_latest}}'] 2024-01-13T09:41:43.219 INFO:scrape: 2024-01-13T09:41:43.219 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm_timeout.py) on smithi115 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm_timeout.py' 2024-01-13T09:41:43.219 INFO:scrape:1 jobs: ['7514502'] 2024-01-13T09:41:43.219 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm_timeout}'] 2024-01-13T09:41:43.219 INFO:scrape: 2024-01-13T09:41:43.219 INFO:scrape:Failure: Command failed (workunit test scrub/osd-scrub-test.sh) on smithi115 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh' 2024-01-13T09:41:43.219 INFO:scrape:1 jobs: ['7514284'] 2024-01-13T09:41:43.219 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{centos_latest}', 'workloads/scrub}'] 2024-01-13T09:41:43.220 INFO:scrape: 2024-01-13T09:41:43.230 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/ failed: 12 dead: 2 running: 0 waiting: 0 queued: 0 passed: 303 Fail ================================================================= [7514274] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 01:45:21 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514274/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514274/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7514284] rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub} ----------------------------------------------------------------- time: 02:02:55 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514284/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514284/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f987f97b19b34ed3a81648fd471897fb Command failed (workunit test scrub/osd-scrub-test.sh) on smithi115 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh' [7514385] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:13:10 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514385/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514385/ Command failed on smithi073 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 2.1f deep_scrub' [7514421] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:57:45 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514421/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514421/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7514493] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:09:37 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514493/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514493/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cd27a38c51fd4c2d9d35842e163a2627 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7514502] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_timeout} ----------------------------------------------------------------- time: 00:36:25 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514502/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514502/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4707628a9be14758bdd4afce8808fd13 Command failed (workunit test cephadm/test_cephadm_timeout.py) on smithi115 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_cephadm_timeout.py' [7514504] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} ----------------------------------------------------------------- time: 00:15:55 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514504/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514504/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7514505] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:30:45 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514505/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514505/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7514583] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:16:22 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514583/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514583/ Command failed on smithi157 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 2.36 deep_scrub' [7514648] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 01:49:10 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514648/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514648/ reached maximum tries (51) after waiting for 300 seconds [7514794] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 01:03:44 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514794/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514794/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7514796] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:09:28 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514796/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514796/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fbe35e1e5896493f88dc198e582c1ca1 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' Dead ================================================================= [7514349] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514349/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514349/ hit max job timeout [7514616] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514616/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514616/ hit max job timeout Pass ================================================================= [7514270] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:18:55 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514270/ [7514272] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/libcephsqlite} time: 00:11:37 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514272/ [7514276] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_extra_daemon_features} time: 00:18:17 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514276/ [7514278] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:13:14 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514278/ [7514280] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:20:13 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514280/ [7514282] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:12 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514282/ [7514286] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_latest} tasks/workunits} time: 00:08:40 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514286/ [7514288] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:42:14 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514288/ [7514290] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} time: 00:10:34 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514290/ [7514292] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:17 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514292/ [7514294] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:22:59 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514294/ [7514296] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:08:14 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514296/ [7514298] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_host_drain} time: 00:22:08 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514298/ [7514300] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} time: 00:33:21 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514300/ [7514302] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:07:30 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514302/ [7514304] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/dedup-io-snaps} time: 00:13:51 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514304/ [7514306] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:10:00 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514306/ [7514308] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:53 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514308/ [7514310] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:24:28 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514310/ [7514312] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:10:01 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514312/ [7514314] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:33:53 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514314/ [7514316] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:14:51 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514316/ [7514318] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:13:12 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514318/ [7514320] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/rados_api_tests} time: 00:41:56 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514320/ [7514322] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:27:55 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514322/ [7514324] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:25:32 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514324/ [7514326] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:08:52 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514326/ [7514328] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:12:35 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514328/ [7514330] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:33:24 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514330/ [7514332] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:11 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514332/ [7514334] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:26:49 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514334/ [7514335] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:29:15 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514335/ [7514337] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_monitoring_stack_basic} time: 00:20:34 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514337/ [7514339] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:30:21 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514339/ [7514341] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} time: 01:23:27 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514341/ [7514343] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:12:00 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514343/ [7514345] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_latest}} time: 00:35:30 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514345/ [7514347] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:11:40 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514347/ [7514351] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} time: 00:14:46 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514351/ [7514353] rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:57:11 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514353/ [7514355] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:19:34 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514355/ [7514357] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:11:22 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514357/ [7514359] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:18 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514359/ [7514361] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:07:52 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514361/ [7514363] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:54 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514363/ [7514365] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:42:43 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514365/ [7514367] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:08:52 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514367/ [7514369] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:17:06 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514369/ [7514371] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:13:42 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514371/ [7514373] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/one workloads/snaps-few-objects} time: 00:33:52 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514373/ [7514375] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:11:50 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514375/ [7514377] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:21:44 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514377/ [7514379] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_orch_cli} time: 00:20:36 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514379/ [7514381] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:10:19 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514381/ [7514383] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:32 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514383/ [7514387] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench} time: 00:26:16 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514387/ [7514389] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:19:49 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514389/ [7514391] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:12:49 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514391/ [7514393] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:14:01 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514393/ [7514395] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:08:22 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514395/ [7514397] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli_mon} time: 00:29:17 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514397/ [7514399] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:14:22 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514399/ [7514401] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:28:50 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514401/ [7514403] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:12:22 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514403/ [7514405] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:07 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514405/ [7514407] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_latest} tasks/failover} time: 00:18:22 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514407/ [7514409] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:14:00 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514409/ [7514411] rados/standalone/{supported-random-distro$/{centos_latest} workloads/crush} time: 00:19:44 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514411/ [7514413] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:13:08 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514413/ [7514415] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:06:55 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514415/ [7514417] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:16:51 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514417/ [7514419] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:11:27 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514419/ [7514423] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_rgw_multisite} time: 00:19:10 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514423/ [7514425] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:16:57 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514425/ [7514427] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:10:04 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514427/ [7514429] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:00 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514429/ [7514431] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_set_mon_crush_locations} time: 00:39:07 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514431/ [7514433] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:54 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514433/ [7514435] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:16:13 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514435/ [7514437] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:15:43 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514437/ [7514438] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:09:49 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514438/ [7514440] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:32 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514440/ [7514442] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:16:39 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514442/ [7514444] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:26 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514444/ [7514446] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:22:00 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514446/ [7514448] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:27:40 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514448/ [7514450] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption} time: 00:32:34 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514450/ [7514452] rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:15:38 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514452/ [7514454] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:17:52 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514454/ [7514455] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:13:45 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514455/ [7514456] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:36 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514456/ [7514457] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:31 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514457/ [7514458] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_latest} tasks/insights} time: 00:10:51 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514458/ [7514459] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/rados_stress_watch} time: 00:14:02 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514459/ [7514460] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:22:48 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514460/ [7514461] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:19:28 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514461/ [7514462] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:19:32 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514462/ [7514463] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:19:08 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514463/ [7514464] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_ca_signed_key} time: 00:18:07 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514464/ [7514465] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 01:31:15 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514465/ [7514466] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:18 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514466/ [7514467] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:07:51 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514467/ [7514468] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:11 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514468/ [7514469] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:33:39 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514469/ [7514470] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:20:58 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514470/ [7514471] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:17:12 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514471/ [7514472] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:20:46 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514472/ [7514473] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:05 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514473/ [7514474] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm} time: 00:18:44 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514474/ [7514475] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:36:50 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514475/ [7514476] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:24 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514476/ [7514477] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:13:56 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514477/ [7514478] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:14:04 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514478/ [7514479] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:14:55 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514479/ [7514480] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} tasks/e2e} time: 00:45:43 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514480/ [7514481] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:21:44 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514481/ [7514482] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_5925} time: 00:09:35 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514482/ [7514483] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:22 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514483/ [7514484] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos} time: 00:07:09 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514484/ [7514485] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:11:21 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514485/ [7514486] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} time: 00:08:01 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514486/ [7514487] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:09:44 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514487/ [7514488] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:43 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514488/ [7514489] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_latest} tasks/module_selftest} time: 00:22:44 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514489/ [7514490] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:20:46 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514490/ [7514491] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:28:18 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514491/ [7514492] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_latest}} time: 00:11:51 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514492/ [7514494] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:16:36 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514494/ [7514495] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:18:07 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514495/ [7514496] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:14:21 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514496/ [7514497] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 01:23:35 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514497/ [7514498] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:11:48 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514498/ [7514499] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:52 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514499/ [7514500] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:24:05 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514500/ [7514501] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:04 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514501/ [7514503] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:17:43 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514503/ [7514507] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:00 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514507/ [7514509] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:34:34 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514509/ [7514511] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:54 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514511/ [7514513] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:14:04 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514513/ [7514515] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:30:26 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514515/ [7514517] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_big} time: 00:29:24 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514517/ [7514519] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_extra_daemon_features} time: 00:32:10 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514519/ [7514521] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:08:01 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514521/ [7514523] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:41:42 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514523/ [7514525] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:17:18 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514525/ [7514527] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_host_drain} time: 00:22:10 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514527/ [7514529] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:28:36 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514529/ [7514531] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:13:31 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514531/ [7514533] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/per_module_finisher_stats} time: 00:11:04 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514533/ [7514535] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:22:34 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514535/ [7514537] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:19:53 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514537/ [7514539] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} time: 00:07:11 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514539/ [7514541] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:10 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514541/ [7514543] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:29 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514543/ [7514545] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:18:00 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514545/ [7514547] rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc} time: 01:03:25 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514547/ [7514549] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 00:13:00 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514549/ [7514551] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:50 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514551/ [7514553] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:27:36 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514553/ [7514555] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:19:43 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514555/ [7514557] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:56 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514557/ [7514559] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:15:40 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514559/ [7514561] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:09:00 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514561/ [7514563] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mix} time: 00:19:31 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514563/ [7514565] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:38:13 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514565/ [7514567] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:21:27 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514567/ [7514569] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:15:03 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514569/ [7514571] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} time: 00:24:29 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514571/ [7514573] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:24:21 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514573/ [7514575] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:04 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514575/ [7514577] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:10:27 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514577/ [7514579] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:14:05 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514579/ [7514581] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:12:14 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514581/ [7514585] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:12:19 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514585/ [7514587] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:31:23 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514587/ [7514589] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:22:06 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514589/ [7514591] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:34 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514591/ [7514594] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:09:38 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514594/ [7514595] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:19:42 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514595/ [7514597] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:58:10 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514597/ [7514599] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:19:24 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514599/ [7514602] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:40 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514602/ [7514604] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:25:06 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514604/ [7514606] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli} time: 00:15:24 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514606/ [7514608] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:16:44 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514608/ [7514610] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:27:05 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514610/ [7514612] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:24:04 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514612/ [7514614] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/dashboard} time: 01:21:54 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514614/ [7514618] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon-stretch} time: 00:25:22 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514618/ [7514620] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:45:27 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514620/ [7514622] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:22:58 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514622/ [7514624] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:11:41 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514624/ [7514626] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:27:35 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514626/ [7514628] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:12:14 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514628/ [7514630] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:17:21 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514630/ [7514632] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:56 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514632/ [7514634] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:42 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514634/ [7514636] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:26 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514636/ [7514638] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:08:50 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514638/ [7514640] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:13:32 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514640/ [7514642] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:18:51 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514642/ [7514644] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:06 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514644/ [7514646] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:05 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514646/ [7514650] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:26 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514650/ [7514652] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:12:29 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514652/ [7514654] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 01:55:08 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514654/ [7514656] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} time: 02:34:06 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514656/ [7514658] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_rgw_multisite} time: 00:21:33 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514658/ [7514660] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:17:05 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514660/ [7514662] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/readwrite} time: 00:10:35 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514662/ [7514664] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:24 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514664/ [7514666] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:14:20 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514666/ [7514668] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:47:41 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514668/ [7514670] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:21:47 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514670/ [7514672] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits} time: 00:31:30 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514672/ [7514674] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} time: 01:06:55 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514674/ [7514676] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} time: 00:13:23 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514676/ [7514678] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:06:54 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514678/ [7514680] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} time: 00:07:56 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514680/ [7514682] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:45 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514682/ [7514684] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:30:53 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514684/ [7514686] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} time: 00:10:53 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514686/ [7514688] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:19:02 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514688/ [7514690] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:11 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514690/ [7514692] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:12:05 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514692/ [7514694] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:07:31 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514694/ [7514696] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/dedup-io-mixed} time: 00:11:37 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514696/ [7514698] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:59 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514698/ [7514700] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:20:02 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514700/ [7514702] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:21:23 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514702/ [7514704] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:16 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514704/ [7514706] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/repair_test} time: 00:16:48 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514706/ [7514708] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:14:02 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514708/ [7514710] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_latest} tasks/workunits} time: 00:08:33 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514710/ [7514712] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:08:17 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514712/ [7514714] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_ca_signed_key} time: 00:15:09 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514714/ [7514716] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/dedup-io-snaps} time: 00:12:47 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514716/ [7514718] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:47 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514718/ [7514720] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:18:46 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514720/ [7514722] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:11:46 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514722/ [7514724] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:10:03 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514724/ [7514726] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm} time: 00:16:02 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514726/ [7514728] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:07:21 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514728/ [7514730] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:23:43 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514730/ [7514732] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:01 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514732/ [7514734] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} time: 00:07:26 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514734/ [7514736] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd-backfill} time: 02:25:54 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514736/ [7514738] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:34:00 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514738/ [7514740] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:17:10 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514740/ [7514742] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:49 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514742/ [7514744] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:18 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514744/ [7514746] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} time: 00:08:42 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514746/ [7514748] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:09:35 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514748/ [7514750] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:16 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514750/ [7514752] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:30:27 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514752/ [7514754] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:19:41 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514754/ [7514756] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:13:07 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514756/ [7514758] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:09:39 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514758/ [7514760] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/scrub_test} time: 00:09:45 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514760/ [7514762] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 01:14:00 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514762/ [7514764] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:09:37 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514764/ [7514766] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_timeout} time: 00:19:23 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514766/ [7514768] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:12:15 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514768/ [7514770] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:21:57 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514770/ [7514772] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:53 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514772/ [7514774] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:18:44 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514774/ [7514776] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} tasks/e2e} time: 00:24:19 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514776/ [7514778] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_latest} tasks/crash} time: 00:10:03 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514778/ [7514780] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:23:19 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514780/ [7514782] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:13:44 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514782/ [7514784] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:51 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514784/ [7514786] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:11:53 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514786/ [7514788] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:12 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514788/ [7514790] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:08:58 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514790/ [7514792] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:12:42 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514792/ [7514798] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:13:11 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514798/ [7514800] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:13:47 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514800/ [7514802] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:11:21 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514802/ [7514804] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} time: 02:29:30 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514804/ [7514806] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/libcephsqlite} time: 00:11:32 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514806/ [7514808] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:13:46 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514808/ [7514810] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_extra_daemon_features} time: 00:17:59 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514810/ [7514812] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_5925} time: 00:09:47 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514812/ [7514814] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:23 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514814/ [7514816] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:11:24 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514816/ [7514818] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_host_drain} time: 00:17:21 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514818/ [7514820] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:12:07 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514820/ [7514822] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:26:34 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514822/ [7514824] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:14:59 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514824/ [7514826] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:14:32 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514826/ [7514828] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:14:43 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514828/ [7514830] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:13:23 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514830/ [7514832] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:14:59 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514832/ [7514834] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/reef backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:19:46 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514834/ [7514836] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:14 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514836/ [7514838] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{centos_latest}} time: 00:06:50 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514838/ [7514840] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:23:35 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514840/ [7514842] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:15:41 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514842/ [7514845] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:13:08 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514845/ [7514847] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:15:00 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514847/ [7514849] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:18:56 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514849/ [7514851] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:45:53 info: https://pulpito.ceph.com/yuriw-2024-01-12_15:18:20-rados-main-distro-default-smithi/7514851/