2024-03-01T21:59:06.614 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-03-01T21:59:06.614 INFO:teuthology.results:subset: '111/120000' 2024-03-01T21:59:06.614 INFO:teuthology.results:seed: '3018' 2024-03-02T04:53:25.650 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-03-02T04:53:25.683 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-03-02T14:29:23.970 INFO:teuthology.results:Tests finished! gathering results... 2024-03-02T14:29:47.957 INFO:scrape:Found 294 jobs 2024-03-02T14:29:50.711 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578434/teuthology.log 2024-03-02T14:29:54.911 INFO:scrape:Found 11 distinct failure reasons 2024-03-02T14:29:54.911 INFO:scrape:Failure: failed to complete snap trimming before timeout 2024-03-02T14:29:54.911 INFO:scrape:2 jobs: ['7578029', '7578422'] 2024-03-02T14:29:54.911 INFO:scrape:suites intersection: ['0-start', '1-tasks', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default'] 2024-03-02T14:29:54.912 INFO:scrape:suites union: ['0-start', '1-tasks', 'mon_election/classic', 'mon_election/connectivity', 'rados/upgrade/parallel/{0-random-distro$/{centos_9.stream}', 'rados/upgrade/parallel/{0-random-distro$/{ubuntu_22.04}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default'] 2024-03-02T14:29:54.912 INFO:scrape: 2024-03-02T14:29:54.912 INFO:scrape:Failure: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-03-02T14:29:54.912 INFO:scrape:6 jobs: ['7578080', '7578264', '7578267', '7577992', '7578661', '7578461'] 2024-03-02T14:29:54.912 INFO:scrape:suites intersection: [] 2024-03-02T14:29:54.912 INFO:scrape:suites union: ['2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'validater/valgrind}'] 2024-03-02T14:29:54.912 INFO:scrape: 2024-03-02T14:29:54.913 INFO:scrape:Failure: Command failed (workunit test scrub/osd-scrub-repair.sh) on smithi129 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=efb04e5e69d058b0c47e511cb7e10d57a92f59ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh' 2024-03-02T14:29:54.913 INFO:scrape:1 jobs: ['7577997'] 2024-03-02T14:29:54.913 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{centos_latest}', 'workloads/scrub}'] 2024-03-02T14:29:54.913 INFO:scrape: 2024-03-02T14:29:54.913 INFO:scrape:Dead: None 2024-03-02T14:29:54.913 INFO:scrape:3 jobs: ['7578434', '7578037', '7578664'] 2024-03-02T14:29:54.913 INFO:scrape: 2024-03-02T14:29:54.913 INFO:scrape:Dead: b'2024-03-02T10:33:13.826 DEBUG:teuthology.exit:Finished running handlers' 2024-03-02T14:29:54.913 INFO:scrape:2 jobs: ['7578027', '7578416'] 2024-03-02T14:29:54.914 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/admin_socket_output'] 2024-03-02T14:29:54.914 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}'] 2024-03-02T14:29:54.914 INFO:scrape: 2024-03-02T14:29:54.914 INFO:scrape:Failure: Command failed on smithi184 with status 100: 'sudo apt-get clean' 2024-03-02T14:29:54.914 INFO:scrape:5 jobs: ['7578643', '7578347', '7578524', '7578090', '7577998'] 2024-03-02T14:29:54.914 INFO:scrape:suites intersection: [] 2024-03-02T14:29:54.914 INFO:scrape:suites union: ['agent/on', 'ceph', 'clusters/{fixed-2', 'fast/normal', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'openstack}', 'rados', 'rados/cephadm/workunits/{0-distro/ubuntu_22.04', 'rados/objectstore/{backends/objectcacher-stress', 'rados/singleton-nomsgr/{all/ceph-snapmapper', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'task/test_ca_signed_key}', 'thrashers/minsize_recovery', 'thrashosds-health', 'workloads/ec-snaps-few-objects-overwrites}'] 2024-03-02T14:29:54.914 INFO:scrape: 2024-03-02T14:29:54.914 INFO:scrape:Failure: Command failed (workunit test mon/test_mon_osdmap_prune.sh) on smithi083 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=efb04e5e69d058b0c47e511cb7e10d57a92f59ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh' 2024-03-02T14:29:54.915 INFO:scrape:1 jobs: ['7578392'] 2024-03-02T14:29:54.915 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/mon-delay', 'msgr/async-v1only', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{centos_latest}', 'thrashers/many', 'workloads/rados_mon_osdmap_prune}'] 2024-03-02T14:29:54.915 INFO:scrape: 2024-03-02T14:29:54.915 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' 2024-03-02T14:29:54.915 INFO:scrape:2 jobs: ['7578230', '7578667'] 2024-03-02T14:29:54.915 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output'] 2024-03-02T14:29:54.915 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}'] 2024-03-02T14:29:54.915 INFO:scrape: 2024-03-02T14:29:54.915 INFO:scrape:Failure: reached maximum tries (51) after waiting for 300 seconds 2024-03-02T14:29:54.915 INFO:scrape:1 jobs: ['7578559'] 2024-03-02T14:29:54.915 INFO:scrape:suites: ['2-inject-leak/osd', 'centos_latest}', 'rados/valgrind-leaks/{1-start'] 2024-03-02T14:29:54.916 INFO:scrape: 2024-03-02T14:29:54.916 INFO:scrape:Failure: SSH connection to smithi131 was lost: 'sudo yum install -y kernel' 2024-03-02T14:29:54.916 INFO:scrape:1 jobs: ['7578580'] 2024-03-02T14:29:54.916 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-1}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/read', 'mon_election/connectivity', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_latest}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/snaps-few-objects-localized}'] 2024-03-02T14:29:54.916 INFO:scrape: 2024-03-02T14:29:54.916 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh 2024-03-02T14:29:54.916 INFO:scrape:1 jobs: ['7578002'] 2024-03-02T14:29:54.916 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-1}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/read', 'mon_election/connectivity', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/rados_api_tests}'] 2024-03-02T14:29:54.916 INFO:scrape: 2024-03-02T14:29:54.927 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/ failed: 19 dead: 6 running: 0 waiting: 0 queued: 0 passed: 269 Fail ================================================================= [7577992] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 01:47:49 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577992/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577992/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7577997] rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub} ----------------------------------------------------------------- time: 01:33:23 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577997/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577997/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c5f2d23d790442058a2e0f508910dbc4 Command failed (workunit test scrub/osd-scrub-repair.sh) on smithi129 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=efb04e5e69d058b0c47e511cb7e10d57a92f59ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub- repair.sh' [7577998] rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_ca_signed_key} ----------------------------------------------------------------- time: 00:10:58 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577998/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577998/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4891afa49d084fa4add8b85c4ffb544a Command failed on smithi076 with status 5: 'sudo systemctl stop ceph-f8f227dc-d81a-11ee-95c5-87774f69a715@mon.a' [7578002] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 03:18:59 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578002/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578002/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ffdda0d4052c4eb799f7fe5ab34ec329 Command failed (workunit test rados/test.sh) on smithi029 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=efb04e5e69d058b0c47e511cb7e10d57a92f59ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [7578029] rados/upgrade/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:50:19 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578029/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578029/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c9b89b0a0f77423f92253c9b63b2fd6d failed to complete snap trimming before timeout [7578080] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:59:15 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578080/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578080/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7578090] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:08:01 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578090/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578090/ sentry: https://sentry.ceph.com/organizations/ceph/?query=55fce533a23a4159b4f9c47f67d4cc90 Command failed on smithi060 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_snap_mapper' [7578230] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:09:44 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578230/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578230/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3d73c58f7a0746a988729112738e4289 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7578264] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} ----------------------------------------------------------------- time: 00:17:25 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578264/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578264/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7578267] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:38:52 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578267/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578267/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7578347] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578347/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578347/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e2d7b88f3356410e81013498f9289d69 Command failed on smithi151 with status 1: 'sudo yum install -y kernel' [7578392] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:52:29 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578392/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578392/ sentry: https://sentry.ceph.com/organizations/ceph/?query=080942570aa246c394b0fda15396add5 Command failed (workunit test mon/test_mon_osdmap_prune.sh) on smithi083 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=efb04e5e69d058b0c47e511cb7e10d57a92f59ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh' [7578422] rados/upgrade/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:40:26 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578422/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578422/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe7f734a120540e6b0d7cb46f291cd5f failed to complete snap trimming before timeout [7578461] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 01:48:37 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578461/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578461/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7578524] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:10:17 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578524/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578524/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9d9b60b31f8d472eb93f6a80b37e6ffd Command failed on smithi077 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_snap_mapper' [7578559] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} ----------------------------------------------------------------- time: 00:26:35 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578559/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578559/ reached maximum tries (51) after waiting for 300 seconds [7578643] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578643/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578643/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3a9d94079bc14f8299e8bff122c0618f Command failed on smithi184 with status 100: 'sudo apt-get clean' [7578661] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 01:13:21 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578661/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578661/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7578667] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:08:20 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578667/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578667/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1b734e5b99e84b6bbce7be63f0afcceb Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' Dead ================================================================= [7578027] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578027/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578027/ hit max job timeout [7578037] rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578037/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578037/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7578416] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578416/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578416/ hit max job timeout [7578434] rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578434/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578434/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7578580] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578580/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578580/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d8a9ade13af34828862331bf60524d81 SSH connection to smithi131 was lost: 'sudo yum install -y kernel' [7578664] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578664/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578664/ Error reimaging machines: Failed to power on smithi145 Pass ================================================================= [7577977] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache} time: 00:17:52 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577977/ [7577978] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:12:17 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577978/ [7577979] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:24:37 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577979/ [7577980] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:14:43 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577980/ [7577981] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed} time: 00:13:39 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577981/ [7577982] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:57 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577982/ [7577983] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{centos_latest}} time: 00:07:32 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577983/ [7577984] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:22:04 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577984/ [7577985] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:24:36 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577985/ [7577986] rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:13:53 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577986/ [7577987] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:17:43 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577987/ [7577988] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps} time: 00:16:02 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577988/ [7577989] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:13 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577989/ [7577990] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:15:43 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577990/ [7577991] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:15:30 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577991/ [7577993] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:13:10 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577993/ [7577994] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:23:49 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577994/ [7577995] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:20:32 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577995/ [7577996] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:49 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577996/ [7577999] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:11:16 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7577999/ [7578000] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:32:04 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578000/ [7578001] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:40:55 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578001/ [7578003] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:08:22 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578003/ [7578004] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} time: 00:30:02 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578004/ [7578005] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:09:32 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578005/ [7578006] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:42:38 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578006/ [7578007] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:10:22 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578007/ [7578008] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:24:42 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578008/ [7578009] rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm} time: 00:14:00 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578009/ [7578010] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:19 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578010/ [7578011] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:30:51 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578011/ [7578012] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/radosbench} time: 01:22:05 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578012/ [7578013] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:13:20 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578013/ [7578014] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:45:13 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578014/ [7578015] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:43:37 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578015/ [7578016] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:12 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578016/ [7578017] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:34:11 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578017/ [7578018] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:14:39 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578018/ [7578019] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:24 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578019/ [7578020] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:28:04 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578020/ [7578021] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:36:58 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578021/ [7578022] rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:13:51 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578022/ [7578023] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/dashboard} time: 01:08:50 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578023/ [7578024] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/crash} time: 00:10:27 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578024/ [7578025] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:40:12 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578025/ [7578026] rados/rest/{mgr-restful supported-random-distro$/{centos_latest}} time: 00:09:36 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578026/ [7578028] rados/standalone/{supported-random-distro$/{centos_latest} workloads/c2c} time: 00:14:39 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578028/ [7578030] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:18:52 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578030/ [7578031] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:12:16 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578031/ [7578032] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:19:01 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578032/ [7578033] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:37 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578033/ [7578034] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:10 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578034/ [7578035] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:11:24 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578035/ [7578036] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:53 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578036/ [7578038] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:14:26 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578038/ [7578039] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/one workloads/snaps-few-objects} time: 00:32:40 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578039/ [7578040] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:11:40 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578040/ [7578041] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/rados_cls_all} time: 00:15:36 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578041/ [7578042] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:13:47 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578042/ [7578043] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} time: 00:08:01 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578043/ [7578044] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:20 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578044/ [7578046] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:09:08 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578046/ [7578048] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:09 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578048/ [7578050] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} time: 00:12:40 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578050/ [7578052] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:20:12 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578052/ [7578054] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} time: 00:11:24 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578054/ [7578056] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:08:30 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578056/ [7578058] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:27:34 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578058/ [7578060] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:21:26 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578060/ [7578062] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:12:51 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578062/ [7578064] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:39 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578064/ [7578066] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:15:39 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578066/ [7578068] rados/standalone/{supported-random-distro$/{centos_latest} workloads/crush} time: 00:22:19 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578068/ [7578070] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:13:48 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578070/ [7578072] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:49 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578072/ [7578074] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:06:02 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578074/ [7578076] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:19:58 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578076/ [7578078] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:32:47 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578078/ [7578082] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/rados_python} time: 00:13:31 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578082/ [7578084] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:12:22 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578084/ [7578087] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:58 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578087/ [7578093] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:23:58 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578093/ [7578096] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:15:56 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578096/ [7578099] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_latest}} time: 00:07:45 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578099/ [7578102] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:17:52 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578102/ [7578105] rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:19:14 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578105/ [7578108] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:25:31 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578108/ [7578111] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:45 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578111/ [7578114] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:25:03 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578114/ [7578117] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:24:41 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578117/ [7578120] rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:15:45 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578120/ [7578123] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:13:58 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578123/ [7578126] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:26:11 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578126/ [7578129] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:07:34 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578129/ [7578132] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_latest} tasks/insights} time: 00:11:34 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578132/ [7578135] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/rados_stress_watch} time: 00:14:58 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578135/ [7578138] rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_extra_daemon_features} time: 00:19:11 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578138/ [7578141] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:27:14 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578141/ [7578144] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:14:05 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578144/ [7578147] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:19:40 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578147/ [7578150] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:14:25 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578150/ [7578153] rados/standalone/{supported-random-distro$/{centos_latest} workloads/erasure-code} time: 01:20:48 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578153/ [7578156] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:01 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578156/ [7578159] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:20 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578159/ [7578162] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:34:20 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578162/ [7578165] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:20:41 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578165/ [7578168] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:22:58 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578168/ [7578171] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:16:51 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578171/ [7578174] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:05 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578174/ [7578177] rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:15:12 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578177/ [7578180] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:30:00 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578180/ [7578183] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:33 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578183/ [7578186] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:14:39 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578186/ [7578189] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:17:28 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578189/ [7578192] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:19:59 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578192/ [7578194] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/e2e} time: 00:28:14 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578194/ [7578197] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} time: 00:12:47 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578197/ [7578200] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:19:21 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578200/ [7578203] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:22 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578203/ [7578206] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:11:32 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578206/ [7578209] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:38 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578209/ [7578212] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} time: 00:07:52 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578212/ [7578215] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:08 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578215/ [7578218] rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} time: 00:17:00 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578218/ [7578221] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/module_selftest} time: 00:23:29 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578221/ [7578224] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:17:50 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578224/ [7578227] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_latest}} time: 00:12:43 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578227/ [7578233] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mgr} time: 00:15:06 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578233/ [7578236] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:18:24 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578236/ [7578240] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 01:42:25 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578240/ [7578243] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:21:34 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578243/ [7578246] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:12:09 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578246/ [7578249] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:13 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578249/ [7578252] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:10:11 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578252/ [7578255] rados/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:23 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578255/ [7578258] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:15:57 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578258/ [7578261] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:21:19 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578261/ [7578270] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:32:04 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578270/ [7578273] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:54 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578273/ [7578276] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:19:51 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578276/ [7578279] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_big} time: 00:33:25 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578279/ [7578282] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:25:47 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578282/ [7578285] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:10:20 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578285/ [7578288] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} time: 00:13:03 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578288/ [7578291] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:35:30 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578291/ [7578294] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:20:00 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578294/ [7578297] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:41:23 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578297/ [7578300] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:14:49 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578300/ [7578303] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/per_module_finisher_stats} time: 00:11:17 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578303/ [7578306] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:22:35 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578306/ [7578309] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:18:02 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578309/ [7578312] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:09:55 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578312/ [7578315] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:50 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578315/ [7578318] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-mixed} time: 00:11:09 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578318/ [7578321] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:18:28 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578321/ [7578324] rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} time: 00:13:13 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578324/ [7578327] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} time: 01:09:44 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578327/ [7578330] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:29:50 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578330/ [7578333] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/dedup-io-snaps} time: 00:13:38 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578333/ [7578335] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:22:20 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578335/ [7578338] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:43 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578338/ [7578341] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:43 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578341/ [7578344] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mix} time: 00:19:09 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578344/ [7578349] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:13:58 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578349/ [7578352] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:28:07 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578352/ [7578357] rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} time: 00:25:30 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578357/ [7578360] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:24:17 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578360/ [7578363] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:25 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578363/ [7578366] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:10:55 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578366/ [7578369] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:15:12 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578369/ [7578372] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:15:45 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578372/ [7578374] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 00:30:05 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578374/ [7578377] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:32:42 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578377/ [7578380] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:23:14 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578380/ [7578383] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:09:48 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578383/ [7578386] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:32 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578386/ [7578389] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:59:53 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578389/ [7578395] rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:19:33 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578395/ [7578398] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:23:28 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578398/ [7578401] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:12 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578401/ [7578404] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:16:42 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578404/ [7578407] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:25:03 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578407/ [7578410] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:33:33 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578410/ [7578413] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} time: 01:09:01 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578413/ [7578419] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon-stretch} time: 00:26:26 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578419/ [7578425] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:02:22 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578425/ [7578428] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:09:58 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578428/ [7578431] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:12:34 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578431/ [7578437] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:19:08 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578437/ [7578440] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:11:52 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578440/ [7578443] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:22:03 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578443/ [7578446] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:04 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578446/ [7578449] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:10:59 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578449/ [7578452] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:10:35 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578452/ [7578455] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:43 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578455/ [7578458] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:02 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578458/ [7578464] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:12:57 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578464/ [7578467] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 02:05:09 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578467/ [7578470] rados/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:38 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578470/ [7578473] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:11:46 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578473/ [7578476] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_latest}} time: 02:14:44 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578476/ [7578479] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/readwrite} time: 00:12:01 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578479/ [7578482] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:09:16 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578482/ [7578485] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:14:35 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578485/ [7578488] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:16:28 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578488/ [7578491] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:38:50 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578491/ [7578494] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits} time: 00:31:24 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578494/ [7578497] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon} time: 01:00:52 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578497/ [7578500] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} time: 00:15:10 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578500/ [7578503] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:27 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578503/ [7578506] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} time: 00:13:29 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578506/ [7578509] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:23:57 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578509/ [7578512] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:36:54 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578512/ [7578515] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:22:17 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578515/ [7578518] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:20:35 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578518/ [7578521] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:00 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578521/ [7578527] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:25:51 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578527/ [7578530] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:32 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578530/ [7578533] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:44:13 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578533/ [7578536] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:21:27 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578536/ [7578539] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:16:40 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578539/ [7578542] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/repair_test} time: 00:15:20 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578542/ [7578545] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:22:23 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578545/ [7578548] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:14:35 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578548/ [7578551] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:11:26 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578551/ [7578554] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:10 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578554/ [7578556] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:44 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578556/ [7578562] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:23:52 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578562/ [7578565] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:13:11 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578565/ [7578568] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:26:06 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578568/ [7578571] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:05 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578571/ [7578574] rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:13:47 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578574/ [7578577] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:38 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578577/ [7578583] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} time: 02:43:38 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578583/ [7578586] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:31:05 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578586/ [7578589] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:15:19 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578589/ [7578593] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:08:53 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578593/ [7578596] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} time: 00:08:48 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578596/ [7578599] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} time: 00:09:43 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578599/ [7578602] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:57 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578602/ [7578605] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:30:52 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578605/ [7578608] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:21:33 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578608/ [7578611] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:13:14 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578611/ [7578614] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/scrub_test} time: 00:13:13 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578614/ [7578616] rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} time: 00:16:35 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578616/ [7578619] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 01:25:27 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578619/ [7578622] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:10:18 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578622/ [7578625] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:14 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578625/ [7578628] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:12:21 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578628/ [7578631] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:52 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578631/ [7578634] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:20:21 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578634/ [7578637] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/e2e} time: 00:26:23 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578637/ [7578640] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:12:49 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578640/ [7578646] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:21:34 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578646/ [7578649] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:17 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578649/ [7578652] rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:43 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578652/ [7578655] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:14:17 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578655/ [7578658] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:19:15 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578658/ [7578671] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:13:24 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578671/ [7578673] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:14:31 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578673/ [7578676] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} time: 02:29:39 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578676/ [7578679] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/libcephsqlite} time: 00:12:22 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578679/ [7578681] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:11:35 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578681/ [7578683] rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:08 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578683/ [7578685] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_5925} time: 00:19:31 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578685/ [7578687] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:12:17 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578687/ [7578689] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:11:42 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578689/ [7578691] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:22:56 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578691/ [7578693] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:16:55 info: https://pulpito.ceph.com/yuriw-2024-03-01_20:49:30-rados-wip-yuri-testing-2024-03-01-0756-distro-default-smithi/7578693/