2023-12-15T19:25:01.670 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-15T19:25:01.671 INFO:teuthology.results:subset: '512/20000' 2023-12-15T19:25:01.671 INFO:teuthology.results:seed: '1940' 2023-12-15T21:35:30.890 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-15T21:35:30.919 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-12-16T09:07:30.161 INFO:teuthology.results:Tests finished! gathering results... 2023-12-16T09:07:46.394 INFO:scrape:Found 200 jobs 2023-12-16T09:07:50.483 INFO:scrape:Found 7 distinct failure reasons 2023-12-16T09:07:50.484 INFO:scrape:Failure: Command failed on smithi055 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e43e691fbf84ba140f7aca68f475c46bb96f4df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 615161ba-9b91-11ee-95a5-87774f69a715 -- ceph rgw realm bootstrap -i -' 2023-12-16T09:07:50.484 INFO:scrape:2 jobs: ['7493121', '7492965'] 2023-12-16T09:07:50.484 INFO:scrape:suites intersection: ['agent/on', 'mon_election/connectivity', 'task/test_rgw_multisite}'] 2023-12-16T09:07:50.484 INFO:scrape:suites union: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_rgw_multisite}'] 2023-12-16T09:07:50.484 INFO:scrape: 2023-12-16T09:07:50.485 INFO:scrape:Failure: valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate 2023-12-16T09:07:50.485 INFO:scrape:3 jobs: ['7493075', '7492999', '7493153'] 2023-12-16T09:07:50.485 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/connectivity', 'msgr-failures/few', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'validater/valgrind}'] 2023-12-16T09:07:50.485 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'validater/valgrind}'] 2023-12-16T09:07:50.485 INFO:scrape: 2023-12-16T09:07:50.485 INFO:scrape:Dead: b'2023-12-16T09:02:54.061 DEBUG:teuthology.exit:Finished running handlers' 2023-12-16T09:07:50.485 INFO:scrape:2 jobs: ['7493094', '7493092'] 2023-12-16T09:07:50.486 INFO:scrape:suites intersection: ['mon_election/classic'] 2023-12-16T09:07:50.486 INFO:scrape:suites union: ['0-start', '1-tasks', 'mon_election/classic', 'rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'supported-random-distro$/{centos_latest}}', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default'] 2023-12-16T09:07:50.486 INFO:scrape: 2023-12-16T09:07:50.486 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi055 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0e43e691fbf84ba140f7aca68f475c46bb96f4df TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-12-16T09:07:50.486 INFO:scrape:1 jobs: ['7493004'] 2023-12-16T09:07:50.486 INFO:scrape:suites: ['debug/mgr', 'mon_election/classic', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-bitmap}', 'tasks/e2e}'] 2023-12-16T09:07:50.486 INFO:scrape: 2023-12-16T09:07:50.486 INFO:scrape:Failure: Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI) 2023-12-16T09:07:50.487 INFO:scrape:1 jobs: ['7493088'] 2023-12-16T09:07:50.487 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_orch_cli}'] 2023-12-16T09:07:50.487 INFO:scrape: 2023-12-16T09:07:50.487 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' 2023-12-16T09:07:50.487 INFO:scrape:1 jobs: ['7493018'] 2023-12-16T09:07:50.487 INFO:scrape:suites: ['mon_election/classic', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{ubuntu_latest}}'] 2023-12-16T09:07:50.487 INFO:scrape: 2023-12-16T09:07:50.487 INFO:scrape:Failure: Command failed (workunit test post-file.sh) on smithi106 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0e43e691fbf84ba140f7aca68f475c46bb96f4df TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh' 2023-12-16T09:07:50.487 INFO:scrape:1 jobs: ['7493129'] 2023-12-16T09:07:50.488 INFO:scrape:suites: ['mon_election/classic', 'rados', 'rados/singleton-nomsgr/{all/ceph-post-file', 'supported-random-distro$/{ubuntu_latest}}'] 2023-12-16T09:07:50.488 INFO:scrape: 2023-12-16T09:07:50.495 INFO:teuthology.results:Sending results to akupczyk@redhat.com: Test Run: akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/ failed: 9 dead: 2 running: 0 waiting: 0 queued: 0 passed: 189 Fail ================================================================= [7492965] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:18:50 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492965/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492965/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1ac1c40811844a67ba7a6e9ddf6df897 Command failed on smithi053 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:0e43e691fbf84ba140f7aca68f475c46bb96f4df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 761eb462-9b82-11ee-95a5-87774f69a715 -- ceph rgw realm bootstrap -i -' [7492999] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 01:56:26 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492999/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492999/ valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate [7493004] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/e2e} ----------------------------------------------------------------- time: 00:32:35 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493004/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493004/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ca9ef94e5bc648068abacb297939ee82 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi055 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0e43e691fbf84ba140f7aca68f475c46bb96f4df TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7493018] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:19 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493018/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493018/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cafb813c401b48138c42d46b066143c7 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7493075] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:48:04 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493075/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493075/ valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate [7493088] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:19:01 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493088/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493088/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5af162b958384f57bb3764f443af9603 Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI) [7493121] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:17:14 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493121/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493121/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f154c975c504461fb13688807894a1aa Command failed on smithi055 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:0e43e691fbf84ba140f7aca68f475c46bb96f4df shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 615161ba-9b91-11ee-95a5-87774f69a715 -- ceph rgw realm bootstrap -i -' [7493129] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:10:48 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493129/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493129/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4778ede6eeab43f6b139bc01f725be18 Command failed (workunit test post-file.sh) on smithi106 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0e43e691fbf84ba140f7aca68f475c46bb96f4df TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh' [7493153] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:30:35 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493153/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493153/ valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate Dead ================================================================= [7493092] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493092/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493092/ hit max job timeout [7493094] rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493094/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493094/ hit max job timeout Pass ================================================================= [7492962] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:16:54 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492962/ [7492963] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:35:13 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492963/ [7492964] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:11:56 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492964/ [7492966] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:13:20 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492966/ [7492967] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:21:14 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492967/ [7492968] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:14:51 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492968/ [7492969] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:10:40 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492969/ [7492970] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:50 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492970/ [7492971] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:10:12 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492971/ [7492972] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:16:12 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492972/ [7492973] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:14:59 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492973/ [7492974] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:25 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492974/ [7492975] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:14:11 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492975/ [7492976] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:13:11 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492976/ [7492977] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:17:23 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492977/ [7492978] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:17:13 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492978/ [7492979] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_set_mon_crush_locations} time: 00:19:34 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492979/ [7492980] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:52 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492980/ [7492981] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:21:47 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492981/ [7492982] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:57 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492982/ [7492983] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:14:46 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492983/ [7492984] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/libcephsqlite} time: 00:13:30 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492984/ [7492985] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd-backfill} time: 02:27:19 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492985/ [7492986] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:23:10 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492986/ [7492987] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:45 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492987/ [7492988] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:41 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492988/ [7492989] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption} time: 00:16:18 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492989/ [7492990] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:55 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492990/ [7492991] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_latest}} time: 00:08:16 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492991/ [7492992] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 02:19:42 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492992/ [7492993] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/pool-create-delete} time: 00:20:44 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492993/ [7492994] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects} time: 00:22:55 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492994/ [7492995] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} time: 00:20:30 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492995/ [7492996] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:48 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492996/ [7492997] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:54 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492997/ [7492998] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:27:01 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7492998/ [7493000] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:11:00 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493000/ [7493001] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} time: 00:27:37 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493001/ [7493002] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_ca_signed_key} time: 00:17:05 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493002/ [7493003] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:30:41 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493003/ [7493005] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_latest} tasks/module_selftest} time: 00:25:11 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493005/ [7493006] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:25:21 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493006/ [7493007] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:06 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493007/ [7493008] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:13:45 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493008/ [7493009] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:13:36 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493009/ [7493010] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:10 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493010/ [7493011] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:23:38 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493011/ [7493012] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:03 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493012/ [7493013] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/rados_api_tests} time: 00:27:31 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493013/ [7493014] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:13:18 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493014/ [7493015] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio} time: 00:15:03 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493015/ [7493016] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:57 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493016/ [7493017] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:38:02 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493017/ [7493019] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:19:13 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493019/ [7493020] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:22:41 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493020/ [7493021] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 02:57:31 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493021/ [7493022] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm} time: 00:16:59 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493022/ [7493023] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:49:47 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493023/ [7493024] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:13:13 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493024/ [7493025] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:34 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493025/ [7493026] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:16:03 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493026/ [7493027] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:11:42 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493027/ [7493028] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/one workloads/rados_5925} time: 00:10:39 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493028/ [7493029] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:43 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493029/ [7493030] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:32 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493030/ [7493031] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:38:35 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493031/ [7493032] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos} time: 00:08:17 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493032/ [7493033] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:21:05 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493033/ [7493034] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} time: 00:12:40 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493034/ [7493035] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/rados_cls_all} time: 00:17:20 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493035/ [7493036] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:29 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493036/ [7493037] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:23:50 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493037/ [7493038] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:08:48 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493038/ [7493039] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_latest} tasks/per_module_finisher_stats} time: 00:11:48 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493039/ [7493040] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:13:48 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493040/ [7493041] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:46 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493041/ [7493042] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{centos_latest}} time: 00:08:51 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493042/ [7493043] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:20:51 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493043/ [7493044] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:21:26 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493044/ [7493045] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_extra_daemon_features} time: 00:16:34 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493045/ [7493046] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:20:57 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493046/ [7493047] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} time: 00:08:48 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493047/ [7493048] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:25:37 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493048/ [7493049] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:32:55 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493049/ [7493050] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:20:13 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493050/ [7493051] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:29 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493051/ [7493052] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:43 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493052/ [7493053] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache} time: 00:11:41 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493053/ [7493054] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:21:12 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493054/ [7493055] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 02:40:20 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493055/ [7493056] rados/singleton/{all/deduptool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:11:42 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493056/ [7493057] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/dedup-io-mixed} time: 00:14:48 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493057/ [7493058] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_host_drain} time: 00:17:59 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493058/ [7493059] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:15:18 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493059/ [7493060] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:45 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493060/ [7493061] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} time: 00:17:58 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493061/ [7493062] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/rados_python} time: 00:15:14 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493062/ [7493063] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:20:32 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493063/ [7493064] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:22:14 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493064/ [7493065] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:10:10 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493065/ [7493066] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_api_tests} time: 00:31:49 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493066/ [7493067] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:26:12 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493067/ [7493068] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:20:14 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493068/ [7493069] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:16 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493069/ [7493070] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:15:45 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493070/ [7493071] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:24:09 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493071/ [7493072] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:28:11 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493072/ [7493073] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:27:34 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493073/ [7493074] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:51 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493074/ [7493076] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:16:32 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493076/ [7493077] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:32:25 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493077/ [7493078] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:12:39 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493078/ [7493079] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_monitoring_stack_basic} time: 00:22:04 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493079/ [7493080] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 00:28:35 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493080/ [7493081] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:12:50 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493081/ [7493082] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} time: 00:08:59 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493082/ [7493083] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:54 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493083/ [7493084] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:08 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493084/ [7493085] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:20:59 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493085/ [7493086] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:15:09 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493086/ [7493087] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/redirect} time: 00:12:28 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493087/ [7493089] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/dashboard} time: 01:22:25 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493089/ [7493090] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_latest}} time: 00:37:21 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493090/ [7493091] rados/rest/{mgr-restful supported-random-distro$/{centos_latest}} time: 00:13:39 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493091/ [7493093] rados/standalone/{supported-random-distro$/{centos_latest} workloads/c2c} time: 00:16:17 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493093/ [7493095] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:20:03 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493095/ [7493096] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:22:07 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493096/ [7493097] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:20:20 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493097/ [7493098] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:17:09 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493098/ [7493099] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:49 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493099/ [7493100] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:13:07 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493100/ [7493101] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:11:13 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493101/ [7493102] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} time: 00:14:28 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493102/ [7493103] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:41:01 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493103/ [7493104] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:13:41 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493104/ [7493105] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:17:55 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493105/ [7493106] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:45:07 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493106/ [7493107] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} time: 00:20:33 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493107/ [7493108] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:12:35 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493108/ [7493109] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:10 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493109/ [7493110] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:23:10 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493110/ [7493111] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:11:53 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493111/ [7493112] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:13:49 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493112/ [7493113] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:11:06 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493113/ [7493114] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:33:03 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493114/ [7493115] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:20:57 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493115/ [7493116] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} time: 00:26:23 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493116/ [7493117] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/lockdep} time: 00:19:28 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493117/ [7493118] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:12:15 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493118/ [7493119] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:14 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493119/ [7493120] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/small-objects} time: 00:22:25 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493120/ [7493122] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:31:43 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493122/ [7493123] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:26:28 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493123/ [7493124] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:11:41 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493124/ [7493125] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:38 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493125/ [7493126] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:04 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493126/ [7493127] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:23:45 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493127/ [7493128] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:04 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493128/ [7493130] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:25:19 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493130/ [7493131] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:31:11 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493131/ [7493132] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:35:50 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493132/ [7493133] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:13:47 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493133/ [7493134] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:26:35 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493134/ [7493135] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:14:14 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493135/ [7493136] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:52 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493136/ [7493137] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:12:22 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493137/ [7493138] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:05 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493138/ [7493139] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_set_mon_crush_locations} time: 00:20:10 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493139/ [7493140] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:10:51 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493140/ [7493141] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:17:10 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493141/ [7493142] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:10:59 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493142/ [7493143] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:34:00 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493143/ [7493144] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:31:12 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493144/ [7493145] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:15:57 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493145/ [7493146] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:26:33 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493146/ [7493147] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_adoption} time: 00:14:23 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493147/ [7493148] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:25 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493148/ [7493149] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:55 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493149/ [7493150] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:14:40 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493150/ [7493151] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:17:03 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493151/ [7493152] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:05 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493152/ [7493154] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:17:03 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493154/ [7493155] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:04 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493155/ [7493156] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:29 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493156/ [7493157] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:12:52 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493157/ [7493158] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:25:05 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493158/ [7493159] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:14:16 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493159/ [7493160] rados/standalone/{supported-random-distro$/{centos_latest} workloads/erasure-code} time: 01:23:02 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493160/ [7493161] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:14:31 info: https://pulpito.ceph.com/akupczyk-2023-12-15_10:26:45-rados-wip-aclamk-bs-fix-esb-multichunk-alloc-distro-default-smithi/7493161/