2024-01-19T18:56:53.069 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-19T18:56:53.070 INFO:teuthology.results:subset: '111/120000' 2024-01-19T18:56:53.070 INFO:teuthology.results:seed: '994' 2024-01-20T17:31:31.218 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-20T17:31:31.267 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-01-21T00:02:05.682 INFO:teuthology.results:Tests finished! gathering results... 2024-01-21T00:02:30.905 INFO:scrape:Found 317 jobs 2024-01-21T00:02:33.906 INFO:scrape:Found 7 distinct failure reasons 2024-01-21T00:02:33.907 INFO:scrape:Dead: b'2024-01-20T08:48:23.537 DEBUG:teuthology.exit:Finished running handlers' 2024-01-21T00:02:33.907 INFO:scrape:3 jobs: ['7522290', '7522697', '7522671'] 2024-01-21T00:02:33.907 INFO:scrape:suites intersection: [] 2024-01-21T00:02:33.907 INFO:scrape:suites union: ['debug/mgr', 'mgr_ttl_cache/enable', 'mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/singleton-nomsgr/{all/admin_socket_output', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/progress}'] 2024-01-21T00:02:33.907 INFO:scrape: 2024-01-21T00:02:33.907 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-01-21T00:02:33.907 INFO:scrape:1 jobs: ['7522214'] 2024-01-21T00:02:33.907 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_cls_all', 'validater/valgrind}'] 2024-01-21T00:02:33.907 INFO:scrape: 2024-01-21T00:02:33.908 INFO:scrape:Failure: No module named 'tasks.cephadm' 2024-01-21T00:02:33.908 INFO:scrape:3 jobs: ['7522687', '7522701', '7522681'] 2024-01-21T00:02:33.908 INFO:scrape:suites intersection: [] 2024-01-21T00:02:33.908 INFO:scrape:suites union: ['0-size-min-size-overrides/3-size-2-min-size', '0-start', '1-install/octopus', '1-tasks', 'agent/off', 'backoff/peering', 'ceph', 'clusters/{openstack', 'd-balancer/on', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'rados', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'task/test_orch_cli}', 'test_rbd_api', 'test_rbd_python}}', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'upgrade-sequence', 'workload/{ec-rados-default', 'workloads/test_rbd_api}'] 2024-01-21T00:02:33.908 INFO:scrape: 2024-01-21T00:02:33.908 INFO:scrape:Failure: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-01-21T00:02:33.908 INFO:scrape:5 jobs: ['7522929', '7522545', '7522360', '7522729', '7522548'] 2024-01-21T00:02:33.908 INFO:scrape:suites intersection: [] 2024-01-21T00:02:33.909 INFO:scrape:suites union: ['2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'validater/valgrind}'] 2024-01-21T00:02:33.909 INFO:scrape: 2024-01-21T00:02:33.909 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' 2024-01-21T00:02:33.909 INFO:scrape:2 jobs: ['7522932', '7522514'] 2024-01-21T00:02:33.909 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output'] 2024-01-21T00:02:33.909 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}'] 2024-01-21T00:02:33.909 INFO:scrape: 2024-01-21T00:02:33.909 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi087 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1d1563036928048a487b8d17bdf66baca01c75bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2024-01-21T00:02:33.909 INFO:scrape:1 jobs: ['7522865'] 2024-01-21T00:02:33.909 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_latest}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/rados_api_tests}'] 2024-01-21T00:02:33.910 INFO:scrape: 2024-01-21T00:02:33.910 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm_timeout.py) on smithi143 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1d1563036928048a487b8d17bdf66baca01c75bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm_timeout.py' 2024-01-21T00:02:33.910 INFO:scrape:1 jobs: ['7522539'] 2024-01-21T00:02:33.910 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm_timeout}'] 2024-01-21T00:02:33.910 INFO:scrape: 2024-01-21T00:02:33.921 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/ failed: 13 dead: 3 running: 0 waiting: 0 queued: 0 passed: 301 Fail ================================================================= [7522214] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 03:21:26 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522214/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522214/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a0ff60fd77804e07af0cc54a7330afb3 Command failed (workunit test cls/test_cls_2pc_queue.sh) on smithi006 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1d1563036928048a487b8d17bdf66baca01c75bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cls/test_cls_2pc_queue.sh' [7522360] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:59:44 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522360/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522360/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7522514] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:09:52 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522514/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522514/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bcedc91233774e3b8f74691475ac6ed7 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7522539] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_timeout} ----------------------------------------------------------------- time: 00:15:16 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522539/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522539/ sentry: https://sentry.ceph.com/organizations/ceph/?query=63257de3dfbd4fb4872e7416d98d8b23 Command failed (workunit test cephadm/test_cephadm_timeout.py) on smithi143 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1d1563036928048a487b8d17bdf66baca01c75bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_cephadm_timeout.py' [7522545] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} ----------------------------------------------------------------- time: 00:20:22 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522545/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522545/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7522548] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:29:00 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522548/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522548/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7522681] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:17:18 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522681/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522681/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ef35bdf0b73f4e0c8ddc789957c453b5 No module named 'tasks.thrashosds' [7522687] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:09:09 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522687/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522687/ sentry: https://sentry.ceph.com/organizations/ceph/?query=818d3d14a1624dbfb02c8003d718f30e No module named 'tasks.cephadm' [7522701] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:09:51 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522701/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522701/ sentry: https://sentry.ceph.com/organizations/ceph/?query=02971a71d07b4224a50f2de52a61fec3 No module named 'tasks' [7522729] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 01:37:33 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522729/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522729/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7522865] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:27:04 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522865/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522865/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c2f1923f3cb46aa8161971a3d927da8 Command failed (workunit test rados/test.sh) on smithi087 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1d1563036928048a487b8d17bdf66baca01c75bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [7522929] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:55:10 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522929/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522929/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7522932] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:07:18 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522932/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522932/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe555c471a4246abb347c7e76731d5a0 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' Dead ================================================================= [7522290] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522290/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522290/ hit max job timeout [7522671] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/progress} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522671/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522671/ hit max job timeout [7522697] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522697/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522697/ hit max job timeout Pass ================================================================= [7522210] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:15:47 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522210/ [7522212] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:16:06 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522212/ [7522216] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_extra_daemon_features} time: 00:19:36 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522216/ [7522218] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:13:06 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522218/ [7522220] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:20:16 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522220/ [7522222] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:44 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522222/ [7522224] rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub} time: 02:22:41 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522224/ [7522226] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:12:45 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522226/ [7522228] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:37:01 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522228/ [7522229] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} time: 00:13:25 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522229/ [7522232] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:11 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522232/ [7522234] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:22:45 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522234/ [7522236] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:20 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522236/ [7522237] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_host_drain} time: 00:22:44 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522237/ [7522239] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_workunits} time: 00:26:44 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522239/ [7522241] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:09:12 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522241/ [7522243] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/dedup-io-snaps} time: 00:12:23 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522243/ [7522245] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:09:50 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522245/ [7522247] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:56 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522247/ [7522249] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:24:04 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522249/ [7522251] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:09:58 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522251/ [7522253] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:32:13 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522253/ [7522255] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:14:35 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522255/ [7522257] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:12:51 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522257/ [7522259] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:28:49 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522259/ [7522262] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:29:10 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522262/ [7522264] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:23:09 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522264/ [7522266] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:05 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522266/ [7522268] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:13:19 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522268/ [7522270] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:30:56 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522270/ [7522272] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:49 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522272/ [7522274] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:28:49 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522274/ [7522276] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:30:02 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522276/ [7522278] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_monitoring_stack_basic} time: 00:20:22 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522278/ [7522280] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:28:41 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522280/ [7522282] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/dashboard} time: 01:24:13 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522282/ [7522284] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_latest} tasks/crash} time: 00:09:57 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522284/ [7522286] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_latest}} time: 00:35:37 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522286/ [7522288] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:14:15 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522288/ [7522292] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} time: 00:15:05 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522292/ [7522294] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:48:11 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522294/ [7522295] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:16:03 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522295/ [7522297] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:11:51 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522297/ [7522300] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:42 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522300/ [7522301] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:07:24 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522301/ [7522303] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:14:03 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522303/ [7522305] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:40:02 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522305/ [7522307] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:04 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522307/ [7522309] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:11:15 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522309/ [7522311] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:13:33 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522311/ [7522313] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/one workloads/snaps-few-objects} time: 00:32:25 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522313/ [7522315] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:11:33 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522315/ [7522317] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:21:34 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522317/ [7522319] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_orch_cli} time: 00:22:25 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522319/ [7522321] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} time: 00:07:25 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522321/ [7522323] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:47 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522323/ [7522325] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:41 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522325/ [7522327] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench} time: 00:26:23 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522327/ [7522329] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:10 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522329/ [7522331] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:12:08 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522331/ [7522333] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:14:06 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522333/ [7522335] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:28 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522335/ [7522337] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli_mon} time: 00:28:57 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522337/ [7522339] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:14:05 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522339/ [7522341] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:26:31 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522341/ [7522343] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:12:25 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522343/ [7522345] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:14 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522345/ [7522347] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:15:12 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522347/ [7522349] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:34 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522349/ [7522350] rados/standalone/{supported-random-distro$/{centos_latest} workloads/crush} time: 00:19:28 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522350/ [7522352] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:13:23 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522352/ [7522354] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:29 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522354/ [7522356] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:15:36 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522356/ [7522358] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:12:56 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522358/ [7522362] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_rgw_multisite} time: 00:19:19 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522362/ [7522364] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/rados_python} time: 00:13:59 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522364/ [7522366] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:11:53 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522366/ [7522368] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:00 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522368/ [7522370] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_set_mon_crush_locations} time: 00:17:14 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522370/ [7522372] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:23 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522372/ [7522374] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:15:13 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522374/ [7522376] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:15:45 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522376/ [7522378] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:10:24 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522378/ [7522380] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:19:01 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522380/ [7522382] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:16:08 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522382/ [7522384] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:37 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522384/ [7522386] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:21:57 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522386/ [7522389] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:23:49 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522389/ [7522392] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption} time: 00:11:30 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522392/ [7522395] rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:13:05 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522395/ [7522398] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:18:39 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522398/ [7522401] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:13:42 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522401/ [7522404] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:18:34 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522404/ [7522407] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:07:18 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522407/ [7522410] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_latest} tasks/insights} time: 00:10:54 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522410/ [7522413] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:20:56 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522413/ [7522416] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:26:49 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522416/ [7522419] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:13:53 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522419/ [7522422] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:21:35 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522422/ [7522425] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:19:42 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522425/ [7522428] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_ca_signed_key} time: 00:19:03 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522428/ [7522431] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 01:38:33 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522431/ [7522434] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:02 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522434/ [7522437] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:15 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522437/ [7522440] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:22 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522440/ [7522443] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:33:49 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522443/ [7522446] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:22:15 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522446/ [7522449] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:16:17 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522449/ [7522452] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:20:42 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522452/ [7522455] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:23 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522455/ [7522458] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm} time: 00:19:49 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522458/ [7522461] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:19:38 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522461/ [7522464] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:40 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522464/ [7522467] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:14:20 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522467/ [7522469] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:11:36 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522469/ [7522472] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:58 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522472/ [7522475] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/e2e} time: 00:25:41 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522475/ [7522478] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:20:26 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522478/ [7522481] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_5925} time: 00:10:01 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522481/ [7522484] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:23 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522484/ [7522487] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos} time: 00:06:58 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522487/ [7522490] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:11:13 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522490/ [7522493] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:35 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522493/ [7522496] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} time: 00:07:11 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522496/ [7522499] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:31 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522499/ [7522502] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/module_selftest} time: 00:23:02 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522502/ [7522505] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:16:06 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522505/ [7522508] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:28:06 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522508/ [7522511] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_latest}} time: 00:11:35 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522511/ [7522517] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:16:45 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522517/ [7522520] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:17:59 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522520/ [7522523] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:14:57 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522523/ [7522526] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 01:24:55 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522526/ [7522529] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:11:59 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522529/ [7522532] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:29 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522532/ [7522534] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:25:34 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522534/ [7522537] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:03 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522537/ [7522542] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:16:51 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522542/ [7522551] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:17 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522551/ [7522554] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:30:32 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522554/ [7522557] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:48 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522557/ [7522560] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:20:08 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522560/ [7522563] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:29:50 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522563/ [7522566] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_big} time: 00:28:32 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522566/ [7522569] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_extra_daemon_features} time: 00:14:46 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522569/ [7522572] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:10:01 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522572/ [7522575] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:31:42 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522575/ [7522578] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:18:50 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522578/ [7522581] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_host_drain} time: 00:24:28 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522581/ [7522584] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:26:19 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522584/ [7522587] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:16 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522587/ [7522590] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/per_module_finisher_stats} time: 00:10:58 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522590/ [7522593] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:22:37 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522593/ [7522596] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:16:55 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522596/ [7522599] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:09:36 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522599/ [7522602] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:11 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522602/ [7522605] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:05 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522605/ [7522608] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:20:03 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522608/ [7522610] rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc} time: 01:04:13 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522610/ [7522614] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 00:12:49 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522614/ [7522616] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:58 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522616/ [7522619] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:33:58 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522619/ [7522622] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:21:25 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522622/ [7522625] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:48 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522625/ [7522628] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:14:58 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522628/ [7522631] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:26 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522631/ [7522634] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mix} time: 00:18:41 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522634/ [7522637] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:37:27 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522637/ [7522640] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:16:31 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522640/ [7522643] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:14:54 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522643/ [7522646] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} time: 00:23:54 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522646/ [7522649] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:23:34 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522649/ [7522652] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:45 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522652/ [7522655] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:22:37 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522655/ [7522658] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:14:16 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522658/ [7522661] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:12:26 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522661/ [7522664] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:12:27 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522664/ [7522667] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:11:06 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522667/ [7522669] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:33:54 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522669/ [7522673] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:17 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522673/ [7522675] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:40 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522675/ [7522677] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:54 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522677/ [7522679] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 01:00:03 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522679/ [7522683] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} time: 00:07:56 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522683/ [7522685] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:21:01 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522685/ [7522689] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:14:09 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522689/ [7522691] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:24:28 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522691/ [7522693] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:24:34 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522693/ [7522695] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} time: 01:21:02 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522695/ [7522699] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon-stretch} time: 00:22:20 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522699/ [7522703] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:22:12 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522703/ [7522705] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:11:53 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522705/ [7522707] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:29:59 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522707/ [7522709] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:12:16 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522709/ [7522711] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:12:20 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522711/ [7522713] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:15 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522713/ [7522715] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:42 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522715/ [7522717] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:58 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522717/ [7522719] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:08:15 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522719/ [7522721] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:12:39 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522721/ [7522723] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:21:07 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522723/ [7522725] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:08:46 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522725/ [7522727] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:36 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522727/ [7522731] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:19 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522731/ [7522733] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:12:43 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522733/ [7522735] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 02:19:23 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522735/ [7522737] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} time: 02:20:43 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522737/ [7522739] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_rgw_multisite} time: 00:22:15 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522739/ [7522741] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:20:31 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522741/ [7522743] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:14:21 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522743/ [7522745] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:41 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522745/ [7522747] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:14:04 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522747/ [7522749] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:45:36 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522749/ [7522751] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:24:58 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522751/ [7522753] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/one workloads/rados_mon_workunits} time: 00:28:15 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522753/ [7522755] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} time: 01:05:15 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522755/ [7522757] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} time: 00:13:14 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522757/ [7522759] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:06:57 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522759/ [7522761] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} time: 00:07:26 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522761/ [7522763] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:23:24 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522763/ [7522765] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:29:26 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522765/ [7522767] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} time: 00:10:21 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522767/ [7522769] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:22:00 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522769/ [7522772] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:18:47 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522772/ [7522775] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:12:11 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522775/ [7522778] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:07:39 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522778/ [7522781] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/dedup-io-mixed} time: 00:10:57 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522781/ [7522784] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:18 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522784/ [7522787] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:19:42 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522787/ [7522790] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:18:35 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522790/ [7522793] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:16:31 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522793/ [7522796] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/repair_test} time: 00:14:43 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522796/ [7522799] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:14:12 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522799/ [7522802] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_latest} tasks/workunits} time: 00:08:41 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522802/ [7522805] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:08:15 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522805/ [7522808] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_ca_signed_key} time: 00:12:58 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522808/ [7522811] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/dedup-io-snaps} time: 00:16:29 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522811/ [7522814] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:37 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522814/ [7522817] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:16:26 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522817/ [7522820] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:11:33 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522820/ [7522823] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:10:11 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522823/ [7522826] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm} time: 00:16:29 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522826/ [7522829] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:46 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522829/ [7522832] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:29:01 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522832/ [7522835] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:24:47 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522835/ [7522838] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:34 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522838/ [7522841] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} time: 02:37:21 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522841/ [7522844] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:33:47 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522844/ [7522847] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:16:24 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522847/ [7522850] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:45 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522850/ [7522853] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:18 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522853/ [7522856] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} time: 00:11:03 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522856/ [7522859] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} time: 00:07:19 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522859/ [7522862] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:34 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522862/ [7522869] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:18:31 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522869/ [7522872] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:12:49 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522872/ [7522875] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:11:38 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522875/ [7522878] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:13:03 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522878/ [7522881] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 01:10:49 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522881/ [7522884] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:43 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522884/ [7522887] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_timeout} time: 00:18:32 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522887/ [7522890] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:12:14 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522890/ [7522893] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:25:02 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522893/ [7522896] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:05 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522896/ [7522899] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:19:27 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522899/ [7522902] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} tasks/e2e} time: 00:26:38 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522902/ [7522905] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:12:26 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522905/ [7522908] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:26:17 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522908/ [7522911] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:13:38 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522911/ [7522914] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:03 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522914/ [7522917] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:12:12 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522917/ [7522920] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:40 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522920/ [7522923] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:07:53 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522923/ [7522926] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:13:34 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522926/ [7522935] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:13:00 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522935/ [7522938] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:55 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522938/ [7522941] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:11:33 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522941/ [7522944] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} time: 02:28:48 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522944/ [7522947] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/libcephsqlite} time: 00:11:50 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522947/ [7522950] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:13:25 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522950/ [7522953] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_extra_daemon_features} time: 00:18:32 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522953/ [7522956] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} time: 00:13:01 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522956/ [7522959] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:24 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522959/ [7522962] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:08:47 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522962/ [7522965] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_host_drain} time: 00:16:08 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522965/ [7522968] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:14:17 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522968/ [7522971] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:27:49 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522971/ [7522974] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:13:53 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522974/ [7522977] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:19:52 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522977/ [7522980] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/failover} time: 00:12:23 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522980/ [7522983] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:13:04 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522983/ [7522986] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:23:09 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522986/ [7522989] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/reef backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:21:32 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522989/ [7522992] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:05 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522992/ [7522995] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{ubuntu_latest}} time: 00:09:18 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522995/ [7522998] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:26:23 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7522998/ [7523000] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:16:26 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7523000/ [7523004] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:13:00 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7523004/ [7523007] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:19:00 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7523007/ [7523010] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:20:02 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7523010/ [7523013] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:45:54 info: https://pulpito.ceph.com/yuriw-2024-01-19_15:23:50-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7523013/