2023-12-07T00:15:29.473 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-07T00:15:29.474 INFO:teuthology.results:subset: '111/120000' 2023-12-07T00:15:29.474 INFO:teuthology.results:seed: '6240' 2023-12-07T03:41:40.835 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-07T03:41:40.861 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-12-07T15:34:49.206 INFO:teuthology.results:Tests finished! gathering results... 2023-12-07T15:35:15.676 INFO:scrape:Found 313 jobs 2023-12-07T15:35:15.760 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481085/teuthology.log 2023-12-07T15:35:23.765 INFO:scrape:Found 13 distinct failure reasons 2023-12-07T15:35:23.766 INFO:scrape:Failure: Command failed on smithi196 with status 1: 'sudo yum -y install ceph' 2023-12-07T15:35:23.766 INFO:scrape:7 jobs: ['7481047', '7480930', '7481151', '7481107', '7480912', '7481166', '7481036'] 2023-12-07T15:35:23.767 INFO:scrape:suites intersection: [] 2023-12-07T15:35:23.767 INFO:scrape:suites union: ['agent/off', 'agent/on', 'mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_adoption}', 'task/test_ca_signed_key}', 'task/test_extra_daemon_features}', 'task/test_orch_cli_mon}', 'task/test_orch_cli}', 'task/test_rgw_multisite}', 'task/test_set_mon_crush_locations}'] 2023-12-07T15:35:23.767 INFO:scrape: 2023-12-07T15:35:23.767 INFO:scrape:Dead: None 2023-12-07T15:35:23.768 INFO:scrape:5 jobs: ['7481085', '7480892', '7480916', '7481172', '7480968'] 2023-12-07T15:35:23.768 INFO:scrape: 2023-12-07T15:35:23.768 INFO:scrape:Failure: reached maximum tries (51) after waiting for 300 seconds 2023-12-07T15:35:23.768 INFO:scrape:2 jobs: ['7481009', '7480899'] 2023-12-07T15:35:23.769 INFO:scrape:suites intersection: ['centos_latest}', 'rados/valgrind-leaks/{1-start'] 2023-12-07T15:35:23.769 INFO:scrape:suites union: ['2-inject-leak/mon', '2-inject-leak/osd', 'centos_latest}', 'rados/valgrind-leaks/{1-start'] 2023-12-07T15:35:23.769 INFO:scrape: 2023-12-07T15:35:23.769 INFO:scrape:Failure: Command failed on smithi016 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f0c322331348463ad8afb13a3a03e833bee1c39c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4b448bf2-949a-11ee-95a2-87774f69a715 -- ceph rgw realm bootstrap -i -' 2023-12-07T15:35:23.769 INFO:scrape:2 jobs: ['7480891', '7481175'] 2023-12-07T15:35:23.770 INFO:scrape:suites intersection: ['agent/off', 'mon_election/connectivity', 'task/test_rgw_multisite}'] 2023-12-07T15:35:23.770 INFO:scrape:suites union: ['agent/off', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_rgw_multisite}'] 2023-12-07T15:35:23.770 INFO:scrape: 2023-12-07T15:35:23.770 INFO:scrape:Failure: valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate 2023-12-07T15:35:23.771 INFO:scrape:5 jobs: ['7481110', '7480969', '7481109', '7480900', '7481181'] 2023-12-07T15:35:23.771 INFO:scrape:suites intersection: [] 2023-12-07T15:35:23.771 INFO:scrape:suites union: ['2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'tasks/rados_cls_all', 'validater/valgrind}'] 2023-12-07T15:35:23.771 INFO:scrape: 2023-12-07T15:35:23.772 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-12-06-1240 2023-12-07T15:35:23.772 INFO:scrape:2 jobs: ['7480983', '7480979'] 2023-12-07T15:35:23.772 INFO:scrape: 2023-12-07T15:35:23.772 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi120 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f0c322331348463ad8afb13a3a03e833bee1c39c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-12-07T15:35:23.772 INFO:scrape:2 jobs: ['7480927', '7481083'] 2023-12-07T15:35:23.772 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}'] 2023-12-07T15:35:23.773 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-zlib}', 'random-objectstore$/{bluestore-hybrid}', 'tasks/e2e}'] 2023-12-07T15:35:23.773 INFO:scrape: 2023-12-07T15:35:23.773 INFO:scrape:Failure: cannot pull file with status: requested 2023-12-07T15:35:23.773 INFO:scrape:2 jobs: ['7480951', '7480967'] 2023-12-07T15:35:23.774 INFO:scrape:suites intersection: ['mon_election/classic'] 2023-12-07T15:35:23.774 INFO:scrape:suites union: ['0-nvme-loop', '0-size-min-size-overrides/2-size-2-min-size', '1-install/nautilus-v2only', 'agent/on', 'backoff/normal', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'fixed-2', 'mon_election/classic', 'msgr-failures/fastclose', 'rados', 'rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'start}', 'thrashers/none', 'thrashosds-health', 'three-plus-one}', 'workloads/snaps-few-objects}'] 2023-12-07T15:35:23.774 INFO:scrape: 2023-12-07T15:35:23.774 INFO:scrape:Failure: Command failed (workunit test post-file.sh) on smithi080 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f0c322331348463ad8afb13a3a03e833bee1c39c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh' 2023-12-07T15:35:23.775 INFO:scrape:2 jobs: ['7481039', '7481195'] 2023-12-07T15:35:23.775 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/ceph-post-file'] 2023-12-07T15:35:23.775 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/ceph-post-file', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}'] 2023-12-07T15:35:23.775 INFO:scrape: 2023-12-07T15:35:23.775 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' 2023-12-07T15:35:23.776 INFO:scrape:2 jobs: ['7480938', '7481098'] 2023-12-07T15:35:23.776 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{centos_latest}}'] 2023-12-07T15:35:23.776 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{centos_latest}}'] 2023-12-07T15:35:23.776 INFO:scrape: 2023-12-07T15:35:23.776 INFO:scrape:Dead: b'2023-12-07T13:52:27.641 DEBUG:teuthology.exit:Finished running handlers' 2023-12-07T15:35:23.777 INFO:scrape:4 jobs: ['7481008', '7481165', '7481163', '7481006'] 2023-12-07T15:35:23.777 INFO:scrape:suites intersection: [] 2023-12-07T15:35:23.777 INFO:scrape:suites union: ['0-start', '1-tasks', 'mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8}', 'rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default'] 2023-12-07T15:35:23.777 INFO:scrape: 2023-12-07T15:35:23.777 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi087 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f0c322331348463ad8afb13a3a03e833bee1c39c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2023-12-07T15:35:23.778 INFO:scrape:1 jobs: ['7481042'] 2023-12-07T15:35:23.778 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}'] 2023-12-07T15:35:23.778 INFO:scrape: 2023-12-07T15:35:23.778 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on smithi118 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f0c322331348463ad8afb13a3a03e833bee1c39c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2023-12-07T15:35:23.778 INFO:scrape:1 jobs: ['7481057'] 2023-12-07T15:35:23.779 INFO:scrape:suites: ['agent/off', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_adoption}'] 2023-12-07T15:35:23.779 INFO:scrape: 2023-12-07T15:35:23.792 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/ failed: 28 dead: 9 running: 0 waiting: 0 queued: 0 passed: 276 Fail ================================================================= [7480891] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:18:02 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480891/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480891/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a0ade8c3490c42d49db300dc37ab8986 Command failed on smithi016 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:f0c322331348463ad8afb13a3a03e833bee1c39c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4b448bf2-949a-11ee-95a2-87774f69a715 -- ceph rgw realm bootstrap -i -' [7480899] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} ----------------------------------------------------------------- time: 00:24:31 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480899/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480899/ reached maximum tries (51) after waiting for 300 seconds [7480900] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:32:17 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480900/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480900/ valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate [7480912] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:11:04 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480912/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480912/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bdf39df271b54e70a04acdb280f6b8a7 Command failed on smithi080 with status 1: 'sudo yum -y install ceph' [7480927] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} tasks/e2e} ----------------------------------------------------------------- time: 00:30:11 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480927/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480927/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ba9bdd4e55b549b683b1b758f972f82a Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi120 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f0c322331348463ad8afb13a3a03e833bee1c39c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7480930] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_ca_signed_key} ----------------------------------------------------------------- time: 00:11:21 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480930/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480930/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41e32849df534d259e553d56f4702bcf Command failed on smithi143 with status 1: 'sudo yum -y install ceph' [7480938] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:09:09 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480938/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480938/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1641ede32dec43fcbe65501898bcee95 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7480951] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:16:11 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480951/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480951/ sentry: https://sentry.ceph.com/organizations/ceph/?query=52b05f74977e48c28ee50fbe27010746 cannot pull file with status: requested [7480967] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:09:43 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480967/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480967/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ec0704eeb7c9465391fc37068f540447 cannot pull file with status: requested [7480969] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 01:46:34 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480969/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480969/ valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate [7480979] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_host_drain} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480979/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480979/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5774b33ab33f40ed927fcae70b1fdaa0 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip- yuri-testing-2023-12-06-1240 [7480983] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480983/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480983/ sentry: https://sentry.ceph.com/organizations/ceph/?query=96798891a27e4d1794a1b13918b5df52 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip- yuri-testing-2023-12-06-1240 [7481009] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} ----------------------------------------------------------------- time: 00:21:50 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481009/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481009/ reached maximum tries (51) after waiting for 300 seconds [7481036] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:11:54 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481036/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481036/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2b73e36e21b04957b5cdd80c5ac233b2 Command failed on smithi094 with status 1: 'sudo yum -y install ceph' [7481039] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:08:54 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481039/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481039/ sentry: https://sentry.ceph.com/organizations/ceph/?query=55ad79c185ad470ea36930a86c95cfe4 Command failed (workunit test post-file.sh) on smithi080 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f0c322331348463ad8afb13a3a03e833bee1c39c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh' [7481042] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 01:01:31 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481042/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481042/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6270c44123c649f596c451a1118f06e8 Command failed (workunit test rados/test.sh) on smithi087 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f0c322331348463ad8afb13a3a03e833bee1c39c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [7481047] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_set_mon_crush_locations} ----------------------------------------------------------------- time: 00:11:32 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481047/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481047/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0ba67afcf39e413ca930988a41929796 Command failed on smithi196 with status 1: 'sudo yum -y install ceph' [7481057] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:10:25 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481057/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481057/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ee005bb7a4004c768b6489e0c07a9dc1 Command failed (workunit test cephadm/test_adoption.sh) on smithi118 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f0c322331348463ad8afb13a3a03e833bee1c39c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [7481083] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} tasks/e2e} ----------------------------------------------------------------- time: 00:29:24 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481083/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481083/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cd2603436dcf4bd3ab40e5b36779b28f Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi089 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f0c322331348463ad8afb13a3a03e833bee1c39c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7481098] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:10:13 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481098/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481098/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bd73fe23b356499c91bfd9e6974cf48a Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7481107] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_extra_daemon_features} ----------------------------------------------------------------- time: 00:11:04 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481107/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481107/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9c7e9af1715642aba99fddb630dd55d5 Command failed on smithi091 with status 1: 'sudo yum -y install ceph' [7481109] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} ----------------------------------------------------------------- time: 00:17:35 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481109/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481109/ valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate [7481110] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:34:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481110/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481110/ valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate [7481151] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:11:06 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481151/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481151/ sentry: https://sentry.ceph.com/organizations/ceph/?query=74e9b9e7501d44bcb698844d54ab9e8b Command failed on smithi153 with status 1: 'sudo yum -y install ceph' [7481166] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:11:24 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481166/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481166/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cb8d239c59c24ed7b2bc6fbdeca040cd Command failed on smithi087 with status 1: 'sudo yum -y install ceph' [7481175] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:18:39 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481175/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481175/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8c0d2ddcce5a4115b5f678b46e8701ac Command failed on smithi008 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:f0c322331348463ad8afb13a3a03e833bee1c39c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97b0f8b8-94b3-11ee-95a2-87774f69a715 -- ceph rgw realm bootstrap -i -' [7481181] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 01:47:01 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481181/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481181/ valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate [7481195] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:10:26 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481195/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481195/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cacf07a93b934ad998c9d0c52a966457 Command failed (workunit test post-file.sh) on smithi148 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f0c322331348463ad8afb13a3a03e833bee1c39c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh' Dead ================================================================= [7480892] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480892/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480892/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7480916] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480916/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480916/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7480968] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/libcephsqlite} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480968/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480968/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7481006] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481006/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481006/ hit max job timeout [7481008] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481008/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481008/ hit max job timeout [7481085] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481085/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481085/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7481163] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481163/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481163/ hit max job timeout [7481165] rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481165/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481165/ hit max job timeout [7481172] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481172/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481172/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds Pass ================================================================= [7480885] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:12:51 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480885/ [7480886] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:55:35 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480886/ [7480887] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:30:24 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480887/ [7480888] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_latest} tasks/per_module_finisher_stats} time: 00:10:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480888/ [7480889] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:09:19 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480889/ [7480890] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:07 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480890/ [7480893] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} time: 00:20:17 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480893/ [7480894] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:55 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480894/ [7480895] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:15:39 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480895/ [7480896] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:10 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480896/ [7480897] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480897/ [7480898] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/readwrite} time: 00:14:15 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480898/ [7480901] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:33 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480901/ [7480902] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:22:41 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480902/ [7480903] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:19:19 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480903/ [7480904] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:36 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480904/ [7480905] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:23:22 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480905/ [7480906] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:09:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480906/ [7480907] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:15:16 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480907/ [7480908] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_set_mon_crush_locations} time: 00:20:20 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480908/ [7480909] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:09:37 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480909/ [7480910] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd-backfill} time: 02:26:27 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480910/ [7480911] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_api_tests} time: 00:37:51 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480911/ [7480913] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:27:01 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480913/ [7480914] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480914/ [7480915] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_latest}} time: 00:07:34 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480915/ [7480917] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:08 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480917/ [7480918] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:24:02 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480918/ [7480919] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:11:13 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480919/ [7480920] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:16:27 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480920/ [7480921] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/repair_test} time: 00:16:40 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480921/ [7480922] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:13:39 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480922/ [7480923] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:48 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480923/ [7480924] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:32:10 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480924/ [7480925] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:37 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480925/ [7480926] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:18:17 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480926/ [7480928] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:21:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480928/ [7480929] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:15:12 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480929/ [7480931] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:54 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480931/ [7480932] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480932/ [7480933] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:26:16 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480933/ [7480934] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:22 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480934/ [7480935] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:11:50 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480935/ [7480936] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:13:45 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480936/ [7480937] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:27:42 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480937/ [7480939] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480939/ [7480940] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:24:18 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480940/ [7480941] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_cephadm} time: 00:19:14 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480941/ [7480942] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 02:44:22 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480942/ [7480943] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:10:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480943/ [7480944] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:14:16 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480944/ [7480945] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:19:09 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480945/ [7480946] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_latest} tasks/prometheus} time: 00:11:59 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480946/ [7480947] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:44:09 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480947/ [7480948] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:15:30 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480948/ [7480949] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:25:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480949/ [7480950] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:14:49 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480950/ [7480952] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:13:57 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480952/ [7480953] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:45 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480953/ [7480954] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:15:14 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480954/ [7480955] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:28:45 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480955/ [7480956] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:21:14 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480956/ [7480957] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_cephadm_repos} time: 00:15:34 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480957/ [7480958] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:23:39 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480958/ [7480959] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:13:10 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480959/ [7480960] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{centos_latest}} time: 00:09:14 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480960/ [7480961] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:23:29 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480961/ [7480962] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_extra_daemon_features} time: 00:28:48 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480962/ [7480963] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:21:40 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480963/ [7480964] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:16 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480964/ [7480965] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache} time: 00:11:30 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480965/ [7480966] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:16:04 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480966/ [7480970] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:14:07 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480970/ [7480971] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:19:26 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480971/ [7480972] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:18:50 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480972/ [7480973] rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub} time: 02:26:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480973/ [7480974] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:19:35 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480974/ [7480975] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/workunits} time: 00:10:53 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480975/ [7480976] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:37:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480976/ [7480977] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} time: 00:14:32 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480977/ [7480978] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:26:54 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480978/ [7480980] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:56 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480980/ [7480981] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_workunits} time: 00:31:07 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480981/ [7480982] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:09:20 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480982/ [7480984] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup-io-snaps} time: 00:17:49 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480984/ [7480985] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} time: 00:09:19 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480985/ [7480986] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480986/ [7480987] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:29:07 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480987/ [7480988] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:24:37 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480988/ [7480989] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:37:29 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480989/ [7480990] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:14:46 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480990/ [7480991] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:30:29 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480991/ [7480992] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:28:32 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480992/ [7480993] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:33:22 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480993/ [7480994] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_monitoring_stack_basic} time: 00:25:14 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480994/ [7480995] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:27:01 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480995/ [7480996] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:14:56 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480996/ [7480997] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:32:29 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480997/ [7480998] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:21 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480998/ [7480999] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:32:13 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7480999/ [7481000] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:22:21 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481000/ [7481001] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:31:01 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481001/ [7481002] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} time: 01:40:06 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481002/ [7481003] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:13:39 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481003/ [7481004] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:41:48 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481004/ [7481005] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:15:06 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481005/ [7481007] rados/standalone/{supported-random-distro$/{centos_latest} workloads/c2c} time: 00:15:28 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481007/ [7481010] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:14:01 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481010/ [7481011] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_orch_cli} time: 00:30:56 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481011/ [7481012] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:20 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481012/ [7481013] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:05 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481013/ [7481014] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:22:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481014/ [7481015] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:39:06 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481015/ [7481016] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:10:59 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481016/ [7481017] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:15:43 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481017/ [7481018] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} time: 00:38:32 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481018/ [7481019] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:14:36 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481019/ [7481020] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:23:07 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481020/ [7481021] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:18:24 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481021/ [7481022] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} time: 00:09:55 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481022/ [7481023] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:15 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481023/ [7481024] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:12:55 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481024/ [7481025] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/radosbench} time: 00:25:55 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481025/ [7481026] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:56 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481026/ [7481027] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_orch_cli_mon} time: 00:38:21 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481027/ [7481028] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:15:18 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481028/ [7481029] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:20:51 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481029/ [7481030] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:39 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481030/ [7481031] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:15:46 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481031/ [7481032] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:31:55 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481032/ [7481033] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:11:25 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481033/ [7481034] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481034/ [7481035] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:15:37 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481035/ [7481037] rados/standalone/{supported-random-distro$/{centos_latest} workloads/crush} time: 00:21:18 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481037/ [7481038] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:14:25 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481038/ [7481040] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:15:21 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481040/ [7481041] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:44:57 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481041/ [7481043] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:23:22 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481043/ [7481044] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/rados_python} time: 00:15:38 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481044/ [7481045] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:13:57 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481045/ [7481046] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:50 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481046/ [7481048] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:34 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481048/ [7481049] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:13:56 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481049/ [7481050] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:15:32 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481050/ [7481051] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_latest}} time: 00:09:31 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481051/ [7481052] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:20:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481052/ [7481053] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:19:08 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481053/ [7481054] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:04 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481054/ [7481055] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:24:07 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481055/ [7481056] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:26:34 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481056/ [7481058] rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:13:04 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481058/ [7481059] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:15:40 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481059/ [7481060] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:15:13 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481060/ [7481061] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:40 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481061/ [7481062] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:21 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481062/ [7481063] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/insights} time: 00:12:47 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481063/ [7481064] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:22:27 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481064/ [7481065] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:38:43 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481065/ [7481066] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:20:02 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481066/ [7481067] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:25:19 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481067/ [7481068] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:22:51 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481068/ [7481069] rados/standalone/{supported-random-distro$/{centos_latest} workloads/erasure-code} time: 01:22:34 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481069/ [7481070] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_ca_signed_key} time: 00:15:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481070/ [7481071] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:50 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481071/ [7481072] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:25 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481072/ [7481073] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:18:40 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481073/ [7481074] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:32:04 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481074/ [7481075] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:24:19 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481075/ [7481076] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:17:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481076/ [7481077] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:19:57 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481077/ [7481078] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:45 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481078/ [7481079] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_cephadm} time: 00:18:37 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481079/ [7481080] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:10:55 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481080/ [7481081] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:15:02 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481081/ [7481082] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:13:46 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481082/ [7481084] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 01:25:59 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481084/ [7481086] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:20:51 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481086/ [7481087] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} time: 00:14:05 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481087/ [7481088] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:10:24 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481088/ [7481089] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/rados_striper} time: 00:09:14 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481089/ [7481090] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:14:56 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481090/ [7481091] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:07 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481091/ [7481092] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:10:40 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481092/ [7481093] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:37 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481093/ [7481094] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:26:44 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481094/ [7481095] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:30:39 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481095/ [7481096] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:18:15 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481096/ [7481097] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_cephadm_repos} time: 00:12:29 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481097/ [7481099] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:17:50 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481099/ [7481100] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:19:26 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481100/ [7481101] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 01:36:05 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481101/ [7481102] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:50 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481102/ [7481103] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:12:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481103/ [7481104] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:15 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481104/ [7481105] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:27:53 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481105/ [7481106] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:13:30 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481106/ [7481108] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:16:38 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481108/ [7481111] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:34:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481111/ [7481112] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:12 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481112/ [7481113] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:17:25 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481113/ [7481114] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:19 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481114/ [7481115] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:37:22 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481115/ [7481116] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_big} time: 00:30:33 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481116/ [7481117] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:10:35 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481117/ [7481118] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_host_drain} time: 00:24:02 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481118/ [7481119] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:21:31 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481119/ [7481120] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:30:43 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481120/ [7481121] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481121/ [7481122] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_latest} tasks/per_module_finisher_stats} time: 00:20:14 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481122/ [7481123] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:19:26 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481123/ [7481124] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:51 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481124/ [7481125] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:19:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481125/ [7481126] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:11:02 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481126/ [7481127] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:11 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481127/ [7481128] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:19:22 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481128/ [7481129] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:16:47 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481129/ [7481130] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:24:07 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481130/ [7481131] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} time: 01:10:33 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481131/ [7481132] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 00:15:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481132/ [7481133] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:34:37 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481133/ [7481134] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:02 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481134/ [7481135] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:22:50 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481135/ [7481136] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:34 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481136/ [7481137] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:10:06 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481137/ [7481138] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mix} time: 00:20:33 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481138/ [7481139] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:38:43 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481139/ [7481140] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:16:54 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481140/ [7481141] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_monitoring_stack_basic} time: 00:21:57 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481141/ [7481142] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:16:27 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481142/ [7481143] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:26:49 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481143/ [7481144] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:29 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481144/ [7481145] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:27:27 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481145/ [7481146] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:15:22 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481146/ [7481147] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:08 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481147/ [7481148] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:17:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481148/ [7481149] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:14:47 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481149/ [7481150] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:32:02 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481150/ [7481152] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:22:21 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481152/ [7481153] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:12:27 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481153/ [7481154] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:40 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481154/ [7481155] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:54:05 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481155/ [7481156] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:54 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481156/ [7481157] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:16:14 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481157/ [7481158] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:23:11 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481158/ [7481159] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:17:24 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481159/ [7481160] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:27:19 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481160/ [7481161] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:25:33 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481161/ [7481162] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/dashboard} time: 01:27:24 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481162/ [7481164] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon-stretch} time: 00:24:50 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481164/ [7481167] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:12:43 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481167/ [7481168] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:31:09 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481168/ [7481169] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:13:18 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481169/ [7481170] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:14:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481170/ [7481171] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:29 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481171/ [7481173] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:20 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481173/ [7481174] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:10:08 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481174/ [7481176] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:36:47 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481176/ [7481177] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:24:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481177/ [7481178] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:11:40 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481178/ [7481179] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:15:38 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481179/ [7481180] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:21 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481180/ [7481182] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:14:04 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481182/ [7481183] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 01:42:50 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481183/ [7481184] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} time: 02:28:54 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481184/ [7481185] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:50 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481185/ [7481186] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:19:46 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481186/ [7481187] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/readwrite} time: 00:12:35 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481187/ [7481188] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:12 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481188/ [7481189] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:15:40 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481189/ [7481190] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:44:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481190/ [7481191] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_set_mon_crush_locations} time: 00:19:28 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481191/ [7481192] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/one workloads/rados_mon_workunits} time: 00:28:59 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481192/ [7481193] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon} time: 01:06:33 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481193/ [7481194] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} time: 00:14:24 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481194/ [7481196] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:11:19 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481196/ [7481197] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:24:55 info: https://pulpito.ceph.com/yuriw-2023-12-07_00:12:58-rados-wip-yuri-testing-2023-12-06-1240-distro-default-smithi/7481197/