2023-12-07T03:41:41.396 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-07T03:41:41.397 INFO:teuthology.results:subset: '111/120000' 2023-12-07T03:41:41.397 INFO:teuthology.results:seed: '9852' 2023-12-07T09:03:24.109 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-07T09:03:24.130 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-12-07T20:36:27.367 INFO:teuthology.results:Tests finished! gathering results... 2023-12-07T20:36:52.516 INFO:scrape:Found 313 jobs 2023-12-07T20:36:55.083 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481530/teuthology.log 2023-12-07T20:37:01.195 INFO:scrape:Found 13 distinct failure reasons 2023-12-07T20:37:01.196 INFO:scrape:Failure: valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate 2023-12-07T20:37:01.196 INFO:scrape:6 jobs: ['7481219', '7481603', '7481602', '7481322', '7481745', '7481467'] 2023-12-07T20:37:01.196 INFO:scrape:suites intersection: [] 2023-12-07T20:37:01.196 INFO:scrape:suites union: ['2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'validater/valgrind}'] 2023-12-07T20:37:01.196 INFO:scrape: 2023-12-07T20:37:01.196 INFO:scrape:Dead: b'2023-12-07T17:25:16.532 DEBUG:teuthology.exit:Finished running handlers' 2023-12-07T20:37:01.196 INFO:scrape:4 jobs: ['7481395', '7481714', '7481399', '7481710'] 2023-12-07T20:37:01.197 INFO:scrape:suites intersection: [] 2023-12-07T20:37:01.197 INFO:scrape:suites union: ['0-start', '1-tasks', 'mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun}', 'rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default'] 2023-12-07T20:37:01.197 INFO:scrape: 2023-12-07T20:37:01.197 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on smithi005 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2d90d175e63a3e83fe3e34fdef509d252350e311 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2023-12-07T20:37:01.197 INFO:scrape:1 jobs: ['7481497'] 2023-12-07T20:37:01.197 INFO:scrape:suites: ['agent/off', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_adoption}'] 2023-12-07T20:37:01.197 INFO:scrape: 2023-12-07T20:37:01.197 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi082 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2d90d175e63a3e83fe3e34fdef509d252350e311 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2023-12-07T20:37:01.197 INFO:scrape:1 jobs: ['7481365'] 2023-12-07T20:37:01.197 INFO:scrape:suites: ['clusters/{fixed-2', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rados_api_tests}'] 2023-12-07T20:37:01.198 INFO:scrape: 2023-12-07T20:37:01.198 INFO:scrape:Failure: Command failed on smithi031 with status 1: 'sudo yum -y install ceph' 2023-12-07T20:37:01.198 INFO:scrape:8 jobs: ['7481341', '7481716', '7481455', '7481686', '7481598', '7481249', '7481231', '7481477'] 2023-12-07T20:37:01.198 INFO:scrape:suites intersection: [] 2023-12-07T20:37:01.198 INFO:scrape:suites union: ['agent/off', 'agent/on', 'mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_adoption}', 'task/test_ca_signed_key}', 'task/test_extra_daemon_features}', 'task/test_host_drain}', 'task/test_orch_cli_mon}', 'task/test_orch_cli}', 'task/test_rgw_multisite}', 'task/test_set_mon_crush_locations}'] 2023-12-07T20:37:01.198 INFO:scrape: 2023-12-07T20:37:01.198 INFO:scrape:Failure: Command failed on smithi033 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2d90d175e63a3e83fe3e34fdef509d252350e311 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f707826-94b6-11ee-95a2-87774f69a715 -- ceph rgw realm bootstrap -i -' 2023-12-07T20:37:01.198 INFO:scrape:2 jobs: ['7481210', '7481734'] 2023-12-07T20:37:01.198 INFO:scrape:suites intersection: ['agent/off', 'mon_election/connectivity', 'task/test_rgw_multisite}'] 2023-12-07T20:37:01.199 INFO:scrape:suites union: ['agent/off', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_rgw_multisite}'] 2023-12-07T20:37:01.199 INFO:scrape: 2023-12-07T20:37:01.199 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi137 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2d90d175e63a3e83fe3e34fdef509d252350e311 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-12-07T20:37:01.199 INFO:scrape:2 jobs: ['7481550', '7481246'] 2023-12-07T20:37:01.199 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-bitmap}', 'tasks/e2e}'] 2023-12-07T20:37:01.199 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-bitmap}', 'tasks/e2e}'] 2023-12-07T20:37:01.199 INFO:scrape: 2023-12-07T20:37:01.199 INFO:scrape:Dead: None 2023-12-07T20:37:01.199 INFO:scrape:2 jobs: ['7481530', '7481216'] 2023-12-07T20:37:01.200 INFO:scrape: 2023-12-07T20:37:01.200 INFO:scrape:Crash: Test failure: test_turn_off_module (tasks.mgr.test_progress.TestProgress) 2023-12-07T20:37:01.200 INFO:scrape:ceph version 19.0.0-44-g2d90d175 (2d90d175e63a3e83fe3e34fdef509d252350e311) reef (dev) 1: /lib64/libc.so.6(+0x54db0) [0x7f8f3b854db0] 2: /lib64/libc.so.6(+0xa154c) [0x7f8f3b8a154c] 3: raise() 4: abort() 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5560c05fe000] 6: (KernelDevice::_aio_thread()+0x10f6) [0x5560c0f4ee36] 7: ceph-osd(+0xda3021) [0x5560c0f30021] 8: /lib64/libc.so.6(+0x9f802) [0x7f8f3b89f802] 9: /lib64/libc.so.6(+0x3f450) [0x7f8f3b83f450] 2023-12-07T20:37:01.200 INFO:scrape:1 jobs: ['7481237'] 2023-12-07T20:37:01.200 INFO:scrape:suites: ['debug/mgr', 'mgr_ttl_cache/disable', 'mon_election/classic', 'rados/mgr/{clusters/{2-node-mgr}', 'random-objectstore$/{bluestore-hybrid}', 'supported-random-distro$/{centos_latest}', 'tasks/progress}'] 2023-12-07T20:37:01.200 INFO:scrape: 2023-12-07T20:37:01.200 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' 2023-12-07T20:37:01.200 INFO:scrape:2 jobs: ['7481259', '7481580'] 2023-12-07T20:37:01.200 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output'] 2023-12-07T20:37:01.200 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}'] 2023-12-07T20:37:01.200 INFO:scrape: 2023-12-07T20:37:01.200 INFO:scrape:Failure: Command failed (workunit test post-file.sh) on smithi097 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2d90d175e63a3e83fe3e34fdef509d252350e311 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh' 2023-12-07T20:37:01.201 INFO:scrape:2 jobs: ['7481461', '7481773'] 2023-12-07T20:37:01.201 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/ceph-post-file'] 2023-12-07T20:37:01.201 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/ceph-post-file', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}'] 2023-12-07T20:37:01.201 INFO:scrape: 2023-12-07T20:37:01.201 INFO:scrape:Failure: Command failed (workunit test mon/mkfs.sh) on smithi186 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2d90d175e63a3e83fe3e34fdef509d252350e311 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh' 2023-12-07T20:37:01.201 INFO:scrape:1 jobs: ['7481769'] 2023-12-07T20:37:01.201 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{ubuntu_latest}', 'workloads/mon}'] 2023-12-07T20:37:01.201 INFO:scrape: 2023-12-07T20:37:01.201 INFO:scrape:Failure: Command failed on smithi137 with status 127: "sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2d90d175e63a3e83fe3e34fdef509d252350e311 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62b34fe4-94bd-11ee-95a2-87774f69a715 -- ceph orch apply prometheus '1;smithi137=a'" 2023-12-07T20:37:01.201 INFO:scrape:1 jobs: ['7481318'] 2023-12-07T20:37:01.201 INFO:scrape:suites: ['0-nvme-loop', 'agent/on', 'fixed-2', 'mon_election/classic', 'rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8', 'start}'] 2023-12-07T20:37:01.202 INFO:scrape: 2023-12-07T20:37:01.212 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/ failed: 27 dead: 6 running: 0 waiting: 0 queued: 0 passed: 280 Fail ================================================================= [7481210] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:17:43 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481210/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481210/ sentry: https://sentry.ceph.com/organizations/ceph/?query=070b9b3cf4c84280b9ef5f99289e9103 Command failed on smithi033 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:2d90d175e63a3e83fe3e34fdef509d252350e311 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f707826-94b6-11ee-95a2-87774f69a715 -- ceph rgw realm bootstrap -i -' [7481219] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:26:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481219/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481219/ valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate [7481231] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:11:46 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481231/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481231/ sentry: https://sentry.ceph.com/organizations/ceph/?query=de8028a63c39468db01818e493f4f1b1 Command failed on smithi176 with status 1: 'sudo yum -y install ceph' [7481237] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_latest} tasks/progress} ----------------------------------------------------------------- time: 00:22:29 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481237/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481237/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2f2c879cc17d4cb7974bb43fc99cfdaf Test failure: test_turn_off_module (tasks.mgr.test_progress.TestProgress) [7481246] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/e2e} ----------------------------------------------------------------- time: 00:29:53 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481246/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481246/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6c96ad4e1e0940fdbd5f0349ca9e1432 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi082 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2d90d175e63a3e83fe3e34fdef509d252350e311 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7481249] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_ca_signed_key} ----------------------------------------------------------------- time: 00:11:15 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481249/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481249/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a83836efd8d949ab83b96daee7d21363 Command failed on smithi104 with status 1: 'sudo yum -y install ceph' [7481259] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:09:30 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481259/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481259/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f12f331bf60942e7a5f4750cde537ba8 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7481318] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:17:09 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481318/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481318/ sentry: https://sentry.ceph.com/organizations/ceph/?query=42749a1e38c04d03911a10d8ad09b883 Command failed on smithi137 with status 127: "sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:2d90d175e63a3e83fe3e34fdef509d252350e311 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62b34fe4-94bd-11ee-95a2-87774f69a715 -- ceph orch apply prometheus '1;smithi137=a'" [7481322] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 01:54:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481322/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481322/ valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate [7481341] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_host_drain} ----------------------------------------------------------------- time: 00:11:42 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481341/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481341/ sentry: https://sentry.ceph.com/organizations/ceph/?query=673d0008984b493ba90422223267965e Command failed on smithi031 with status 1: 'sudo yum -y install ceph' [7481365] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:26:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481365/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481365/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5a971aa0d4e74f64b43a65db31b351e0 Command failed (workunit test rados/test.sh) on smithi082 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2d90d175e63a3e83fe3e34fdef509d252350e311 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [7481455] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:11:45 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481455/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481455/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea46a7c24b6e49b79174b1075b3f91fd Command failed on smithi026 with status 1: 'sudo yum -y install ceph' [7481461] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:08:47 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481461/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481461/ sentry: https://sentry.ceph.com/organizations/ceph/?query=890450e2c3e540e8900eedb65672ee66 Command failed (workunit test post-file.sh) on smithi097 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2d90d175e63a3e83fe3e34fdef509d252350e311 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh' [7481467] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:43:35 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481467/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481467/ valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate [7481477] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_set_mon_crush_locations} ----------------------------------------------------------------- time: 00:10:54 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481477/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481477/ sentry: https://sentry.ceph.com/organizations/ceph/?query=775850ad3fff48e796332f464e0c895a Command failed on smithi150 with status 1: 'sudo yum -y install ceph' [7481497] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:10:09 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481497/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481497/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c426bb084234453c99702bc4727b0563 Command failed (workunit test cephadm/test_adoption.sh) on smithi005 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2d90d175e63a3e83fe3e34fdef509d252350e311 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [7481550] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/e2e} ----------------------------------------------------------------- time: 00:29:19 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481550/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481550/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e0e0fcc1b4644a149ba3e48534a34d0c Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi137 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2d90d175e63a3e83fe3e34fdef509d252350e311 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7481580] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:30 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481580/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481580/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fab2053db9f040f5a96e169f48252e62 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7481598] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_extra_daemon_features} ----------------------------------------------------------------- time: 00:10:53 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481598/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481598/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e385d0027f2f49d684c86d776fa074d3 Command failed on smithi078 with status 1: 'sudo yum -y install ceph' [7481602] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} ----------------------------------------------------------------- time: 00:18:12 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481602/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481602/ valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate [7481603] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:38:04 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481603/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481603/ valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate [7481686] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:11:20 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481686/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481686/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1190592824c84d4e91d187d68f302858 Command failed on smithi169 with status 1: 'sudo yum -y install ceph' [7481716] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:12:17 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481716/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481716/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4f278bb70aa547098fa99139076073de Command failed on smithi169 with status 1: 'sudo yum -y install ceph' [7481734] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:18:35 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481734/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481734/ sentry: https://sentry.ceph.com/organizations/ceph/?query=877349aeca4547e99281d90635461b04 Command failed on smithi110 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:2d90d175e63a3e83fe3e34fdef509d252350e311 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2ccab928-94de-11ee-95a2-87774f69a715 -- ceph rgw realm bootstrap -i -' [7481745] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 01:41:19 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481745/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481745/ valgrind error: Leak_StillReachable operator new[](unsigned long) allocate allocate [7481769] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} ----------------------------------------------------------------- time: 00:15:37 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481769/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481769/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0c32e5f2e4324f0e85c2606c725cd850 Command failed (workunit test mon/mkfs.sh) on smithi186 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2d90d175e63a3e83fe3e34fdef509d252350e311 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh' [7481773] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:10:44 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481773/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481773/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eaaad47b0a2d4e1cb250672cc0088eb8 Command failed (workunit test post-file.sh) on smithi066 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2d90d175e63a3e83fe3e34fdef509d252350e311 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh' Dead ================================================================= [7481216] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481216/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481216/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7481395] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481395/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481395/ hit max job timeout [7481399] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481399/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481399/ hit max job timeout [7481530] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481530/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481530/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7481710] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481710/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481710/ hit max job timeout [7481714] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481714/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481714/ hit max job timeout Pass ================================================================= [7481204] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:13:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481204/ [7481205] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:46:01 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481205/ [7481206] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:36:15 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481206/ [7481207] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/per_module_finisher_stats} time: 00:11:59 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481207/ [7481208] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:56 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481208/ [7481209] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:24 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481209/ [7481211] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:41 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481211/ [7481212] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:22:32 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481212/ [7481213] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:18:57 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481213/ [7481214] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:15:12 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481214/ [7481215] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:29 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481215/ [7481217] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/readwrite} time: 00:12:53 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481217/ [7481218] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:20:05 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481218/ [7481220] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:05 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481220/ [7481221] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:22:27 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481221/ [7481222] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:17:53 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481222/ [7481223] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:53 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481223/ [7481224] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:24:10 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481224/ [7481225] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:13 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481225/ [7481226] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:16:08 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481226/ [7481227] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_set_mon_crush_locations} time: 00:19:09 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481227/ [7481228] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:11:35 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481228/ [7481229] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} time: 02:39:33 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481229/ [7481230] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_api_tests} time: 00:29:54 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481230/ [7481232] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:28:08 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481232/ [7481233] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:33 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481233/ [7481234] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_latest}} time: 00:08:12 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481234/ [7481235] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:11:09 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481235/ [7481236] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:32 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481236/ [7481238] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:11:24 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481238/ [7481239] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:15:19 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481239/ [7481240] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:19:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481240/ [7481241] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:13:49 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481241/ [7481242] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:19 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481242/ [7481243] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:35:11 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481243/ [7481244] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:42 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481244/ [7481245] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:18:54 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481245/ [7481247] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:22:21 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481247/ [7481248] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:15:29 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481248/ [7481250] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:37 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481250/ [7481251] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:28 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481251/ [7481252] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:27:20 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481252/ [7481253] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:26:01 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481253/ [7481254] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:13:34 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481254/ [7481255] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:13:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481255/ [7481257] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:26:08 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481257/ [7481261] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:41 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481261/ [7481263] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:23:57 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481263/ [7481265] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_cephadm} time: 00:19:40 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481265/ [7481267] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} time: 02:31:28 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481267/ [7481269] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:44 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481269/ [7481271] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/scrub_test} time: 00:11:43 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481271/ [7481273] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:19:45 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481273/ [7481275] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:13:56 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481275/ [7481277] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:43:47 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481277/ [7481279] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:12:43 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481279/ [7481281] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:23:35 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481281/ [7481283] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:14:05 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481283/ [7481285] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:33:47 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481285/ [7481287] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:13:31 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481287/ [7481289] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:12 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481289/ [7481291] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:14:16 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481291/ [7481293] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:28:59 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481293/ [7481295] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:21:01 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481295/ [7481297] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_cephadm_repos} time: 00:09:24 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481297/ [7481299] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:20:47 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481299/ [7481301] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:13:11 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481301/ [7481303] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{ubuntu_latest}} time: 00:10:37 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481303/ [7481305] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:22:48 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481305/ [7481308] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_extra_daemon_features} time: 00:16:37 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481308/ [7481309] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:21:31 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481309/ [7481311] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:13 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481311/ [7481313] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache} time: 00:14:21 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481313/ [7481315] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:15:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481315/ [7481320] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/libcephsqlite} time: 00:13:35 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481320/ [7481324] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:14:09 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481324/ [7481326] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:19:31 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481326/ [7481327] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481327/ [7481329] rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub} time: 02:23:51 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481329/ [7481331] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:19:11 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481331/ [7481333] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:12:38 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481333/ [7481335] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:40:09 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481335/ [7481337] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} time: 00:13:39 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481337/ [7481339] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:24:34 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481339/ [7481343] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:43 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481343/ [7481345] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} time: 00:33:16 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481345/ [7481347] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:09:18 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481347/ [7481349] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:16:38 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481349/ [7481351] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/dedup-io-snaps} time: 00:17:15 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481351/ [7481353] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} time: 00:09:10 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481353/ [7481355] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:40 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481355/ [7481357] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:27:56 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481357/ [7481359] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:24:32 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481359/ [7481361] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:30:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481361/ [7481363] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:14:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481363/ [7481367] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:29:08 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481367/ [7481369] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:22:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481369/ [7481371] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_monitoring_stack_basic} time: 00:25:43 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481371/ [7481373] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:28:18 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481373/ [7481375] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:12:59 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481375/ [7481377] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:32:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481377/ [7481379] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:10 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481379/ [7481381] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:31:56 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481381/ [7481383] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481383/ [7481385] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:31:22 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481385/ [7481387] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} time: 01:23:13 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481387/ [7481389] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_latest} tasks/crash} time: 00:11:57 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481389/ [7481391] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:42:04 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481391/ [7481393] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:15:02 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481393/ [7481397] rados/standalone/{supported-random-distro$/{centos_latest} workloads/c2c} time: 00:15:06 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481397/ [7481401] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:16:48 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481401/ [7481403] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:12:53 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481403/ [7481405] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_orch_cli} time: 00:21:17 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481405/ [7481407] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:32 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481407/ [7481409] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:59 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481409/ [7481411] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:27 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481411/ [7481413] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:42:21 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481413/ [7481415] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:32 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481415/ [7481417] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:15:24 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481417/ [7481419] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} time: 00:34:27 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481419/ [7481421] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:14:33 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481421/ [7481423] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/rados_cls_all} time: 00:16:36 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481423/ [7481425] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:14:14 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481425/ [7481427] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:10:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481427/ [7481429] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:51 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481429/ [7481431] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:59 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481431/ [7481433] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench} time: 00:28:07 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481433/ [7481435] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:43 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481435/ [7481437] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_orch_cli_mon} time: 00:27:39 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481437/ [7481439] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:15:48 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481439/ [7481441] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:41 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481441/ [7481443] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:15 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481443/ [7481445] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:13:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481445/ [7481447] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:27:22 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481447/ [7481449] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:14:18 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481449/ [7481451] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:32 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481451/ [7481453] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_latest} tasks/failover} time: 00:14:05 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481453/ [7481457] rados/standalone/{supported-random-distro$/{centos_latest} workloads/crush} time: 00:21:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481457/ [7481459] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:15:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481459/ [7481463] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:18:48 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481463/ [7481465] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:32:59 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481465/ [7481469] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:16:10 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481469/ [7481471] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/rados_python} time: 00:15:39 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481471/ [7481473] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:13:38 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481473/ [7481475] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:26 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481475/ [7481479] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481479/ [7481481] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:15:32 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481481/ [7481483] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:15:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481483/ [7481485] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_latest}} time: 00:08:42 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481485/ [7481487] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481487/ [7481489] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:18:57 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481489/ [7481491] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:09 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481491/ [7481493] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:25:27 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481493/ [7481495] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:28:33 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481495/ [7481499] rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:12:44 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481499/ [7481501] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:19:15 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481501/ [7481503] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:14:53 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481503/ [7481505] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:33 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481505/ [7481507] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:24 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481507/ [7481509] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:14:40 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481509/ [7481511] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/rados_stress_watch} time: 00:15:53 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481511/ [7481513] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:28:18 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481513/ [7481515] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:20:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481515/ [7481517] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:21:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481517/ [7481520] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:20:30 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481520/ [7481522] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 01:31:14 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481522/ [7481524] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_ca_signed_key} time: 00:16:13 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481524/ [7481526] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:18 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481526/ [7481528] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:28 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481528/ [7481532] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:34:40 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481532/ [7481533] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:22:19 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481533/ [7481536] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:18:36 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481536/ [7481538] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:19:35 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481538/ [7481540] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:30 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481540/ [7481542] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_cephadm} time: 00:17:25 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481542/ [7481544] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:10:57 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481544/ [7481546] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:15:24 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481546/ [7481548] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:12:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481548/ [7481552] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 01:30:02 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481552/ [7481554] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:18:41 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481554/ [7481556] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:23:20 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481556/ [7481558] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_5925} time: 00:11:35 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481558/ [7481560] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:09:48 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481560/ [7481562] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:12:16 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481562/ [7481564] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:19:33 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481564/ [7481566] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} time: 00:09:36 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481566/ [7481568] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:11:16 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481568/ [7481570] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:39 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481570/ [7481572] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_latest} tasks/module_selftest} time: 00:24:59 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481572/ [7481574] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:31:36 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481574/ [7481576] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:19:14 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481576/ [7481578] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_cephadm_repos} time: 00:11:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481578/ [7481582] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:17:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481582/ [7481584] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:19:18 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481584/ [7481586] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 01:27:48 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481586/ [7481588] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:07 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481588/ [7481590] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:12:59 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481590/ [7481592] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:22 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481592/ [7481594] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:28:59 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481594/ [7481596] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:13:08 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481596/ [7481600] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:18:54 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481600/ [7481606] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:32:48 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481606/ [7481607] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:49 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481607/ [7481609] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:20:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481609/ [7481611] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:50 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481611/ [7481614] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:29:36 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481614/ [7481616] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:34:20 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481616/ [7481618] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:11:33 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481618/ [7481620] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_host_drain} time: 00:23:11 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481620/ [7481621] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:19:48 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481621/ [7481624] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:28:36 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481624/ [7481626] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:12 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481626/ [7481628] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_latest} tasks/per_module_finisher_stats} time: 00:10:18 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481628/ [7481630] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:19:01 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481630/ [7481632] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:54 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481632/ [7481634] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:19:42 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481634/ [7481635] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:10:53 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481635/ [7481637] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:55 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481637/ [7481639] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:19:44 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481639/ [7481641] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:16:37 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481641/ [7481643] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:22:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481643/ [7481645] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} time: 01:10:53 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481645/ [7481647] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 00:16:45 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481647/ [7481649] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:30:11 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481649/ [7481651] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:49 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481651/ [7481653] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:23:10 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481653/ [7481655] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:47 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481655/ [7481658] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:45 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481658/ [7481660] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:23:58 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481660/ [7481662] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:39:08 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481662/ [7481664] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:18:18 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481664/ [7481666] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_monitoring_stack_basic} time: 00:22:15 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481666/ [7481668] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:16:10 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481668/ [7481670] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:25:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481670/ [7481672] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:14 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481672/ [7481674] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:28:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481674/ [7481676] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:15:08 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481676/ [7481678] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:51 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481678/ [7481680] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:15:46 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481680/ [7481682] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:17:55 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481682/ [7481684] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:36:14 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481684/ [7481688] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_latest} tasks/progress} time: 00:22:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481688/ [7481690] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:13:40 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481690/ [7481692] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:24:03 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481692/ [7481694] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:57:06 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481694/ [7481696] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:23 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481696/ [7481698] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:53 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481698/ [7481700] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:27:02 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481700/ [7481702] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:19:18 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481702/ [7481704] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:27:57 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481704/ [7481706] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:26:46 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481706/ [7481708] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/dashboard} time: 01:28:16 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481708/ [7481712] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon-stretch} time: 00:24:11 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481712/ [7481718] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:14:12 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481718/ [7481720] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:28:56 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481720/ [7481722] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:13:45 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481722/ [7481724] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:18:54 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481724/ [7481726] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:11:26 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481726/ [7481728] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:15 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481728/ [7481730] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:06 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481730/ [7481732] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:12:10 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481732/ [7481736] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:36:27 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481736/ [7481738] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:22:49 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481738/ [7481739] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:12:02 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481739/ [7481741] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:06 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481741/ [7481743] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:00 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481743/ [7481747] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_latest} tasks/prometheus} time: 00:11:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481747/ [7481749] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 02:47:17 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481749/ [7481751] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_latest}} time: 02:08:05 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481751/ [7481753] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:31 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481753/ [7481755] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:21:18 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481755/ [7481757] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:15:43 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481757/ [7481759] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:09:43 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481759/ [7481761] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:15:19 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481761/ [7481763] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:47:52 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481763/ [7481765] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_set_mon_crush_locations} time: 00:20:03 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481765/ [7481767] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/one workloads/rados_mon_workunits} time: 00:31:05 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481767/ [7481771] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache} time: 00:12:47 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481771/ [7481775] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} time: 00:09:25 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481775/ [7481777] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:02 info: https://pulpito.ceph.com/yuriw-2023-12-07_01:25:18-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7481777/