2023-10-20T15:08:14.153 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-20T15:08:14.180 INFO:teuthology.results:subset: '111/120000' 2023-10-20T15:08:14.180 INFO:teuthology.results:seed: '9270' 2023-10-21T03:39:25.399 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-21T03:39:25.451 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-10-21T06:10:39.612 INFO:teuthology.results:Tests finished! gathering results... 2023-10-21T06:11:04.545 INFO:scrape:Found 307 jobs 2023-10-21T06:11:05.017 WARNING:scrape:Misunderstood line: 2023-10-21T06:11:05.171 WARNING:scrape:Misunderstood line: 2023-10-21T06:11:05.869 WARNING:scrape:Misunderstood line: 2023-10-21T06:11:06.220 WARNING:scrape:Misunderstood line: 2023-10-21T06:11:08.321 WARNING:scrape:Misunderstood line: 2023-10-21T06:11:08.322 INFO:scrape:Found 5 distinct failure reasons 2023-10-21T06:11:08.322 INFO:scrape:Crash: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 2023-10-21T06:11:08.323 INFO:scrape:ceph version 18.2.0-909-g4195210f (4195210f984d2f5c82ddc9ef0cb14f99dc3a4ea6) reef (stable) 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f79c6603475] 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x7a5) [0x563ecaee3725] 3: (write_callback(void*, void*)+0x1e) [0x563ecaef66ce] 4: /lib64/librados.so.2(+0xc01dc) [0x7f79c79321dc] 5: /lib64/librados.so.2(+0xd5ea5) [0x7f79c7947ea5] 6: /lib64/librados.so.2(+0xd663a) [0x7f79c794863a] 7: /lib64/librados.so.2(+0xc4f51) [0x7f79c7936f51] 8: /lib64/librados.so.2(+0xdaf5c) [0x7f79c794cf5c] 9: /lib64/libstdc++.so.6(+0xc2b13) [0x7f79c493bb13] 10: /lib64/libpthread.so.0(+0x81ca) [0x7f79c5a4f1ca] 2023-10-21T06:11:08.323 INFO:scrape:1 jobs: ['7433318'] 2023-10-21T06:11:08.324 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/none', 'msgr/async-v2only', 'objectstore/bluestore-hybrid', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{centos_8}}'] 2023-10-21T06:11:08.324 INFO:scrape: 2023-10-21T06:11:08.324 INFO:scrape:Valgrind: mon (Leak_StillReachable) 2023-10-21T06:11:08.325 INFO:scrape:5 jobs: ['7433225', '7433224', '7433087', '7433294', '7433159'] 2023-10-21T06:11:08.325 INFO:scrape:suites intersection: [] 2023-10-21T06:11:08.326 INFO:scrape:suites union: ['2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'validater/valgrind}'] 2023-10-21T06:11:08.326 INFO:scrape: 2023-10-21T06:11:08.326 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi072 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4195210f984d2f5c82ddc9ef0cb14f99dc3a4ea6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-10-21T06:11:08.327 INFO:scrape:2 jobs: ['7433353', '7433198'] 2023-10-21T06:11:08.327 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}'] 2023-10-21T06:11:08.328 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-zstd}', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'tasks/e2e}'] 2023-10-21T06:11:08.328 INFO:scrape: 2023-10-21T06:11:08.328 INFO:scrape:Failure: Test failure: test_update_export_ro_to_rw (tasks.cephfs.test_nfs.TestNFS) 2023-10-21T06:11:08.329 INFO:scrape:1 jobs: ['7433100'] 2023-10-21T06:11:08.329 INFO:scrape:suites: ['agent/on', 'mon_election/classic', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_nfs}'] 2023-10-21T06:11:08.330 INFO:scrape: 2023-10-21T06:11:08.330 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' 2023-10-21T06:11:08.330 INFO:scrape:2 jobs: ['7433054', '7433207'] 2023-10-21T06:11:08.331 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output'] 2023-10-21T06:11:08.331 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}'] 2023-10-21T06:11:08.332 INFO:scrape: 2023-10-21T06:11:08.342 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/ failed: 11 dead: 0 running: 0 waiting: 0 queued: 0 passed: 296 Fail ================================================================= [7433054] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:09:17 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433054/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433054/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e8980145b82049049ddacc628d243a92 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7433087] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 01:58:44 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433087/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433087/ "2023-10-20T23:37:38.676708+0000 mon.a (mon.0) 835 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7433100] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:31:57 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433100/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433100/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ddfbb99896e44c0e9b12db4f0505f53d Test failure: test_update_export_ro_to_rw (tasks.cephfs.test_nfs.TestNFS) [7433159] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:49:52 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433159/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433159/ saw valgrind issues [7433198] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} tasks/e2e} ----------------------------------------------------------------- time: 00:31:38 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433198/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433198/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8cb87a927774491a34806e6cf229cf5 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi040 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4195210f984d2f5c82ddc9ef0cb14f99dc3a4ea6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7433207] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:08 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433207/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433207/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da63060be98d4ebbab3b81738796b3f6 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7433224] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} ----------------------------------------------------------------- time: 00:18:30 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433224/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433224/ saw valgrind issues [7433225] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:32:06 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433225/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433225/ saw valgrind issues [7433294] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 02:06:05 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433294/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433294/ "2023-10-21T04:18:44.062457+0000 mon.a (mon.0) 684 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log [7433318] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:15:02 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433318/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433318/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' [7433353] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/e2e} ----------------------------------------------------------------- time: 00:30:36 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433353/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433353/ sentry: https://sentry.ceph.com/organizations/ceph/?query=705850193cef4da19fdc1564a2332821 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi072 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4195210f984d2f5c82ddc9ef0cb14f99dc3a4ea6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' Pass ================================================================= [7433047] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:15:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433047/ [7433048] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:43 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433048/ [7433049] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:24:24 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433049/ [7433050] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_ca_signed_key} time: 00:14:49 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433050/ [7433051] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:58 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433051/ [7433052] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:32:14 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433052/ [7433053] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:13:52 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433053/ [7433055] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:25:37 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433055/ [7433056] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:16:33 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433056/ [7433057] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:07 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433057/ [7433058] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:26:12 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433058/ [7433059] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/osd} time: 02:39:25 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433059/ [7433060] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:17 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433060/ [7433061] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:19:08 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433061/ [7433062] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:12:47 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433062/ [7433063] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:15:46 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433063/ [7433064] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/prometheus} time: 00:17:27 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433064/ [7433065] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:42:11 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433065/ [7433066] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_cephadm} time: 00:16:52 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433066/ [7433067] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:23:48 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433067/ [7433068] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433068/ [7433069] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:34:19 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433069/ [7433070] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}} time: 00:11:12 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433070/ [7433071] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:19:36 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433071/ [7433072] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:12 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433072/ [7433073] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:38 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433073/ [7433074] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:26:42 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433074/ [7433075] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:13:47 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433075/ [7433076] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{ubuntu_20.04}} time: 00:08:18 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433076/ [7433077] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_cephadm_repos} time: 00:11:32 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433077/ [7433078] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:26:50 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433078/ [7433079] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:25:32 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433079/ [7433080] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:27 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433080/ [7433081] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:18:11 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433081/ [7433082] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache} time: 00:13:58 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433082/ [7433083] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:19 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433083/ [7433084] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:22:13 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433084/ [7433085] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:17:51 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433085/ [7433086] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:19:08 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433086/ [7433088] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:14:05 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433088/ [7433089] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:15:58 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433089/ [7433090] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:14 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433090/ [7433091] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/scrub} time: 02:48:17 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433091/ [7433092] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/workunits} time: 00:13:24 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433092/ [7433093] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}} time: 00:32:55 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433093/ [7433094] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} time: 00:12:10 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433094/ [7433095] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:26:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433095/ [7433096] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:59 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433096/ [7433097] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:48 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433097/ [7433098] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_workunits} time: 00:29:31 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433098/ [7433099] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:10:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433099/ [7433101] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/dedup-io-snaps} time: 00:17:16 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433101/ [7433102] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} time: 00:08:54 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433102/ [7433103] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:27:27 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433103/ [7433104] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:24:32 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433104/ [7433105] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:30:20 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433105/ [7433106] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:14:28 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433106/ [7433107] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} tasks/rados_api_tests} time: 00:28:27 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433107/ [7433108] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:29:16 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433108/ [7433109] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:21:52 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433109/ [7433110] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433110/ [7433111] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:30:34 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433111/ [7433112] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:40 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433112/ [7433113] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}} time: 00:32:50 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433113/ [7433114] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:16 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433114/ [7433115] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:32:11 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433115/ [7433116] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:32 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433116/ [7433117] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_orch_cli} time: 00:16:44 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433117/ [7433118] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:30:14 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433118/ [7433119] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/dashboard} time: 01:17:28 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433119/ [7433120] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_8} tasks/crash} time: 00:16:37 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433120/ [7433121] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:43:05 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433121/ [7433122] rados/rest/{mgr-restful supported-random-distro$/{centos_latest}} time: 00:13:05 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433122/ [7433123] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:24:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433123/ [7433124] rados/standalone/{supported-random-distro$/{centos_latest} workloads/c2c} time: 00:15:13 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433124/ [7433125] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:30:24 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433125/ [7433126] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:19:20 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433126/ [7433127] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:13:12 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433127/ [7433128] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:17:03 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433128/ [7433129] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:09:03 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433129/ [7433130] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:32 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433130/ [7433131] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:37:49 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433131/ [7433132] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:17:01 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433132/ [7433133] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:15:15 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433133/ [7433134] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:12:50 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433134/ [7433135] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/one workloads/snaps-few-objects} time: 00:32:03 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433135/ [7433136] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:12:52 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433136/ [7433137] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:22:14 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433137/ [7433138] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:12:22 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433138/ [7433139] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_orch_cli_mon} time: 00:26:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433139/ [7433140] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/radosbench} time: 00:25:58 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433140/ [7433141] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:39 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433141/ [7433142] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:26 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433142/ [7433143] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:17:19 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433143/ [7433144] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:02 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433144/ [7433145] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:13:41 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433145/ [7433146] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:15:47 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433146/ [7433147] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:27:26 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433147/ [7433148] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:11:08 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433148/ [7433149] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_rgw_multisite} time: 00:20:32 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433149/ [7433150] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:11 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433150/ [7433151] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/failover} time: 00:17:54 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433151/ [7433152] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/crush} time: 00:22:24 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433152/ [7433153] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:47 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433153/ [7433154] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:13:25 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433154/ [7433155] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:14:57 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433155/ [7433156] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:14 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433156/ [7433157] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:16:12 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433157/ [7433158] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:30:46 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433158/ [7433160] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:17:36 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433160/ [7433161] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:16:26 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433161/ [7433162] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:42 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433162/ [7433163] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_set_mon_crush_locations} time: 00:23:05 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433163/ [7433164] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:41 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433164/ [7433165] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:13:26 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433165/ [7433166] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:20:56 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433166/ [7433167] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:10:21 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433167/ [7433168] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/pool-create-delete} time: 00:22:49 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433168/ [7433169] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:19:11 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433169/ [7433170] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} tasks/mon_recovery} time: 00:22:59 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433170/ [7433171] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:14:16 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433171/ [7433172] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_adoption} time: 00:15:35 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433172/ [7433173] rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:12:23 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433173/ [7433174] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:17:58 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433174/ [7433175] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:14:36 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433175/ [7433176] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:05 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433176/ [7433177] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:16:22 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433177/ [7433178] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} tasks/rados_stress_watch} time: 00:19:12 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433178/ [7433179] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:52 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433179/ [7433180] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:28:25 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433180/ [7433181] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:25:48 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433181/ [7433182] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:22 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433182/ [7433183] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:23:22 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433183/ [7433184] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/erasure-code} time: 01:27:29 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433184/ [7433185] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:17 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433185/ [7433186] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_ca_signed_key} time: 00:16:36 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433186/ [7433187] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433187/ [7433188] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:38:04 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433188/ [7433189] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:21:43 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433189/ [7433190] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:11:13 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433190/ [7433191] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:18:53 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433191/ [7433192] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:32 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433192/ [7433193] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:24:33 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433193/ [7433194] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:50 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433194/ [7433195] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:14:50 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433195/ [7433196] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:18:06 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433196/ [7433197] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:18:14 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433197/ [7433199] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:37 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433199/ [7433200] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 01:37:21 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433200/ [7433201] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:21:44 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433201/ [7433202] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} time: 00:13:04 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433202/ [7433203] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_cephadm} time: 00:16:58 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433203/ [7433204] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:13:05 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433204/ [7433205] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:15:01 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433205/ [7433206] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} tasks/mon_clock_no_skews} time: 00:08:50 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433206/ [7433208] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_latest} tasks/module_selftest} time: 00:30:07 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433208/ [7433209] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:13:35 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433209/ [7433210] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:30:36 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433210/ [7433211] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_latest}} time: 00:12:59 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433211/ [7433212] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:18:12 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433212/ [7433213] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:20:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433213/ [7433214] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_cephadm_repos} time: 00:09:10 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433214/ [7433215] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:14:51 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433215/ [7433216] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 01:48:37 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433216/ [7433217] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:13:07 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433217/ [7433218] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:08 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433218/ [7433219] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:25:38 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433219/ [7433220] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:13 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433220/ [7433221] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:18:12 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433221/ [7433222] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:20:16 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433222/ [7433223] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:21:29 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433223/ [7433226] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:36:17 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433226/ [7433227] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:51 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433227/ [7433228] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:30 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433228/ [7433229] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:25:22 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433229/ [7433230] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_big} time: 00:30:31 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433230/ [7433231] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:55 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433231/ [7433232] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:17:52 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433232/ [7433233] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:25:54 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433233/ [7433234] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:28:36 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433234/ [7433235] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:14:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433235/ [7433236] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_20.04} tasks/per_module_finisher_stats} time: 00:11:05 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433236/ [7433237] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:25:17 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433237/ [7433238] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:31 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433238/ [7433239] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:19:08 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433239/ [7433240] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} time: 00:08:30 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433240/ [7433241] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:22:24 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433241/ [7433242] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:20:48 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433242/ [7433243] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_nfs} time: 00:32:31 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433243/ [7433244] rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc} time: 01:04:26 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433244/ [7433245] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 00:14:31 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433245/ [7433246] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:26:14 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433246/ [7433247] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:41 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433247/ [7433248] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:21:05 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433248/ [7433249] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:14 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433249/ [7433250] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:58 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433250/ [7433251] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} tasks/rados_workunit_loadgen_mix} time: 00:22:04 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433251/ [7433252] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:38:22 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433252/ [7433253] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:18:56 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433253/ [7433254] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04}} time: 00:15:20 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433254/ [7433255] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433255/ [7433256] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_orch_cli} time: 00:18:40 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433256/ [7433257] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:29:16 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433257/ [7433258] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:27:40 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433258/ [7433259] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:51 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433259/ [7433260] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:15:24 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433260/ [7433261] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:55 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433261/ [7433262] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:25:33 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433262/ [7433263] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:12:49 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433263/ [7433264] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:32:04 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433264/ [7433265] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:23:34 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433265/ [7433266] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:13:40 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433266/ [7433267] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:16:04 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433267/ [7433268] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:14 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433268/ [7433269] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 01:01:24 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433269/ [7433270] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:12:57 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433270/ [7433271] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:29:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433271/ [7433272] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_orch_cli_mon} time: 00:26:10 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433272/ [7433273] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} tasks/mon_recovery} time: 00:16:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433273/ [7433274] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:28:04 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433274/ [7433275] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/dashboard} time: 01:14:43 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433275/ [7433276] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:18:11 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433276/ [7433277] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/mon-stretch} time: 00:26:55 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433277/ [7433278] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:32:15 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433278/ [7433279] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:16:26 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433279/ [7433280] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:17:44 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433280/ [7433281] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:29:31 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433281/ [7433282] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:13:20 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433282/ [7433283] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:52 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433283/ [7433284] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:23:21 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433284/ [7433285] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:02 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433285/ [7433286] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_rgw_multisite} time: 00:16:49 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433286/ [7433287] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:11:32 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433287/ [7433288] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:37:43 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433288/ [7433289] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:21:18 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433289/ [7433290] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:22:57 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433290/ [7433291] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:15:37 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433291/ [7433292] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:20:32 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433292/ [7433293] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:31 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433293/ [7433295] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_latest} tasks/prometheus} time: 00:13:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433295/ [7433296] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 01:21:38 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433296/ [7433297] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:20:56 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433297/ [7433298] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_8}} time: 02:21:11 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433298/ [7433299] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:19:11 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433299/ [7433300] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:16:02 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433300/ [7433301] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:01 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433301/ [7433302] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:15:48 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433302/ [7433303] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:31:38 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433303/ [7433304] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_set_mon_crush_locations} time: 00:26:30 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433304/ [7433305] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} time: 00:38:29 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433305/ [7433306] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 01:13:48 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433306/ [7433307] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache} time: 00:16:17 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433307/ [7433308] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:17:39 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433308/ [7433309] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_adoption} time: 00:19:25 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433309/ [7433310] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:08:18 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433310/ [7433311] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:20:37 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433311/ [7433312] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:21:31 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433312/ [7433313] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:14:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433313/ [7433314] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed} time: 00:21:21 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433314/ [7433315] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:30 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433315/ [7433316] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:22:34 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433316/ [7433317] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:07 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433317/ [7433319] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:50 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433319/ [7433320] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/repair_test} time: 00:16:11 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433320/ [7433321] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:21 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433321/ [7433322] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:15:35 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433322/ [7433323] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_20.04} tasks/workunits} time: 00:10:20 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433323/ [7433324] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-snaps} time: 00:22:56 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433324/ [7433325] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433325/ [7433326] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:14 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433326/ [7433327] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:16:56 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433327/ [7433328] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:12:50 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433328/ [7433329] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_ca_signed_key} time: 00:21:48 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433329/ [7433330] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:17:31 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433330/ [7433331] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:20:36 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433331/ [7433332] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:06 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433332/ [7433333] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:39:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433333/ [7433334] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:15 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433334/ [7433335] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:36 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433335/ [7433336] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd-backfill} time: 02:31:28 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433336/ [7433337] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:37:20 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433337/ [7433338] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/sync-many workloads/pool-create-delete} time: 00:16:14 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433338/ [7433339] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:20:39 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433339/ [7433340] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_latest}} time: 00:07:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433340/ [7433341] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:17:04 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433341/ [7433342] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:35:51 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433342/ [7433343] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}} time: 00:22:09 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433343/ [7433344] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:14:17 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433344/ [7433345] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_cephadm} time: 00:18:40 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433345/ [7433346] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:13:36 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433346/ [7433347] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:16:56 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433347/ [7433348] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_cephadm_repos} time: 00:09:36 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433348/ [7433349] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:44 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433349/ [7433350] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:23:29 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433350/ [7433351] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:59 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433351/ [7433352] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:21:43 info: http://pulpito.ceph.com/yuriw-2023-10-20_15:03:24-rados-wip-yuri3-testing-2023-10-18-1510-reef-distro-default-smithi/7433352/