2024-01-31T02:32:16.326 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-31T02:32:16.326 INFO:teuthology.results:subset: '111/120000' 2024-01-31T02:32:16.327 INFO:teuthology.results:seed: '6638' 2024-01-31T21:28:26.322 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-31T21:28:26.360 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-02-01T09:19:33.377 INFO:teuthology.results:Tests finished! gathering results... 2024-02-01T09:19:59.910 INFO:scrape:Found 328 jobs 2024-02-01T09:19:59.984 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539101/teuthology.log 2024-02-01T09:20:07.152 INFO:scrape:Found 10 distinct failure reasons 2024-02-01T09:20:07.152 INFO:scrape:Failure: Command failed on smithi194 with status 1: 'sudo yum install -y kernel' 2024-02-01T09:20:07.152 INFO:scrape:3 jobs: ['7538804', '7538802', '7538822'] 2024-02-01T09:20:07.152 INFO:scrape:suites intersection: [] 2024-02-01T09:20:07.152 INFO:scrape:suites union: ['2-inject-leak/mon', 'centos_latest}', 'ceph', 'clusters/3-mons', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/mon-delay', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/monthrash/{ceph', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'supported-random-distro$/{centos_latest}', 'tasks/mon_recovery', 'thrashers/one', 'thrashosds-health}', 'validater/lockdep}', 'workloads/snaps-few-objects}'] 2024-02-01T09:20:07.153 INFO:scrape: 2024-02-01T09:20:07.153 INFO:scrape:Dead: None 2024-02-01T09:20:07.153 INFO:scrape:7 jobs: ['7539101', '7538774', '7539062', '7539014', '7539182', '7538705', '7538858'] 2024-02-01T09:20:07.153 INFO:scrape: 2024-02-01T09:20:07.153 INFO:scrape:Dead: b'2024-02-01T06:09:53.146 DEBUG:teuthology.exit:Finished running handlers' 2024-02-01T09:20:07.153 INFO:scrape:10 jobs: ['7538925', '7538838', '7539168', '7539107', '7538738', '7539126', '7538796', '7538647', '7539170', '7539019'] 2024-02-01T09:20:07.153 INFO:scrape:suites intersection: ['rados'] 2024-02-01T09:20:07.153 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-5}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/read', 'fast/fast', 'fast/normal', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'supported-random-distro$/{centos_latest}', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'thrashers/careful', 'thrashers/default', 'thrashers/fastread', 'thrashers/minsize_recovery', 'thrashers/morepggrow', 'thrashers/pggrow', 'thrashosds-health', 'workloads/ec-pool-snaps-few-objects-overwrites}', 'workloads/ec-small-objects-fast-read-overwrites}', 'workloads/ec-small-objects-overwrites}', 'workloads/ec-snaps-few-objects-overwrites}', 'workloads/small-objects-balanced}'] 2024-02-01T09:20:07.153 INFO:scrape: 2024-02-01T09:20:07.154 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi026 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3fb6d78cec60c8f5c9fadc9d7aff52fbb473053c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2024-02-01T09:20:07.154 INFO:scrape:2 jobs: ['7538651', '7538740'] 2024-02-01T09:20:07.154 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'mon_election/connectivity', 'msgr/async', 'openstack}', 'rados'] 2024-02-01T09:20:07.154 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/read', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/verify/{centos_latest', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rados_api_tests', 'thrashers/pggrow', 'thrashosds-health', 'thrashosds-health}', 'validater/lockdep}', 'workloads/rados_api_tests}'] 2024-02-01T09:20:07.154 INFO:scrape: 2024-02-01T09:20:07.154 INFO:scrape:Failure: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-02-01T09:20:07.154 INFO:scrape:3 jobs: ['7538872', '7539148', '7539012'] 2024-02-01T09:20:07.154 INFO:scrape:suites intersection: [] 2024-02-01T09:20:07.154 INFO:scrape:suites union: ['2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'validater/valgrind}'] 2024-02-01T09:20:07.155 INFO:scrape: 2024-02-01T09:20:07.155 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-02-01T09:20:07.155 INFO:scrape:1 jobs: ['7538717'] 2024-02-01T09:20:07.155 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_cls_all', 'validater/valgrind}'] 2024-02-01T09:20:07.155 INFO:scrape: 2024-02-01T09:20:07.155 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' 2024-02-01T09:20:07.155 INFO:scrape:2 jobs: ['7538989', '7538655'] 2024-02-01T09:20:07.155 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{centos_latest}}'] 2024-02-01T09:20:07.155 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{centos_latest}}'] 2024-02-01T09:20:07.155 INFO:scrape: 2024-02-01T09:20:07.155 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm_timeout.py) on smithi100 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3fb6d78cec60c8f5c9fadc9d7aff52fbb473053c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm_timeout.py' 2024-02-01T09:20:07.156 INFO:scrape:1 jobs: ['7539006'] 2024-02-01T09:20:07.156 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm_timeout}'] 2024-02-01T09:20:07.156 INFO:scrape: 2024-02-01T09:20:07.156 INFO:scrape:Failure: No module named 'tasks.cephadm' 2024-02-01T09:20:07.156 INFO:scrape:2 jobs: ['7538800', '7538812'] 2024-02-01T09:20:07.156 INFO:scrape:suites intersection: ['mon_election/classic'] 2024-02-01T09:20:07.156 INFO:scrape:suites union: ['0-nvme-loop', '0-start', '1-tasks', 'agent/off', 'fixed-2', 'mon_election/classic', 'rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools', 'rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'start}', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default'] 2024-02-01T09:20:07.156 INFO:scrape: 2024-02-01T09:20:07.156 INFO:scrape:Crash: Test failure: test_turn_off_module (tasks.mgr.test_progress.TestProgress) 2024-02-01T09:20:07.156 INFO:scrape:ceph version 19.0.0-1016-g3fb6d78c (3fb6d78cec60c8f5c9fadc9d7aff52fbb473053c) squid (dev) 1: /lib64/libc.so.6(+0x54db0) [0x7f29e2c54db0] 2: /lib64/libc.so.6(+0xa154c) [0x7f29e2ca154c] 3: raise() 4: abort() 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x561d8306d587] 6: (KernelDevice::_aio_thread()+0x11e0) [0x561d83a2ef40] 7: ceph-osd(+0xdb30b1) [0x561d83a2f0b1] 8: /lib64/libc.so.6(+0x9f802) [0x7f29e2c9f802] 9: /lib64/libc.so.6(+0x3f450) [0x7f29e2c3f450] 2024-02-01T09:20:07.157 INFO:scrape:1 jobs: ['7538609'] 2024-02-01T09:20:07.157 INFO:scrape:suites: ['debug/mgr', 'mgr_ttl_cache/disable', 'mon_election/classic', 'rados/mgr/{clusters/{2-node-mgr}', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'supported-random-distro$/{centos_latest}', 'tasks/progress}'] 2024-02-01T09:20:07.157 INFO:scrape: 2024-02-01T09:20:07.168 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/ failed: 15 dead: 17 running: 0 waiting: 0 queued: 0 passed: 296 Fail ================================================================= [7538609] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_latest} tasks/progress} ----------------------------------------------------------------- time: 00:21:52 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538609/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538609/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ac6513cf2be9457898affbdd76118579 Test failure: test_turn_off_module (tasks.mgr.test_progress.TestProgress) [7538651] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} ----------------------------------------------------------------- time: 00:26:06 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538651/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538651/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d98fd39fc2d14517b6f19334a65475ff Command failed (workunit test rados/test.sh) on smithi026 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3fb6d78cec60c8f5c9fadc9d7aff52fbb473053c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [7538655] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:08:06 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538655/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538655/ sentry: https://sentry.ceph.com/organizations/ceph/?query=228776416ed84b24a56f057a1474a2e6 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7538717] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 03:32:36 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538717/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538717/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b910f8c2477341069a37fe34e3734178 Command failed (workunit test cls/test_cls_2pc_queue.sh) on smithi090 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3fb6d78cec60c8f5c9fadc9d7aff52fbb473053c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cls/test_cls_2pc_queue.sh' [7538740] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 03:18:30 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538740/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538740/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f202b81641dc4fbcbc7413836553671f Command failed (workunit test rados/test.sh) on smithi094 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3fb6d78cec60c8f5c9fadc9d7aff52fbb473053c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [7538800] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:13:38 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538800/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538800/ sentry: https://sentry.ceph.com/organizations/ceph/?query=16d52905935a49d891724c4376a9277c No module named 'tasks.cephadm' [7538802] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538802/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538802/ sentry: https://sentry.ceph.com/organizations/ceph/?query=71d2c5a1496442209e6590907027caa1 Command failed on smithi135 with status 1: 'sudo yum install -y kernel' [7538804] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538804/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538804/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9c89614efe924ca4b65e7b70e21278b0 Command failed on smithi194 with status 1: 'sudo yum install -y kernel' [7538812] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:34:26 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538812/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538812/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c669a559ffb045a386694cfe7c1add03 No module named 'tasks' [7538822] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/one workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538822/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538822/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4e92b4398c394d42bc5407cb4c8d69e7 Command failed on smithi143 with status 1: 'sudo yum install -y kernel' [7538872] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 01:03:33 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538872/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538872/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7538989] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:07:53 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538989/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538989/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f4f3554ad45f4eb98bcd2950825f3c5c Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7539006] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_timeout} ----------------------------------------------------------------- time: 00:18:55 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539006/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539006/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4210d8ae6b4d4ac38df61d72ec7e3437 Command failed (workunit test cephadm/test_cephadm_timeout.py) on smithi100 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3fb6d78cec60c8f5c9fadc9d7aff52fbb473053c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_cephadm_timeout.py' [7539012] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} ----------------------------------------------------------------- time: 00:26:45 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539012/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539012/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun [7539148] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 01:51:56 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539148/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539148/ valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun Dead ================================================================= [7538647] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538647/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538647/ hit max job timeout [7538705] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538705/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538705/ Error reimaging machines: Expected smithi162's OS to be ubuntu 22.04 but found rhel 8.6 [7538738] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538738/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538738/ hit max job timeout [7538774] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538774/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538774/ Error reimaging machines: Expected smithi027's OS to be centos 8 but found centos 9 [7538796] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538796/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538796/ hit max job timeout [7538838] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538838/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538838/ hit max job timeout [7538858] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_latest} tasks/failover} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538858/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538858/ Error reimaging machines: Expected smithi123's OS to be centos 9 but found rhel 8.6 [7538925] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538925/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538925/ hit max job timeout [7539014] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539014/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539014/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7539019] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539019/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539019/ hit max job timeout [7539062] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539062/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539062/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7539101] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_latest} tasks/progress} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539101/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539101/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7539107] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539107/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539107/ hit max job timeout [7539126] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539126/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539126/ hit max job timeout [7539168] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-balanced} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539168/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539168/ hit max job timeout [7539170] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539170/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539170/ hit max job timeout [7539182] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_latest}} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539182/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539182/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds Pass ================================================================= [7538601] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:32 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538601/ [7538603] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} time: 00:08:51 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538603/ [7538605] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} time: 00:07:54 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538605/ [7538607] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:43 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538607/ [7538611] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:15:36 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538611/ [7538613] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:17:41 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538613/ [7538615] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:09:52 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538615/ [7538617] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/repair_test} time: 00:16:29 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538617/ [7538619] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:54 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538619/ [7538621] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:31:54 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538621/ [7538623] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:20 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538623/ [7538625] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:40:47 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538625/ [7538627] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:29:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538627/ [7538629] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:16:39 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538629/ [7538631] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/e2e} time: 00:25:52 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538631/ [7538633] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:22:26 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538633/ [7538635] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:15:23 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538635/ [7538637] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_ca_signed_key} time: 00:17:18 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538637/ [7538639] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:27 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538639/ [7538641] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:33 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538641/ [7538643] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:20:36 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538643/ [7538645] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:14:48 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538645/ [7538649] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:13:07 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538649/ [7538653] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:23:46 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538653/ [7538657] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:30 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538657/ [7538659] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm} time: 00:17:22 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538659/ [7538661] rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} time: 02:28:59 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538661/ [7538663] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:09:56 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538663/ [7538665] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:18:20 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538665/ [7538667] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:20:56 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538667/ [7538669] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/scrub_test} time: 00:14:53 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538669/ [7538671] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:12:40 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538671/ [7538673] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:42:58 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538673/ [7538675] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:10:35 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538675/ [7538677] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:07:55 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538677/ [7538679] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:13:31 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538679/ [7538681] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:12:56 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538681/ [7538683] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/cache} time: 00:15:47 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538683/ [7538685] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:12:59 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538685/ [7538687] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:25:57 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538687/ [7538689] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:07 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538689/ [7538691] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:14:35 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538691/ [7538693] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed} time: 00:19:07 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538693/ [7538695] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} time: 00:09:50 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538695/ [7538697] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{centos_latest}} time: 00:08:13 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538697/ [7538699] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_cephadm_timeout} time: 00:23:39 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538699/ [7538701] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:22:47 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538701/ [7538703] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:23:37 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538703/ [7538707] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps} time: 00:14:25 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538707/ [7538709] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:35 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538709/ [7538711] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:18:45 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538711/ [7538713] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:15:52 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538713/ [7538715] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/libcephsqlite} time: 00:12:06 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538715/ [7538719] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_extra_daemon_features} time: 00:23:18 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538719/ [7538721] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:13:22 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538721/ [7538723] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:25:30 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538723/ [7538726] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:18:27 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538726/ [7538728] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:19 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538728/ [7538730] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 02:46:23 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538730/ [7538732] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_latest} tasks/workunits} time: 00:09:07 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538732/ [7538734] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:36:31 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538734/ [7538735] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:15 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538735/ [7538742] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:08:44 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538742/ [7538744] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_host_drain} time: 00:22:06 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538744/ [7538746] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} time: 00:30:28 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538746/ [7538748] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:07:38 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538748/ [7538750] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:41:45 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538750/ [7538752] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} time: 00:08:07 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538752/ [7538754] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:24:46 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538754/ [7538756] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:24:05 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538756/ [7538758] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:26:01 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538758/ [7538760] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:32:28 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538760/ [7538762] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench} time: 01:24:22 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538762/ [7538764] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:24:33 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538764/ [7538766] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:13:13 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538766/ [7538768] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:29:10 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538768/ [7538770] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:23:47 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538770/ [7538772] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:09:53 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538772/ [7538776] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:33:42 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538776/ [7538779] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:15:39 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538779/ [7538781] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:19 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538781/ [7538782] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:28:08 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538782/ [7538784] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:42:13 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538784/ [7538786] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_monitoring_stack_basic} time: 00:30:02 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538786/ [7538788] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} time: 01:29:33 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538788/ [7538790] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:12:44 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538790/ [7538793] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_latest}} time: 00:35:48 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538793/ [7538795] rados/rest/{mgr-restful supported-random-distro$/{centos_latest}} time: 00:09:33 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538795/ [7538798] rados/standalone/{supported-random-distro$/{centos_latest} workloads/c2c} time: 00:14:30 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538798/ [7538806] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:20:18 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538806/ [7538808] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:17:30 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538808/ [7538810] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:53 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538810/ [7538814] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:13:22 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538814/ [7538816] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:28 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538816/ [7538818] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:16:20 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538818/ [7538820] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:13:41 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538820/ [7538824] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:11:14 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538824/ [7538826] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/rados_cls_all} time: 00:19:22 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538826/ [7538828] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_orch_cli} time: 00:20:29 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538828/ [7538830] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:16:15 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538830/ [7538832] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:10:01 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538832/ [7538834] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:58 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538834/ [7538836] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:58 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538836/ [7538840] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:13 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538840/ [7538842] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} time: 00:12:08 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538842/ [7538844] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:19:35 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538844/ [7538846] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:34 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538846/ [7538848] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli_mon} time: 00:29:57 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538848/ [7538850] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:23:46 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538850/ [7538852] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:19:37 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538852/ [7538854] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:10:22 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538854/ [7538856] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:30 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538856/ [7538860] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:02 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538860/ [7538862] rados/standalone/{supported-random-distro$/{centos_latest} workloads/crush} time: 00:20:05 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538862/ [7538864] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:14:16 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538864/ [7538866] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:07:42 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538866/ [7538868] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:24:15 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538868/ [7538870] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:26:03 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538870/ [7538874] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_rgw_multisite} time: 00:19:15 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538874/ [7538876] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:17:39 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538876/ [7538878] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:12:54 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538878/ [7538881] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:07 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538881/ [7538883] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_set_mon_crush_locations} time: 00:20:38 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538883/ [7538885] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:08:14 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538885/ [7538886] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:26:32 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538886/ [7538889] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:16:46 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538889/ [7538891] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:10:37 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538891/ [7538893] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:19:55 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538893/ [7538895] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:14:58 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538895/ [7538896] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:23:19 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538896/ [7538898] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:55 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538898/ [7538900] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:22:55 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538900/ [7538902] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:25:09 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538902/ [7538904] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption} time: 00:13:24 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538904/ [7538907] rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:15:17 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538907/ [7538909] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:14:39 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538909/ [7538911] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:26:33 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538911/ [7538913] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:40 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538913/ [7538915] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:07:54 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538915/ [7538917] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_latest} tasks/insights} time: 00:11:27 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538917/ [7538919] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:20:53 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538919/ [7538921] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:28:15 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538921/ [7538923] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:18:46 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538923/ [7538927] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:20 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538927/ [7538929] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_ca_signed_key} time: 00:20:19 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538929/ [7538931] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 01:35:05 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538931/ [7538933] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:19 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538933/ [7538935] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:27 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538935/ [7538937] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:05 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538937/ [7538939] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:31:01 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538939/ [7538941] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:30:29 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538941/ [7538943] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:20:15 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538943/ [7538945] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:21:57 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538945/ [7538947] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:57 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538947/ [7538948] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm} time: 00:19:40 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538948/ [7538951] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:26:11 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538951/ [7538953] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:01 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538953/ [7538955] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:14:17 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538955/ [7538957] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:17:31 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538957/ [7538959] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:14:41 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538959/ [7538961] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:16:48 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538961/ [7538962] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/e2e} time: 00:26:54 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538962/ [7538964] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} time: 00:12:18 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538964/ [7538967] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:20:36 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538967/ [7538969] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:09:20 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538969/ [7538971] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos} time: 00:07:15 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538971/ [7538973] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/rados_striper} time: 00:12:41 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538973/ [7538975] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} time: 00:10:43 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538975/ [7538976] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} time: 00:08:30 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538976/ [7538979] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:31 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538979/ [7538981] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:26:12 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538981/ [7538983] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:14:55 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538983/ [7538985] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:19:07 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538985/ [7538987] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:16:13 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538987/ [7538991] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:17:11 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538991/ [7538993] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:16:50 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538993/ [7538994] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:18 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538994/ [7538996] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 01:59:11 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538996/ [7538999] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:22:25 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7538999/ [7539000] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:11:57 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539000/ [7539002] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:29 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539002/ [7539004] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:04 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539004/ [7539008] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:19:49 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539008/ [7539010] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:23:03 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539010/ [7539016] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:23:53 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539016/ [7539021] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:53 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539021/ [7539022] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:20:15 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539022/ [7539024] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_big} time: 00:28:56 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539024/ [7539026] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:25:42 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539026/ [7539028] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_extra_daemon_features} time: 00:15:42 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539028/ [7539030] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:12:43 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539030/ [7539032] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:34:03 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539032/ [7539034] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:19:54 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539034/ [7539036] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_host_drain} time: 00:25:18 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539036/ [7539038] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:44:01 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539038/ [7539040] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:17:59 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539040/ [7539042] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_latest} tasks/per_module_finisher_stats} time: 00:09:09 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539042/ [7539044] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:22:47 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539044/ [7539046] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:21:54 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539046/ [7539048] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:10:04 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539048/ [7539050] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:29 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539050/ [7539052] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:18 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539052/ [7539054] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-mixed} time: 00:12:59 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539054/ [7539056] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:22:26 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539056/ [7539058] rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc} time: 01:04:30 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539058/ [7539060] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:25 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539060/ [7539064] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/dedup-io-snaps} time: 00:15:31 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539064/ [7539066] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:20:04 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539066/ [7539068] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:49 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539068/ [7539070] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:15:49 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539070/ [7539072] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:23 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539072/ [7539074] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mix} time: 00:19:21 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539074/ [7539076] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_latest}} time: 00:23:55 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539076/ [7539078] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:13:05 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539078/ [7539080] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:31:01 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539080/ [7539082] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} time: 00:24:12 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539082/ [7539084] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:25:18 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539084/ [7539086] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:56 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539086/ [7539088] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:56 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539088/ [7539090] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:14:03 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539090/ [7539092] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:58 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539092/ [7539094] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:15:34 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539094/ [7539097] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 00:28:34 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539097/ [7539099] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:31:27 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539099/ [7539103] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:16:38 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539103/ [7539105] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:30 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539105/ [7539108] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:48:13 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539108/ [7539111] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:57:12 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539111/ [7539113] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:23:22 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539113/ [7539114] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} time: 00:08:43 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539114/ [7539116] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli} time: 00:16:34 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539116/ [7539118] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:16:20 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539118/ [7539120] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:27:43 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539120/ [7539122] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:24:22 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539122/ [7539124] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} time: 01:22:23 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539124/ [7539128] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon-stretch} time: 00:25:45 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539128/ [7539130] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:47:21 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539130/ [7539133] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench} time: 00:59:53 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539133/ [7539135] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:27:24 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539135/ [7539136] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:12:11 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539136/ [7539137] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:12:06 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539137/ [7539138] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:16:17 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539138/ [7539139] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:19:24 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539139/ [7539140] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:37 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539140/ [7539141] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:53 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539141/ [7539142] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:42 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539142/ [7539143] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:10:41 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539143/ [7539144] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:53 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539144/ [7539145] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:11:20 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539145/ [7539146] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:35 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539146/ [7539147] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:50 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539147/ [7539149] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:18:38 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539149/ [7539150] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:12:33 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539150/ [7539151] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 01:53:41 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539151/ [7539152] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:12:28 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539152/ [7539153] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_latest}} time: 02:11:03 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539153/ [7539154] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_rgw_multisite} time: 00:24:09 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539154/ [7539155] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/readwrite} time: 00:15:30 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539155/ [7539156] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:35 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539156/ [7539157] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:14:27 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539157/ [7539158] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:16:08 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539158/ [7539159] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:47:52 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539159/ [7539160] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:24:07 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539160/ [7539161] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/one workloads/rados_mon_workunits} time: 00:28:25 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539161/ [7539162] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon} time: 01:01:41 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539162/ [7539163] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_latest}} time: 00:07:52 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539163/ [7539164] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} time: 00:08:55 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539164/ [7539165] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:39 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539165/ [7539166] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:34:32 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539166/ [7539167] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} time: 00:10:46 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539167/ [7539169] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:24:12 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539169/ [7539171] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:14:52 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539171/ [7539172] rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{centos_latest}} time: 00:08:13 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539172/ [7539173] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:21:39 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539173/ [7539174] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:07 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539174/ [7539175] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:20:38 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539175/ [7539176] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:23:56 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539176/ [7539177] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:20 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539177/ [7539178] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:18:20 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539178/ [7539179] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:20:02 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539179/ [7539180] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:14:08 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539180/ [7539181] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_latest} tasks/workunits} time: 00:10:02 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539181/ [7539183] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_ca_signed_key} time: 00:14:32 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539183/ [7539184] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:47 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539184/ [7539185] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:17:46 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539185/ [7539186] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:12:32 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539186/ [7539187] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:08:45 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539187/ [7539188] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:25:56 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539188/ [7539189] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm} time: 00:16:50 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539189/ [7539190] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:09 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539190/ [7539191] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:34 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539191/ [7539192] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:50 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539192/ [7539193] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:29:13 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539193/ [7539194] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} time: 03:02:00 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539194/ [7539195] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:32:13 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539195/ [7539196] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:16:13 info: https://pulpito.ceph.com/yuriw-2024-01-30_16:08:52-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7539196/