2023-09-28T16:50:19.613 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-28T16:50:19.613 INFO:teuthology.results:subset: '111/120000' 2023-09-28T16:50:19.613 INFO:teuthology.results:seed: '768' 2023-09-29T00:46:14.794 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-29T00:46:14.823 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-09-29T03:39:30.490 INFO:teuthology.results:Tests finished! gathering results... 2023-09-29T03:39:54.099 INFO:scrape:Found 322 jobs 2023-09-29T03:39:54.356 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404052/teuthology.log 2023-09-29T03:39:57.248 INFO:scrape:Found 7 distinct failure reasons 2023-09-29T03:39:57.248 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi135 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5250001660bc85943c39bad156c0a8d0c74901c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-09-29T03:39:57.248 INFO:scrape:2 jobs: ['7404246', '7404082'] 2023-09-29T03:39:57.248 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}'] 2023-09-29T03:39:57.249 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-zlib}', 'random-objectstore$/{bluestore-hybrid}', 'tasks/e2e}'] 2023-09-29T03:39:57.249 INFO:scrape: 2023-09-29T03:39:57.249 INFO:scrape:Dead: None 2023-09-29T03:39:57.249 INFO:scrape:3 jobs: ['7404052', '7404061', '7404084'] 2023-09-29T03:39:57.249 INFO:scrape: 2023-09-29T03:39:57.249 INFO:scrape:Failure: "1695924513.8992484 mon.a (mon.0) 2147 : cluster [WRN] Health check failed: 1 pools have too many placement groups (POOL_TOO_MANY_PGS)" in cluster log 2023-09-29T03:39:57.249 INFO:scrape:3 jobs: ['7403946', '7404253', '7403962'] 2023-09-29T03:39:57.249 INFO:scrape:suites intersection: [] 2023-09-29T03:39:57.250 INFO:scrape:suites union: ['mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/none', 'msgr/async', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'rados', 'rados/objectstore/{backends/alloc-hint', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton/{all/mon-config-keys', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{ubuntu_latest}}'] 2023-09-29T03:39:57.250 INFO:scrape: 2023-09-29T03:39:57.250 INFO:scrape:Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi078 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5250001660bc85943c39bad156c0a8d0c74901c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' 2023-09-29T03:39:57.250 INFO:scrape:1 jobs: ['7404067'] 2023-09-29T03:39:57.250 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/none', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb', 'supported-random-distro$/{rhel_8}}'] 2023-09-29T03:39:57.250 INFO:scrape: 2023-09-29T03:39:57.250 INFO:scrape:Failure: SSH connection to smithi114 was lost: 'sudo yum install -y kernel' 2023-09-29T03:39:57.251 INFO:scrape:3 jobs: ['7404053', '7404063', '7404068'] 2023-09-29T03:39:57.251 INFO:scrape:suites intersection: [] 2023-09-29T03:39:57.251 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'agent/off', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v2only', 'no_pools', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'rados/multimon/{clusters/6', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'task/test_cephadm}', 'tasks/mon_clock_with_skews}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/snaps-few-objects-localized}'] 2023-09-29T03:39:57.251 INFO:scrape: 2023-09-29T03:39:57.251 INFO:scrape:Failure: Test failure: test_non_existent_cluster (tasks.cephfs.test_nfs.TestNFS) 2023-09-29T03:39:57.251 INFO:scrape:2 jobs: ['7404120', '7404274'] 2023-09-29T03:39:57.251 INFO:scrape:suites intersection: ['task/test_nfs}'] 2023-09-29T03:39:57.252 INFO:scrape:suites union: ['agent/off', 'agent/on', 'mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0', 'task/test_nfs}'] 2023-09-29T03:39:57.252 INFO:scrape: 2023-09-29T03:39:57.252 INFO:scrape:Failure: Command failed on smithi114 with status 100: 'sudo apt-get clean' 2023-09-29T03:39:57.252 INFO:scrape:1 jobs: ['7404072'] 2023-09-29T03:39:57.252 INFO:scrape:suites: ['clusters/{fixed-4', 'mon_election/connectivity', 'msgr-failures/fastclose', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/thrash-erasure-code-shec/{ceph', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashosds-health', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}'] 2023-09-29T03:39:57.252 INFO:scrape: 2023-09-29T03:39:57.263 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/ failed: 9 dead: 6 running: 0 waiting: 0 queued: 0 passed: 307 Fail ================================================================= [7403946] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:37:27 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403946/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403946/ "1695924513.8992484 mon.a (mon.0) 2147 : cluster [WRN] Health check failed: 1 pools have too many placement groups (POOL_TOO_MANY_PGS)" in cluster log [7403962] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:09:18 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403962/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403962/ "1695925742.2258472 mon.a (mon.0) 60 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7404067] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:13:46 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404067/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404067/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e991ce89d89c43be91a8472b2e5e1b07 Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi078 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5250001660bc85943c39bad156c0a8d0c74901c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7404072] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404072/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404072/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4e6b85473d314c57b300aa7cb39d6f99 Command failed on smithi114 with status 100: 'sudo apt-get clean' [7404082] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/e2e} ----------------------------------------------------------------- time: 00:19:51 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404082/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404082/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9f38ae067f894ae7906bcc4dd5dad8ab Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi082 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5250001660bc85943c39bad156c0a8d0c74901c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7404120] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/on mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:28:18 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404120/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404120/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cec1976f5b804d2da418151e169878a3 Test failure: test_non_existent_cluster (tasks.cephfs.test_nfs.TestNFS) [7404246] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/e2e} ----------------------------------------------------------------- time: 00:20:02 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404246/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404246/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6f1b955ecdfd4dc89ecdc79bb48df2b0 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi135 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5250001660bc85943c39bad156c0a8d0c74901c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7404253] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:15:11 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404253/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404253/ "1695946900.4123104 mon.a (mon.0) 59 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7404274] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:23:05 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404274/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404274/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0dd52f24944a465c8c67f33942d7fa22 Test failure: test_non_existent_cluster (tasks.cephfs.test_nfs.TestNFS) Dead ================================================================= [7404052] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404052/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404052/ Error reimaging machines: Expected smithi114's OS to be rhel 8.4 but found centos 8 [7404053] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404053/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404053/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0dd2c41f69be440fbc946d125b65343f SSH connection to smithi114 was lost: 'sudo yum install -y kernel' [7404061] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404061/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404061/ Error reimaging machines: Expected smithi114's OS to be rhel 8.4 but found ubuntu 20.04 [7404063] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404063/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404063/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6d55ff3852b2471fab9fef8e6238e46d SSH connection to smithi114 was lost: 'sudo apt-get update' [7404068] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404068/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404068/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1dd27abee75f488b85cdf232b25c21e5 SSH connection to smithi114 was lost: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic' [7404084] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404084/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404084/ Error reimaging machines: reached maximum tries (241) after waiting for 3600 seconds Pass ================================================================= [7403922] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:36:51 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403922/ [7403924] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:34:57 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403924/ [7403926] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:21:52 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403926/ [7403928] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:23:59 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403928/ [7403930] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:32:06 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403930/ [7403932] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:13:06 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403932/ [7403934] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:12:09 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403934/ [7403936] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} time: 00:18:52 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403936/ [7403938] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:19:58 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403938/ [7403940] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:16:38 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403940/ [7403942] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:33 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403942/ [7403944] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:20 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403944/ [7403948] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:18:43 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403948/ [7403950] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:35 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403950/ [7403952] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:20:13 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403952/ [7403954] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:24:55 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403954/ [7403956] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:13:17 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403956/ [7403958] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/dashboard} time: 01:08:30 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403958/ [7403960] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{rhel_8} tasks/crash} time: 00:16:43 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403960/ [7403964] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:13:23 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403964/ [7403966] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:21:39 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403966/ [7403968] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} time: 00:13:53 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403968/ [7403970] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:22:55 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403970/ [7403972] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:25:18 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403972/ [7403974] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} time: 00:25:18 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403974/ [7403976] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:18:05 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403976/ [7403978] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:29:44 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403978/ [7403980] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:28:13 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403980/ [7403982] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:05 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403982/ [7403984] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:26:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403984/ [7403986] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:14:04 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403986/ [7403987] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:14:54 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403987/ [7403989] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:20 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403989/ [7403991] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:12:44 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403991/ [7403994] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:19:51 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403994/ [7403995] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:28:45 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403995/ [7403997] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} time: 00:12:17 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403997/ [7403999] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:30:41 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7403999/ [7404001] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:48 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404001/ [7404003] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:05 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404003/ [7404005] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:24:24 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404005/ [7404007] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:17:45 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404007/ [7404009] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:37 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404009/ [7404011] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:55 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404011/ [7404013] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:17:26 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404013/ [7404015] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:58 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404015/ [7404017] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:24:09 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404017/ [7404019] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_rgw_multisite} time: 00:16:36 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404019/ [7404021] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:18:19 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404021/ [7404023] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:08:45 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404023/ [7404025] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/failover} time: 00:19:27 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404025/ [7404027] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:21:03 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404027/ [7404029] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} time: 00:26:34 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404029/ [7404031] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:11:40 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404031/ [7404033] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:17 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404033/ [7404035] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits} time: 00:34:55 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404035/ [7404037] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:19 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404037/ [7404039] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects} time: 00:27:37 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404039/ [7404041] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:33:14 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404041/ [7404042] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:57:53 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404042/ [7404043] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:18:59 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404043/ [7404044] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:18 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404044/ [7404045] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/off mon_election/classic task/test_set_mon_crush_locations} time: 00:23:27 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404045/ [7404046] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:30 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404046/ [7404047] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:31:49 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404047/ [7404048] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:15:52 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404048/ [7404049] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:18:39 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404049/ [7404050] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:38 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404050/ [7404051] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:15:32 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404051/ [7404054] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:52 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404054/ [7404055] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/on mon_election/connectivity task/test_adoption} time: 00:14:56 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404055/ [7404056] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:12:38 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404056/ [7404057] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:43 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404057/ [7404058] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:12:51 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404058/ [7404059] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:13:20 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404059/ [7404060] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/insights} time: 00:16:20 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404060/ [7404062] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:18:18 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404062/ [7404064] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:42 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404064/ [7404065] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:25:59 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404065/ [7404066] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 01:30:37 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404066/ [7404069] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:21:21 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404069/ [7404070] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} time: 00:39:34 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404070/ [7404071] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404071/ [7404073] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:10:04 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404073/ [7404074] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:35:54 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404074/ [7404075] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:55 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404075/ [7404076] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 01:12:49 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404076/ [7404077] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:10 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404077/ [7404078] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:18 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404078/ [7404079] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:26:38 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404079/ [7404080] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:12:29 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404080/ [7404081] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:52 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404081/ [7404083] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404083/ [7404085] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:30:07 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404085/ [7404086] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} time: 01:26:49 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404086/ [7404087] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:21:01 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404087/ [7404088] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:09:05 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404088/ [7404089] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:50 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404089/ [7404090] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:25:35 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404090/ [7404091] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:25:42 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404091/ [7404092] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:46 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404092/ [7404093] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:31:50 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404093/ [7404094] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:18:51 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404094/ [7404095] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:20:29 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404095/ [7404096] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:18:33 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404096/ [7404097] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:32:49 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404097/ [7404098] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:18:31 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404098/ [7404099] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:23:59 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404099/ [7404100] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:17:41 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404100/ [7404101] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:36:20 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404101/ [7404102] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:03 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404102/ [7404103] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:11:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404103/ [7404104] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/pool-create-delete} time: 00:18:46 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404104/ [7404105] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:51 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404105/ [7404106] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:30:11 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404106/ [7404107] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:14:05 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404107/ [7404108] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:16:44 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404108/ [7404109] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:46 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404109/ [7404110] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:30 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404110/ [7404111] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:23:32 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404111/ [7404112] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:36:14 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404112/ [7404113] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:25:16 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404113/ [7404114] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:30 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404114/ [7404115] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:25:37 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404115/ [7404116] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:14:19 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404116/ [7404117] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:27:38 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404117/ [7404118] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:32:14 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404118/ [7404119] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:19:53 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404119/ [7404121] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:35 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404121/ [7404122] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:21:23 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404122/ [7404123] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/per_module_finisher_stats} time: 00:13:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404123/ [7404124] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:22:54 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404124/ [7404125] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:25:17 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404125/ [7404126] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:19:07 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404126/ [7404127] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:14 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404127/ [7404128] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:09:05 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404128/ [7404129] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:22:03 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404129/ [7404130] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:21:50 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404130/ [7404131] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 01:09:10 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404131/ [7404132] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:15:25 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404132/ [7404133] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:28:09 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404133/ [7404134] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:27 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404134/ [7404136] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:42 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404136/ [7404138] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925} time: 00:14:31 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404138/ [7404140] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:41 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404140/ [7404142] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache} time: 00:21:35 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404142/ [7404143] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli} time: 00:18:06 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404143/ [7404144] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:54 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404144/ [7404145] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:10:01 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404145/ [7404146] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:31:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404146/ [7404147] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} time: 00:17:04 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404147/ [7404148] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:27:59 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404148/ [7404149] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:13:14 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404149/ [7404150] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:08 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404150/ [7404151] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:24:04 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404151/ [7404152] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:13:48 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404152/ [7404153] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:10:27 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404153/ [7404154] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:38:28 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404154/ [7404155] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:21:49 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404155/ [7404156] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:36:49 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404156/ [7404157] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:40 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404157/ [7404158] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} time: 00:18:47 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404158/ [7404159] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:32 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404159/ [7404160] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:26:24 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404160/ [7404161] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:13:47 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404161/ [7404162] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:14:56 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404162/ [7404163] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:16:22 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404163/ [7404164] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:33:25 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404164/ [7404165] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/dashboard} time: 01:03:19 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404165/ [7404166] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:24:13 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404166/ [7404167] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon-stretch} time: 00:24:38 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404167/ [7404168] rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:30:01 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404168/ [7404169] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:17:56 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404169/ [7404170] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:26:11 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404170/ [7404171] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:41 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404171/ [7404172] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:35:26 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404172/ [7404173] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_rgw_multisite} time: 00:16:31 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404173/ [7404174] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:11:19 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404174/ [7404175] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:37:03 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404175/ [7404176] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:13:16 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404176/ [7404177] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:45 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404177/ [7404178] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:33:43 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404178/ [7404179] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:15:06 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404179/ [7404180] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:33:11 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404180/ [7404181] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:35:32 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404181/ [7404182] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:21:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404182/ [7404183] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:32:08 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404183/ [7404184] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:15:39 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404184/ [7404185] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:24:45 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404185/ [7404186] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:17 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404186/ [7404187] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:11:29 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404187/ [7404188] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:16:55 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404188/ [7404189] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:42 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404189/ [7404190] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:18:48 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404190/ [7404191] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench} time: 00:55:17 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404191/ [7404192] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:31:20 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404192/ [7404193] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:50 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404193/ [7404194] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:13:45 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404194/ [7404195] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:17:47 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404195/ [7404196] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:19:41 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404196/ [7404197] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/repair_test} time: 00:20:32 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404197/ [7404198] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect} time: 00:18:34 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404198/ [7404199] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} time: 01:12:04 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404199/ [7404200] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:25 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404200/ [7404201] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:14:43 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404201/ [7404202] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:30:33 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404202/ [7404203] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:58:45 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404203/ [7404204] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/off mon_election/classic task/test_adoption} time: 00:15:53 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404204/ [7404205] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:32 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404205/ [7404206] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:45 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404206/ [7404207] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:15:20 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404207/ [7404208] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:17:32 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404208/ [7404209] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:14:29 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404209/ [7404210] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404210/ [7404211] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:30:07 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404211/ [7404212] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:45 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404212/ [7404213] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:26:27 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404213/ [7404214] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:32 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404214/ [7404215] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:19:53 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404215/ [7404216] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404216/ [7404217] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:10:02 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404217/ [7404218] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:12:25 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404218/ [7404219] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:34 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404219/ [7404220] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:22:25 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404220/ [7404221] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:46 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404221/ [7404222] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm} time: 00:20:19 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404222/ [7404223] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:12:41 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404223/ [7404224] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:19:25 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404224/ [7404225] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:18:44 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404225/ [7404226] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:12:31 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404226/ [7404227] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:09:06 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404227/ [7404228] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:24:57 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404228/ [7404229] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:17 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404229/ [7404230] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} time: 02:41:09 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404230/ [7404231] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:45 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404231/ [7404232] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:37:25 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404232/ [7404233] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:25:47 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404233/ [7404234] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 00:54:52 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404234/ [7404235] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_workunits} time: 00:33:06 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404235/ [7404236] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:12:19 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404236/ [7404237] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:33 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404237/ [7404238] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:45 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404238/ [7404239] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:11:56 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404239/ [7404240] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{rhel_8}} time: 02:37:47 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404240/ [7404241] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:35:41 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404241/ [7404242] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:25:22 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404242/ [7404243] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos} time: 00:07:07 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404243/ [7404244] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:11:12 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404244/ [7404245] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:34:54 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404245/ [7404247] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:11:17 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404247/ [7404248] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:14:51 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404248/ [7404249] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:17:39 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404249/ [7404250] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/libcephsqlite} time: 00:17:41 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404250/ [7404251] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects} time: 00:24:40 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404251/ [7404252] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:29:09 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404252/ [7404254] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:39 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404254/ [7404255] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:16:36 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404255/ [7404256] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:15:12 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404256/ [7404257] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:29:58 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404257/ [7404258] rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:10:47 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404258/ [7404259] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:09:18 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404259/ [7404260] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:16:51 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404260/ [7404261] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:12:27 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404261/ [7404262] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:27 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404262/ [7404263] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} time: 02:44:40 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404263/ [7404264] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:21:22 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404264/ [7404265] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:37 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404265/ [7404266] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:29:17 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404266/ [7404267] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/snaps-few-objects} time: 00:34:25 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404267/ [7404268] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:16 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404268/ [7404269] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:23:22 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404269/ [7404270] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} time: 02:48:25 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404270/ [7404271] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:29:42 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404271/ [7404272] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:17 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404272/ [7404273] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:30:39 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404273/ [7404275] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:30:04 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404275/ [7404276] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:00 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404276/ [7404277] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:26:34 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404277/ [7404278] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_8} tasks/failover} time: 00:16:23 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404278/ [7404279] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:30:08 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404279/ [7404280] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:15:37 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404280/ [7404281] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:19:02 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404281/ [7404282] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:26:29 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404282/ [7404283] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:19:08 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404283/ [7404284] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:12:04 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404284/ [7404285] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:51 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404285/ [7404286] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:17:41 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404286/ [7404287] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:23:50 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404287/ [7404288] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:11:15 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404288/ [7404289] rados/singleton/{all/peer mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:14:53 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404289/ [7404290] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:23:32 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404290/ [7404291] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/on mon_election/connectivity task/test_orch_cli} time: 00:21:03 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404291/ [7404292] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:18:09 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404292/ [7404293] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:42:07 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404293/ [7404294] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 02:35:26 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404294/ [7404295] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} time: 00:31:40 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404295/ [7404296] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:21:40 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404296/ [7404297] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/sync workloads/pool-create-delete} time: 00:18:17 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404297/ [7404298] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:25:11 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404298/ [7404299] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{ubuntu_latest}} time: 00:31:51 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404299/ [7404300] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli_mon} time: 00:30:52 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404300/ [7404301] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:17:28 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404301/ [7404302] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:14:22 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404302/ [7404303] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:33:04 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404303/ [7404304] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:20:11 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404304/ [7404305] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:12:23 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404305/ [7404306] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2023-09-27_19:29:17-rados-wip-yuri6-testing-2023-09-27-0938-quincy-distro-default-smithi/7404306/