2023-06-08T18:50:19.564 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-08T18:50:19.565 INFO:teuthology.results:subset: '412/20000' 2023-06-08T18:50:19.565 INFO:teuthology.results:seed: '2375' 2023-06-09T00:02:18.404 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-09T00:02:18.418 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-06-09T02:42:33.162 INFO:teuthology.results:Tests finished! gathering results... 2023-06-09T02:42:48.431 INFO:scrape:Found 200 jobs 2023-06-09T02:42:51.798 WARNING:scrape:Misunderstood line: 2023-06-09T02:42:52.704 INFO:scrape:Found 8 distinct failure reasons 2023-06-09T02:42:52.705 INFO:scrape:Failure: "1686267822.7953215 osd.1 (osd.1) 2 : cluster [WRN] WaitReplicas::react(const DigestUpdate&): Unexpected DigestUpdate event" in cluster log 2023-06-09T02:42:52.705 INFO:scrape:1 jobs: ['7299092'] 2023-06-09T02:42:52.705 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/many', 'msgr/async-v1only', 'objectstore/bluestore-hybrid', 'rados', 'rados/singleton/{all/osd-recovery', 'supported-random-distro$/{ubuntu_latest}}'] 2023-06-09T02:42:52.706 INFO:scrape: 2023-06-09T02:42:52.706 INFO:scrape:Failure: Command failed on smithi079 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" 2023-06-09T02:42:52.706 INFO:scrape:2 jobs: ['7299035', '7299118'] 2023-06-09T02:42:52.707 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', 'k8s/1.21', 'rados/rook/smoke/{0-distro/ubuntu_20.04'] 2023-06-09T02:42:52.707 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/flannel', 'net/host', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}'] 2023-06-09T02:42:52.707 INFO:scrape: 2023-06-09T02:42:52.708 INFO:scrape:Failure: Command failed on smithi112 with status 5: 'sudo systemctl stop ceph-eb80fe7a-0638-11ee-9b1e-001a4aab830c@mon.b' 2023-06-09T02:42:52.708 INFO:scrape:2 jobs: ['7299040', '7298998'] 2023-06-09T02:42:52.708 INFO:scrape:suites intersection: ['mon_election/connectivity'] 2023-06-09T02:42:52.708 INFO:scrape:suites union: ['0-size-min-size-overrides/2-size-2-min-size', '1-install/nautilus-v1only', 'agent/on', 'backoff/normal', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'mon_election/connectivity', 'msgr-failures/few', 'rados', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'task/test_orch_cli_mon}', 'thrashers/mapgap', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}'] 2023-06-09T02:42:52.709 INFO:scrape: 2023-06-09T02:42:52.709 INFO:scrape:Failure: Command failed (workunit test cls/test_cls_rbd.sh) on smithi159 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh' 2023-06-09T02:42:52.709 INFO:scrape:1 jobs: ['7299148'] 2023-06-09T02:42:52.710 INFO:scrape:suites: ['0-start', '1-tasks', 'mon_election/connectivity', 'rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default'] 2023-06-09T02:42:52.710 INFO:scrape: 2023-06-09T02:42:52.710 INFO:scrape:Failure: Command failed (workunit test misc/mclock-config.sh) on smithi189 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9564655a5e7b3237dff14304a9dff15cf1a8439a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh' 2023-06-09T02:42:52.710 INFO:scrape:1 jobs: ['7299127'] 2023-06-09T02:42:52.711 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{ubuntu_20.04}', 'workloads/misc}'] 2023-06-09T02:42:52.711 INFO:scrape: 2023-06-09T02:42:52.711 INFO:scrape:Valgrind: osd (InvalidRead) 2023-06-09T02:42:52.712 INFO:scrape:1 jobs: ['7299017'] 2023-06-09T02:42:52.712 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}'] 2023-06-09T02:42:52.712 INFO:scrape: 2023-06-09T02:42:52.713 INFO:scrape:Failure: Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI) 2023-06-09T02:42:52.713 INFO:scrape:1 jobs: ['7299164'] 2023-06-09T02:42:52.713 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'task/test_orch_cli}'] 2023-06-09T02:42:52.713 INFO:scrape: 2023-06-09T02:42:52.714 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi177 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9564655a5e7b3237dff14304a9dff15cf1a8439a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-06-09T02:42:52.714 INFO:scrape:1 jobs: ['7299062'] 2023-06-09T02:42:52.714 INFO:scrape:suites: ['debug/mgr', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-stupid}', 'tasks/e2e}'] 2023-06-09T02:42:52.714 INFO:scrape: 2023-06-09T02:42:52.723 INFO:teuthology.results:Sending results to akupczyk@redhat.com: Test Run: akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/ failed: 10 dead: 0 running: 0 waiting: 0 queued: 0 passed: 190 Fail ================================================================= [7298998] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:16:58 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7298998/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7298998/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eb2fee1d03f84f248026334aaa04185d Command failed on smithi112 with status 5: 'sudo systemctl stop ceph-e2a0641e-0631-11ee-9b1e-001a4aab830c@mon.b' [7299017] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:58:44 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299017/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299017/ saw valgrind issues [7299035] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:06:05 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299035/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299035/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8ab4ad51e5d424eb387f88c544156f5 Command failed on smithi079 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7299040] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:20:29 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299040/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299040/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1e6d2166685e4b22aafd33551b30d820 Command failed on smithi112 with status 5: 'sudo systemctl stop ceph- eb80fe7a-0638-11ee-9b1e-001a4aab830c@mon.b' [7299062] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/e2e} ----------------------------------------------------------------- time: 01:04:55 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299062/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299062/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a1645165fdfc4273b5df684fcc8d6b88 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi177 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9564655a5e7b3237dff14304a9dff15cf1a8439a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7299092] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:23:03 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299092/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299092/ "1686267822.7953215 osd.1 (osd.1) 2 : cluster [WRN] WaitReplicas::react(const DigestUpdate&): Unexpected DigestUpdate event" in cluster log [7299118] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:06:15 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299118/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299118/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8bb74d6744404db1a3f6f14f68809112 Command failed on smithi103 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7299127] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/misc} ----------------------------------------------------------------- time: 00:14:17 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299127/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299127/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cd048eccd95f4269963f7a53ec30f19f Command failed (workunit test misc/mclock-config.sh) on smithi189 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9564655a5e7b3237dff14304a9dff15cf1a8439a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh' [7299148] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:49:40 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299148/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299148/ sentry: https://sentry.ceph.com/organizations/ceph/?query=caf4589bfbc84857bfb4d7ca254841a9 Command failed (workunit test cls/test_cls_rbd.sh) on smithi159 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=quincy TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh' [7299164] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:18:38 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299164/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299164/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5a3ec51d43a24123a588571478c75c22 Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI) Pass ================================================================= [7298990] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} tasks/repair_test} time: 00:17:13 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7298990/ [7298991] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:18:02 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7298991/ [7298992] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:13:37 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7298992/ [7298993] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 00:34:17 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7298993/ [7298994] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:30 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7298994/ [7298995] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:36:26 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7298995/ [7298996] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:35:05 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7298996/ [7298997] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:42:19 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7298997/ [7298999] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:16:25 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7298999/ [7299000] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_nfs} time: 00:32:17 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299000/ [7299001] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:43:14 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299001/ [7299002] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench} time: 00:51:51 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299002/ [7299003] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:58 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299003/ [7299004] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:18:39 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299004/ [7299005] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:12 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299005/ [7299006] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:15:21 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299006/ [7299007] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:11:35 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299007/ [7299008] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04}} time: 01:00:52 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299008/ [7299009] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:12:46 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299009/ [7299010] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:07 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299010/ [7299011] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:17 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299011/ [7299012] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:21:57 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299012/ [7299013] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:26 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299013/ [7299014] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} time: 00:24:21 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299014/ [7299015] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:15:35 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299015/ [7299016] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04}} time: 00:08:58 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299016/ [7299018] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli} time: 00:19:30 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299018/ [7299019] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:15:14 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299019/ [7299020] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:50 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299020/ [7299021] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/sync workloads/rados_api_tests} time: 00:28:46 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299021/ [7299022] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:23:21 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299022/ [7299023] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:10:26 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299023/ [7299024] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:16:21 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299024/ [7299025] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:13:02 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299025/ [7299026] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:24:39 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299026/ [7299027] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:10:34 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299027/ [7299028] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:28 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299028/ [7299029] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:23:22 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299029/ [7299030] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:23:20 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299030/ [7299031] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:32 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299031/ [7299032] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:14:14 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299032/ [7299033] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:48 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299033/ [7299034] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:18:49 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299034/ [7299036] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:34:38 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299036/ [7299037] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:31:21 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299037/ [7299038] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:17:43 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299038/ [7299039] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04}} time: 00:12:29 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299039/ [7299041] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:29 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299041/ [7299042] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:15:02 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299042/ [7299043] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:47 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299043/ [7299044] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:28:54 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299044/ [7299045] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:30:18 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299045/ [7299046] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:59 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299046/ [7299047] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:39 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299047/ [7299048] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:32:16 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299048/ [7299049] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:16:41 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299049/ [7299050] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:40 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299050/ [7299051] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} time: 01:32:02 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299051/ [7299052] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:39 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299052/ [7299053] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:14:45 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299053/ [7299054] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} time: 00:31:09 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299054/ [7299055] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:21:56 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299055/ [7299056] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:28:36 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299056/ [7299057] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:39:57 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299057/ [7299058] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:50:30 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299058/ [7299059] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:33:04 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299059/ [7299060] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:30:01 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299060/ [7299061] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} tasks/mon_recovery} time: 00:14:22 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299061/ [7299063] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:37 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299063/ [7299064] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} time: 00:34:53 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299064/ [7299065] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:36:02 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299065/ [7299066] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:12 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299066/ [7299067] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:45:36 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299067/ [7299068] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:28:30 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299068/ [7299069] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:15:01 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299069/ [7299070] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:16:08 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299070/ [7299071] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:28:49 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299071/ [7299072] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}} time: 00:33:12 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299072/ [7299073] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:24:41 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299073/ [7299074] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_20.04}} time: 00:16:09 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299074/ [7299075] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:42:17 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299075/ [7299076] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:12:42 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299076/ [7299077] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} time: 00:28:37 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299077/ [7299078] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:26:12 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299078/ [7299079] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:28:36 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299079/ [7299080] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:40:21 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299080/ [7299081] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04}} time: 00:23:18 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299081/ [7299082] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:23:42 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299082/ [7299083] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:06 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299083/ [7299084] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:33 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299084/ [7299085] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:25:05 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299085/ [7299086] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:22 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299086/ [7299087] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:21:13 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299087/ [7299088] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:22:57 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299088/ [7299089] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:23:28 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299089/ [7299090] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:20:00 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299090/ [7299091] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} tasks/rados_cls_all} time: 00:21:02 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299091/ [7299093] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:21:31 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299093/ [7299094] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} time: 00:34:34 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299094/ [7299095] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:19:22 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299095/ [7299096] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:39 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299096/ [7299097] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} time: 00:29:33 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299097/ [7299098] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:24:14 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299098/ [7299099] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/dedup-io-mixed} time: 00:11:58 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299099/ [7299100] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:14:16 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299100/ [7299101] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:30:13 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299101/ [7299102] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos} time: 00:10:55 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299102/ [7299103] rados/singleton/{all/peer mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:21 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299103/ [7299104] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:13:11 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299104/ [7299105] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:27 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299105/ [7299106] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-snaps} time: 00:15:46 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299106/ [7299107] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:16:17 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299107/ [7299108] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} time: 00:37:59 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299108/ [7299109] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04}} time: 00:17:34 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299109/ [7299110] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:20:58 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299110/ [7299111] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rados_api_tests} time: 00:32:40 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299111/ [7299112] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:34 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299112/ [7299113] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/progress} time: 00:31:00 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299113/ [7299114] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}} time: 00:17:19 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299114/ [7299115] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:23:14 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299115/ [7299116] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} time: 00:35:02 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299116/ [7299117] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:17:27 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299117/ [7299119] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:12 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299119/ [7299120] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:16:31 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299120/ [7299121] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_20.04}} time: 00:31:48 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299121/ [7299122] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/radosbench} time: 00:29:42 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299122/ [7299123] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:13:21 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299123/ [7299124] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:14:04 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299124/ [7299125] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect} time: 00:14:58 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299125/ [7299126] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:27:39 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299126/ [7299128] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:39 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299128/ [7299129] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:30:01 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299129/ [7299130] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:49 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299130/ [7299131] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/one workloads/pool-create-delete} time: 00:19:09 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299131/ [7299132] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} time: 00:13:30 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299132/ [7299133] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:46:08 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299133/ [7299134] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}} time: 00:16:22 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299134/ [7299135] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:15:03 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299135/ [7299136] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:14 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299136/ [7299137] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:17:51 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299137/ [7299138] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:35 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299138/ [7299139] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_set_object} time: 00:15:19 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299139/ [7299140] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:38:34 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299140/ [7299141] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:35:12 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299141/ [7299142] rados/singleton/{all/random-eio mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:30:24 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299142/ [7299143] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/set-chunks-read} time: 00:23:48 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299143/ [7299144] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:26:05 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299144/ [7299145] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_nfs} time: 00:29:13 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299145/ [7299146] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/dashboard} time: 01:12:43 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299146/ [7299147] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:18:07 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299147/ [7299149] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} time: 00:22:14 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299149/ [7299150] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:15 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299150/ [7299151] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:17:40 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299151/ [7299152] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:12:55 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299152/ [7299153] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_20.04} tasks/prometheus} time: 00:12:47 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299153/ [7299154] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:34:11 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299154/ [7299155] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}} time: 00:33:06 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299155/ [7299156] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:26 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299156/ [7299157] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects} time: 00:22:57 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299157/ [7299158] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:56 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299158/ [7299159] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:26:30 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299159/ [7299160] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:45:56 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299160/ [7299161] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:32:28 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299161/ [7299162] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:24:14 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299162/ [7299163] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 01:27:59 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299163/ [7299165] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:32:48 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299165/ [7299166] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:13:21 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299166/ [7299167] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} time: 02:34:02 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299167/ [7299168] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:04 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299168/ [7299169] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:11:21 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299169/ [7299170] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/sync-many workloads/rados_5925} time: 00:11:32 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299170/ [7299171] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:34:58 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299171/ [7299172] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:11:41 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299172/ [7299173] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{rhel_8}} time: 02:22:44 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299173/ [7299174] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:30:16 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299174/ [7299175] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:15:17 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299175/ [7299176] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} tasks/mon_recovery} time: 00:11:28 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299176/ [7299177] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:04 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299177/ [7299178] rados/singleton/{all/test-crash mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:13:04 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299178/ [7299179] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:28:08 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299179/ [7299180] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:19 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299180/ [7299181] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli_mon} time: 00:36:05 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299181/ [7299182] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:24:34 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299182/ [7299183] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:08:59 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299183/ [7299184] rados/singleton/{all/test-noautoscale-flag mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:12:00 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299184/ [7299185] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:37:22 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299185/ [7299186] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:28:08 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299186/ [7299187] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:19:13 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299187/ [7299188] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:35 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299188/ [7299189] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/workunits} time: 00:15:07 info: http://pulpito.ceph.com/akupczyk-2023-06-08_15:51:51-rados-wip-aclamk-bs-esb-3-extentmap-dup-distro-default-smithi/7299189/