2023-05-08T20:21:43.300 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-08T20:21:43.301 INFO:teuthology.results:subset: '412/20000' 2023-05-08T20:21:43.301 INFO:teuthology.results:seed: '8655' 2023-05-08T23:20:12.450 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-08T23:20:12.869 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-05-09T02:04:29.490 INFO:teuthology.results:Tests finished! gathering results... 2023-05-09T02:04:55.887 INFO:scrape:Found 340 jobs 2023-05-09T02:04:58.747 INFO:scrape:Found 8 distinct failure reasons 2023-05-09T02:04:58.748 INFO:scrape:Failure: Command failed on smithi002 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' 2023-05-09T02:04:58.748 INFO:scrape:6 jobs: ['7267320', '7267151', '7267367', '7267406', '7267206', '7267234'] 2023-05-09T02:04:58.749 INFO:scrape:suites intersection: [] 2023-05-09T02:04:58.749 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '0-size-min-size-overrides/2-size-2-min-size', '1-install/nautilus', '1-rook', '2-workload/none', '2-workload/radosbench', 'backoff/peering_and_degraded', 'ceph', 'cluster/1-node', 'cluster/3-node', 'clusters/{openstack', 'd-balancer/crush-compat', 'k8s/1.21', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr/async', 'net/calico', 'net/flannel', 'net/host', 'no_pools', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/multimon/{clusters/9', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'rook/1.7.2}', 'rook/master}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/mon_clock_with_skews}', 'thrashers/none', 'thrashosds-health', 'three-plus-one}', 'workloads/rbd_cls}'] 2023-05-09T02:04:58.749 INFO:scrape: 2023-05-09T02:04:58.750 INFO:scrape:Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi119 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bedaa2241947e11719cf6877c9e60ac7af4a2658 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' 2023-05-09T02:04:58.750 INFO:scrape:2 jobs: ['7267362', '7267307'] 2023-05-09T02:04:58.750 INFO:scrape:suites intersection: ['mon_election/classic', 'msgr-failures/many', 'msgr/async-v1only', 'rados', 'test_envlibrados_for_rocksdb}'] 2023-05-09T02:04:58.751 INFO:scrape:suites union: ['mon_election/classic', 'msgr-failures/many', 'msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-stupid', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}}', 'test_envlibrados_for_rocksdb}'] 2023-05-09T02:04:58.751 INFO:scrape: 2023-05-09T02:04:58.752 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' 2023-05-09T02:04:58.752 INFO:scrape:2 jobs: ['7267356', '7267187'] 2023-05-09T02:04:58.752 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{ubuntu_latest}}'] 2023-05-09T02:04:58.753 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{ubuntu_latest}}'] 2023-05-09T02:04:58.753 INFO:scrape: 2023-05-09T02:04:58.753 INFO:scrape:Failure: "1683582242.8657966 osd.0 (osd.0) 12 : cluster [WRN] WaitReplicas::react(const DigestUpdate&): Unexpected DigestUpdate event" in cluster log 2023-05-09T02:04:58.754 INFO:scrape:1 jobs: ['7267208'] 2023-05-09T02:04:58.754 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/many', 'msgr/async-v1only', 'objectstore/bluestore-hybrid', 'rados', 'rados/singleton/{all/osd-recovery', 'supported-random-distro$/{ubuntu_latest}}'] 2023-05-09T02:04:58.754 INFO:scrape: 2023-05-09T02:04:58.755 INFO:scrape:Failure: 2023-05-09T02:04:58.755 INFO:scrape:1 jobs: ['7267128'] 2023-05-09T02:04:58.755 INFO:scrape:suites: ['clusters/{fixed-2', 'mon_election/classic', 'msgr-failures/many', 'msgr/async-v1only', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{centos_8}', 'tasks/scrub_test}'] 2023-05-09T02:04:58.756 INFO:scrape: 2023-05-09T02:04:58.756 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bedaa2241947e11719cf6877c9e60ac7af4a2658 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-05-09T02:04:58.756 INFO:scrape:2 jobs: ['7267178', '7267345'] 2023-05-09T02:04:58.757 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}'] 2023-05-09T02:04:58.757 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-lz4}', 'random-objectstore$/{bluestore-comp-zstd}', 'tasks/e2e}'] 2023-05-09T02:04:58.758 INFO:scrape: 2023-05-09T02:04:58.758 INFO:scrape:Failure: SSH connection to smithi191 was lost: 'sudo apt-get update' 2023-05-09T02:04:58.758 INFO:scrape:1 jobs: ['7267368'] 2023-05-09T02:04:58.759 INFO:scrape:suites: ['mon_election/classic', 'rados', 'rados/singleton-nomsgr/{all/librados_hello_world', 'supported-random-distro$/{ubuntu_20.04}}'] 2023-05-09T02:04:58.759 INFO:scrape: 2023-05-09T02:04:58.759 INFO:scrape:Failure: "1683582313.0223095 mon.a (mon.0) 507 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log 2023-05-09T02:04:58.760 INFO:scrape:1 jobs: ['7267207'] 2023-05-09T02:04:58.760 INFO:scrape:suites: ['clusters/{fixed-2', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rados_cls_all}'] 2023-05-09T02:04:58.760 INFO:scrape: 2023-05-09T02:04:58.774 INFO:teuthology.results:Sending results to akupczyk@redhat.com: Test Run: akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/ failed: 15 dead: 1 running: 0 waiting: 0 queued: 0 passed: 324 Fail ================================================================= [7267128] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/scrub_test} ----------------------------------------------------------------- time: 00:06:41 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267128/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267128/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bfb0d914a80142be97733f042517e0fd [7267151] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:06:38 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267151/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267151/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5c05a08d9f8f464994c7ac83e11911af Command failed on smithi044 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7267178] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/e2e} ----------------------------------------------------------------- time: 00:27:10 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267178/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267178/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cacc0376621c43d8b097cb50f72518e9 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bedaa2241947e11719cf6877c9e60ac7af4a2658 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7267187] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:26 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267187/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267187/ sentry: https://sentry.ceph.com/organizations/ceph/?query=df90289baa7e493b9b3054370fcb97e7 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7267206] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:08:14 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267206/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267206/ sentry: https://sentry.ceph.com/organizations/ceph/?query=069c36c7112a4f61a31215a1cc0ed49f Command failed on smithi125 with status 5: 'sudo systemctl stop ceph-267937c8-ede7-11ed-9b02-001a4aab830c@mon.b' [7267207] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:23:01 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267207/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267207/ "1683582313.0223095 mon.a (mon.0) 507 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7267208] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:20:25 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267208/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267208/ "1683582242.8657966 osd.0 (osd.0) 12 : cluster [WRN] WaitReplicas::react(const DigestUpdate&): Unexpected DigestUpdate event" in cluster log [7267234] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:06:21 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267234/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267234/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f6a77ab1a0b94b8d8b80bbea16a4760b Command failed on smithi003 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7267307] rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest test_envlibrados_for_rocksdb} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:14:24 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267307/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267307/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9a43cd3cb3fb424787b5e3fccf08cc3d Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi174 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bedaa2241947e11719cf6877c9e60ac7af4a2658 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7267320] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:06:32 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267320/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267320/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ee2d88ae403e4a27b9e38d43ea42ca25 Command failed on smithi002 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7267345] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/e2e} ----------------------------------------------------------------- time: 00:23:55 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267345/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267345/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0d9640a32c474afab5409246c52b1c2f Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi016 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bedaa2241947e11719cf6877c9e60ac7af4a2658 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7267356] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:01 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267356/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267356/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f25c0d2677144423b6fc1d82928d1e66 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7267362] rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest test_envlibrados_for_rocksdb} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:12:07 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267362/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267362/ sentry: https://sentry.ceph.com/organizations/ceph/?query=87d1b2f4a10a4884bb1e50d87900ea19 Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi119 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bedaa2241947e11719cf6877c9e60ac7af4a2658 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7267367] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267367/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267367/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe51b761ac734ccd9d859a2637002fe5 Command failed on smithi191 with status 100: 'sudo apt-get clean' [7267406] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/flannel rook/1.7.2} ----------------------------------------------------------------- time: 00:06:22 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267406/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267406/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c777d0df5b2d45b09a4355be0a1f8cdc Command failed on smithi070 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' Dead ================================================================= [7267368] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267368/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267368/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a3ff0ce8ba314e12ae6464f0e522ad4e SSH connection to smithi191 was lost: 'sudo apt-get update' Pass ================================================================= [7267106] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:20:19 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267106/ [7267107] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:14:12 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267107/ [7267108] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}} time: 00:08:32 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267108/ [7267109] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 00:31:15 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267109/ [7267110] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:24 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267110/ [7267111] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:32:01 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267111/ [7267112] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:25 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267112/ [7267113] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:41:42 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267113/ [7267114] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:32:16 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267114/ [7267115] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:27 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267115/ [7267116] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_nfs} time: 00:36:39 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267116/ [7267117] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:29:16 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267117/ [7267118] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/radosbench} time: 00:49:23 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267118/ [7267119] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:09:57 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267119/ [7267120] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:19:57 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267120/ [7267121] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:34 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267121/ [7267122] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{rhel_8} tasks/failover} time: 00:22:39 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267122/ [7267123] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:11:12 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267123/ [7267124] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:54:36 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267124/ [7267125] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:14:26 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267125/ [7267126] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:16 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267126/ [7267127] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:11:29 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267127/ [7267129] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:12 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267129/ [7267130] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:23:52 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267130/ [7267131] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:19:24 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267131/ [7267132] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:10:57 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267132/ [7267133] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} time: 01:03:03 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267133/ [7267134] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli} time: 00:19:13 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267134/ [7267135] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:22:06 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267135/ [7267136] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:19:06 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267136/ [7267137] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_api_tests} time: 00:29:27 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267137/ [7267138] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:27 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267138/ [7267139] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:11:28 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267139/ [7267140] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04}} time: 00:12:25 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267140/ [7267141] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:52 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267141/ [7267142] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:23:56 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267142/ [7267143] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_20.04}} time: 00:08:42 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267143/ [7267144] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:07 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267144/ [7267145] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:43 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267145/ [7267146] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:21:31 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267146/ [7267147] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:33 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267147/ [7267148] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}} time: 00:12:40 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267148/ [7267149] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:45 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267149/ [7267150] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:18:09 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267150/ [7267152] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:30:33 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267152/ [7267153] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:27:07 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267153/ [7267154] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} tasks/libcephsqlite} time: 00:15:20 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267154/ [7267155] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:13:43 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267155/ [7267156] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:23:36 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267156/ [7267157] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:25 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267157/ [7267158] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{rhel_8} tasks/insights} time: 00:29:22 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267158/ [7267159] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:46 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267159/ [7267160] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:18:30 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267160/ [7267161] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:31:03 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267161/ [7267162] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:26 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267162/ [7267163] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:24 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267163/ [7267164] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:26:33 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267164/ [7267165] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:13:22 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267165/ [7267166] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:44 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267166/ [7267167] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 01:35:56 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267167/ [7267168] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:59 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267168/ [7267169] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:19:33 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267169/ [7267170] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} time: 00:16:16 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267170/ [7267171] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:28 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267171/ [7267172] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:04 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267172/ [7267173] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:17:01 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267173/ [7267174] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:51:00 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267174/ [7267175] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:28:20 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267175/ [7267176] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:33:55 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267176/ [7267177] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:15:38 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267177/ [7267179] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:32 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267179/ [7267180] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} time: 00:10:39 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267180/ [7267181] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:47:30 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267181/ [7267182] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:26 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267182/ [7267183] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:25:54 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267183/ [7267184] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:13:40 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267184/ [7267185] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:17:17 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267185/ [7267186] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:15:46 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267186/ [7267188] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:34:29 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267188/ [7267189] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:24:29 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267189/ [7267190] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:18:45 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267190/ [7267191] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:19:24 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267191/ [7267192] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:13:00 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267192/ [7267193] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} time: 00:20:48 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267193/ [7267194] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:24:50 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267194/ [7267195] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_20.04} tasks/module_selftest} time: 00:26:43 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267195/ [7267196] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:11 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267196/ [7267197] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:32:08 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267197/ [7267198] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:24:46 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267198/ [7267199] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:44 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267199/ [7267200] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:12 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267200/ [7267201] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:21:20 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267201/ [7267202] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:24:07 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267202/ [7267203] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:59 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267203/ [7267204] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:17:29 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267204/ [7267205] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:17:57 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267205/ [7267209] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:12 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267209/ [7267210] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} time: 00:29:54 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267210/ [7267211] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:21:03 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267211/ [7267212] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:17:39 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267212/ [7267213] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} time: 00:30:35 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267213/ [7267214] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:21:20 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267214/ [7267215] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/dedup-io-mixed} time: 00:13:23 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267215/ [7267216] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:13:48 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267216/ [7267217] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:21:47 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267217/ [7267218] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos} time: 00:10:26 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267218/ [7267219] rados/singleton/{all/peer mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:42 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267219/ [7267220] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:12:51 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267220/ [7267221] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:30 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267221/ [7267222] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/dedup-io-snaps} time: 00:18:11 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267222/ [7267223] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:11:51 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267223/ [7267224] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} time: 00:32:59 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267224/ [7267225] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:16:05 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267225/ [7267226] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:20:45 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267226/ [7267227] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rados_api_tests} time: 00:34:03 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267227/ [7267228] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:21 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267228/ [7267229] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{rhel_8} tasks/progress} time: 00:30:20 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267229/ [7267230] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:22:16 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267230/ [7267231] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:18:35 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267231/ [7267232] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} time: 00:38:46 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267232/ [7267233] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:24 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267233/ [7267235] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:55 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267235/ [7267236] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:18:11 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267236/ [7267237] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_20.04}} time: 00:31:18 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267237/ [7267238] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/radosbench} time: 00:27:57 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267238/ [7267239] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:12:35 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267239/ [7267240] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:07:49 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267240/ [7267241] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/redirect} time: 00:12:03 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267241/ [7267242] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:34:31 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267242/ [7267243] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} time: 01:11:10 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267243/ [7267244] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:11:54 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267244/ [7267245] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:23:36 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267245/ [7267246] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:21:26 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267246/ [7267247] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/pool-create-delete} time: 00:20:39 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267247/ [7267248] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} time: 00:13:35 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267248/ [7267249] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:35:50 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267249/ [7267250] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:13:50 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267250/ [7267251] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} tasks/mon_clock_with_skews} time: 00:09:21 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267251/ [7267252] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:10:07 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267252/ [7267253] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:14:13 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267253/ [7267254] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:03 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267254/ [7267255] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_set_object} time: 00:15:40 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267255/ [7267256] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:33:50 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267256/ [7267257] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:36 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267257/ [7267258] rados/singleton/{all/random-eio mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:28:09 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267258/ [7267259] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/set-chunks-read} time: 00:17:44 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267259/ [7267260] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:15:24 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267260/ [7267261] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_nfs} time: 00:29:05 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267261/ [7267262] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/dashboard} time: 01:06:26 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267262/ [7267263] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:18:44 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267263/ [7267264] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:21:30 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267264/ [7267265] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} time: 00:23:40 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267265/ [7267266] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:06 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267266/ [7267267] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:17:06 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267267/ [7267268] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} time: 00:08:59 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267268/ [7267269] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_20.04} tasks/prometheus} time: 00:12:03 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267269/ [7267270] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:24:04 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267270/ [7267271] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}} time: 00:33:56 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267271/ [7267272] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:25 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267272/ [7267273] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects} time: 00:19:09 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267273/ [7267274] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:35:08 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267274/ [7267275] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:09 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267275/ [7267276] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:26:15 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267276/ [7267277] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:30:42 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267277/ [7267278] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:13:48 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267278/ [7267279] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 01:19:10 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267279/ [7267280] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli} time: 00:13:03 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267280/ [7267281] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:30:04 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267281/ [7267282] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:09:54 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267282/ [7267283] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} time: 02:22:27 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267283/ [7267284] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:42 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267284/ [7267285] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} tasks/rados_striper} time: 00:09:45 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267285/ [7267286] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_5925} time: 00:14:10 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267286/ [7267287] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:26:30 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267287/ [7267288] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:11:22 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267288/ [7267289] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} time: 02:40:13 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267289/ [7267290] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:26:30 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267290/ [7267291] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:12:13 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267291/ [7267292] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:12:19 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267292/ [7267293] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:32 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267293/ [7267294] rados/singleton/{all/test-crash mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:09:45 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267294/ [7267295] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:15 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267295/ [7267296] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:44 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267296/ [7267297] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli_mon} time: 00:31:53 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267297/ [7267298] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:15:08 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267298/ [7267299] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:24 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267299/ [7267300] rados/singleton/{all/test-noautoscale-flag mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:08:25 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267300/ [7267301] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:31:05 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267301/ [7267302] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:22:00 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267302/ [7267303] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:19:27 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267303/ [7267304] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:22 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267304/ [7267305] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_8} tasks/workunits} time: 00:13:19 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267305/ [7267306] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:12:16 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267306/ [7267308] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:49 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267308/ [7267309] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:11:19 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267309/ [7267310] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:33:45 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267310/ [7267311] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:10:40 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267311/ [7267312] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:42 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267312/ [7267313] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:26:55 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267313/ [7267314] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:27:05 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267314/ [7267315] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}} time: 01:13:20 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267315/ [7267316] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_adoption} time: 00:15:39 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267316/ [7267317] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:36 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267317/ [7267318] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} time: 03:41:38 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267318/ [7267319] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:17:37 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267319/ [7267321] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:37 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267321/ [7267322] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:14:01 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267322/ [7267323] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_api_tests} time: 00:37:32 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267323/ [7267324] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:26:28 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267324/ [7267325] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:24:12 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267325/ [7267326] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:30:18 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267326/ [7267327] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:26:56 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267327/ [7267328] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:27:18 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267328/ [7267329] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:22:22 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267329/ [7267330] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:37 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267330/ [7267331] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:54 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267331/ [7267332] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache} time: 00:14:19 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267332/ [7267333] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:46 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267333/ [7267334] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:54 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267334/ [7267335] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:19:28 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267335/ [7267336] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_20.04}} time: 00:07:45 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267336/ [7267337] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} tasks/rados_workunit_loadgen_mix} time: 00:21:46 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267337/ [7267338] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} time: 00:15:27 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267338/ [7267339] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:13 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267339/ [7267340] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm} time: 00:19:13 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267340/ [7267341] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:13:40 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267341/ [7267342] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-snaps} time: 00:24:59 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267342/ [7267343] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:25:51 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267343/ [7267344] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:31:38 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267344/ [7267346] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:57 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267346/ [7267347] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:11:48 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267347/ [7267348] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:09 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267348/ [7267349] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:45 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267349/ [7267350] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:28:40 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267350/ [7267351] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:11:12 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267351/ [7267352] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:32:11 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267352/ [7267353] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}} time: 00:33:10 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267353/ [7267354] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:10:13 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267354/ [7267355] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:25:46 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267355/ [7267357] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 02:59:12 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267357/ [7267358] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:11:01 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267358/ [7267359] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:34 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267359/ [7267360] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:51:40 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267360/ [7267361] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 01:19:36 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267361/ [7267363] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:50:16 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267363/ [7267364] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench} time: 00:52:07 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267364/ [7267365] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:34:13 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267365/ [7267366] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:09 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267366/ [7267369] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:18:40 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267369/ [7267370] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:09:32 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267370/ [7267371] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:16 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267371/ [7267372] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:04:42 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267372/ [7267373] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:14:27 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267373/ [7267374] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:21:06 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267374/ [7267375] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:19:44 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267375/ [7267376] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}} time: 00:20:17 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267376/ [7267377] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{rhel_8} tasks/failover} time: 00:20:25 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267377/ [7267378] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:11:29 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267378/ [7267379] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:24:39 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267379/ [7267380] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:17:28 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267380/ [7267381] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{centos_8}} time: 00:06:55 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267381/ [7267382] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:16:18 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267382/ [7267383] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}} time: 00:11:12 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267383/ [7267384] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:22:43 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267384/ [7267385] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:13 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267385/ [7267386] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:29:49 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267386/ [7267387] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:15:26 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267387/ [7267388] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:21:12 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267388/ [7267389] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:00 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267389/ [7267390] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:23 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267390/ [7267391] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:17:26 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267391/ [7267392] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/scrub} time: 02:46:58 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267392/ [7267393] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:01 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267393/ [7267394] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} time: 00:35:47 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267394/ [7267395] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:22:44 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267395/ [7267396] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:20:44 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267396/ [7267397] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:21:15 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267397/ [7267398] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:19:16 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267398/ [7267399] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:26:47 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267399/ [7267400] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:19:21 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267400/ [7267401] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:25:58 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267401/ [7267402] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:14:46 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267402/ [7267403] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:35:20 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267403/ [7267404] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:16 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267404/ [7267405] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio} time: 00:12:51 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267405/ [7267407] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:32:36 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267407/ [7267408] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:41 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267408/ [7267409] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_nfs} time: 00:33:56 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267409/ [7267410] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:17:28 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267410/ [7267411] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:27:34 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267411/ [7267412] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{rhel_8} tasks/insights} time: 00:20:18 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267412/ [7267413] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:34:52 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267413/ [7267414] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:10:58 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267414/ [7267415] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:20:27 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267415/ [7267416] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:27 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267416/ [7267417] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}} time: 00:45:30 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267417/ [7267418] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 00:20:21 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267418/ [7267419] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli} time: 00:19:17 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267419/ [7267420] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:41 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267420/ [7267421] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:12:37 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267421/ [7267422] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:21:22 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267422/ [7267423] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:54:08 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267423/ [7267424] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:11:03 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267424/ [7267425] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:17:22 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267425/ [7267426] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:15:17 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267426/ [7267427] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/dashboard} time: 01:03:13 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267427/ [7267428] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:51:22 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267428/ [7267429] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:18:30 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267429/ [7267430] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:20:00 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267430/ [7267431] rados/standalone/{supported-random-distro$/{rhel_8} workloads/c2c} time: 00:16:41 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267431/ [7267432] rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:36:07 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267432/ [7267433] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:19:45 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267433/ [7267434] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} time: 00:34:33 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267434/ [7267435] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:19:49 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267435/ [7267436] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:28:45 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267436/ [7267437] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:35:10 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267437/ [7267438] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:26:59 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267438/ [7267439] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:28:16 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267439/ [7267440] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:06:48 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267440/ [7267441] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} time: 00:09:59 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267441/ [7267442] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:09:37 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267442/ [7267443] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:10:34 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267443/ [7267444] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:25:14 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267444/ [7267445] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:25 info: http://pulpito.ceph.com/akupczyk-2023-05-08_20:20:43-rados-wip-aclamk-bs-elastic-shared-blob-distro-default-smithi/7267445/