2023-06-13T12:21:27.620 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-13T12:21:27.628 INFO:teuthology.results:subset: '412/20000' 2023-06-13T12:21:27.628 INFO:teuthology.results:seed: '2505' 2023-06-13T14:06:43.728 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-13T14:06:43.751 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-06-14T00:30:40.467 INFO:teuthology.results:Tests finished! gathering results... 2023-06-14T00:30:55.661 INFO:scrape:Found 200 jobs 2023-06-14T00:30:56.648 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301831/teuthology.log 2023-06-14T00:30:57.857 INFO:scrape:Found 10 distinct failure reasons 2023-06-14T00:30:57.858 INFO:scrape:Failure: Test failure: test_non_existent_cluster (tasks.cephfs.test_nfs.TestNFS) 2023-06-14T00:30:57.858 INFO:scrape:1 jobs: ['7301906'] 2023-06-14T00:30:57.859 INFO:scrape:suites: ['agent/off', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8', 'task/test_nfs}'] 2023-06-14T00:30:57.859 INFO:scrape: 2023-06-14T00:30:57.859 INFO:scrape:Failure: Command failed (workunit test cls/test_cls_refcount.sh) on smithi098 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=pacific TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh' 2023-06-14T00:30:57.860 INFO:scrape:1 jobs: ['7301929'] 2023-06-14T00:30:57.860 INFO:scrape:suites: ['0-start', '1-tasks', 'mon_election/connectivity', 'rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default'] 2023-06-14T00:30:57.860 INFO:scrape: 2023-06-14T00:30:57.860 INFO:scrape:Dead: None 2023-06-14T00:30:57.861 INFO:scrape:2 jobs: ['7301831', '7301785'] 2023-06-14T00:30:57.861 INFO:scrape: 2023-06-14T00:30:57.861 INFO:scrape:Failure: Command failed on smithi006 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" 2023-06-14T00:30:57.862 INFO:scrape:2 jobs: ['7301807', '7301899'] 2023-06-14T00:30:57.862 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', '3-final', 'k8s/1.21', 'rados/rook/smoke/{0-distro/ubuntu_20.04'] 2023-06-14T00:30:57.862 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/flannel', 'net/host', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}'] 2023-06-14T00:30:57.862 INFO:scrape: 2023-06-14T00:30:57.863 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi167 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5406f4b1729bf4f476338ad344cc86b126e0c5b3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-06-14T00:30:57.863 INFO:scrape:1 jobs: ['7301836'] 2023-06-14T00:30:57.863 INFO:scrape:suites: ['debug/mgr', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-hybrid}', 'tasks/e2e}'] 2023-06-14T00:30:57.864 INFO:scrape: 2023-06-14T00:30:57.864 INFO:scrape:Failure: SSH connection to smithi022 was lost: 'sudo yum install -y kernel' 2023-06-14T00:30:57.864 INFO:scrape:1 jobs: ['7301786'] 2023-06-14T00:30:57.865 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'recovery-overrides/{more-active-recovery}', 'supported-random-distro$/{centos_8}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}'] 2023-06-14T00:30:57.865 INFO:scrape: 2023-06-14T00:30:57.865 INFO:scrape:Failure: reached maximum tries (801) after waiting for 4800 seconds 2023-06-14T00:30:57.866 INFO:scrape:1 jobs: ['7301883'] 2023-06-14T00:30:57.866 INFO:scrape:suites: ['clusters/{fixed-2', 'fast/fast', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{default}', 'supported-random-distro$/{rhel_8}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/ec-radosbench}'] 2023-06-14T00:30:57.866 INFO:scrape: 2023-06-14T00:30:57.867 INFO:scrape:Dead: b'2023-06-14T00:27:56.305 DEBUG:teuthology.exit:Finished running handlers' 2023-06-14T00:30:57.867 INFO:scrape:1 jobs: ['7301798'] 2023-06-14T00:30:57.867 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/none', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'rados', 'rados/singleton/{all/lost-unfound', 'supported-random-distro$/{rhel_8}}'] 2023-06-14T00:30:57.868 INFO:scrape: 2023-06-14T00:30:57.868 INFO:scrape:Failure: [Errno None] Unable to connect to port 22 on 172.21.15.22 2023-06-14T00:30:57.868 INFO:scrape:1 jobs: ['7301833'] 2023-06-14T00:30:57.869 INFO:scrape:suites: ['0-nvme-loop', 'agent/on', 'fixed-2', 'mon_election/connectivity', 'rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8', 'start}'] 2023-06-14T00:30:57.869 INFO:scrape: 2023-06-14T00:30:57.870 INFO:scrape:Failure: Command failed on smithi081 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-0' 2023-06-14T00:30:57.870 INFO:scrape:1 jobs: ['7301870'] 2023-06-14T00:30:57.870 INFO:scrape:suites: ['2-inject-leak/none', 'centos_latest}', 'rados/valgrind-leaks/{1-start'] 2023-06-14T00:30:57.871 INFO:scrape: 2023-06-14T00:30:57.878 INFO:teuthology.results:Sending results to akupczyk@redhat.com: Test Run: akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/ failed: 8 dead: 4 running: 0 waiting: 0 queued: 0 passed: 188 Fail ================================================================= [7301807] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:07:04 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301807/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301807/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0e6b19a2ebf448f38982f0b5e491f2a9 Command failed on smithi006 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7301833] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301833/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301833/ sentry: https://sentry.ceph.com/organizations/ceph/?query=be48e7058a7c4f9fbaccac140e384c07 [Errno None] Unable to connect to port 22 on 172.21.15.22 [7301836] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} tasks/e2e} ----------------------------------------------------------------- time: 00:20:07 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301836/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301836/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b2fec69e54304ee580ab0cadb642e543 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi167 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5406f4b1729bf4f476338ad344cc86b126e0c5b3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7301870] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} ----------------------------------------------------------------- time: 00:38:43 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301870/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301870/ sentry: https://sentry.ceph.com/organizations/ceph/?query=05a1f9b8d464464ab08bcf1e82029cca Command failed on smithi081 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-0' [7301883] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} ----------------------------------------------------------------- time: 01:50:15 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301883/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301883/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2e8950956f904800b150dfba2695698f reached maximum tries (801) after waiting for 4800 seconds [7301899] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:05:59 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301899/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301899/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e3cc832b6cfc44bc93e986721b3b36af Command failed on smithi101 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7301906] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/off mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:26:41 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301906/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301906/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0eb7af361867410d945917d75ff9b5e4 Test failure: test_non_existent_cluster (tasks.cephfs.test_nfs.TestNFS) [7301929] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:39:18 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301929/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301929/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f1af3e69d86049498286533c3a70fca3 Command failed (workunit test cls/test_cls_refcount.sh) on smithi098 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=pacific TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh' Dead ================================================================= [7301785] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301785/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301785/ Error reimaging machines: Expected smithi022's OS to be rhel 8.4 but found centos 8 [7301786] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301786/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301786/ sentry: https://sentry.ceph.com/organizations/ceph/?query=24fac27e1e7e4d538d34005f30f426f2 SSH connection to smithi022 was lost: 'sudo yum install -y kernel' [7301798] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301798/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301798/ hit max job timeout [7301831] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301831/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301831/ Error reimaging machines: Expected smithi022's OS to be centos 8 but found rhel 8.4 Pass ================================================================= [7301769] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:22:21 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301769/ [7301770] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:49:50 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301770/ [7301771] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:22:09 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301771/ [7301772] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:16:13 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301772/ [7301773] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:20:28 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301773/ [7301774] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:39:59 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301774/ [7301775] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:15:20 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301775/ [7301776] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:15:10 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301776/ [7301777] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:14:21 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301777/ [7301778] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_8} tasks/failover} time: 00:17:48 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301778/ [7301779] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:10:18 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301779/ [7301780] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:18:42 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301780/ [7301781] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:14:28 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301781/ [7301782] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/sync workloads/pool-create-delete} time: 00:21:55 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301782/ [7301783] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} time: 00:54:15 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301783/ [7301784] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:16:56 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301784/ [7301787] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:47:41 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301787/ [7301788] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_orch_cli} time: 00:17:51 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301788/ [7301789] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:29 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301789/ [7301790] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} time: 00:30:38 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301790/ [7301791] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:22:13 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301791/ [7301792] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:27:37 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301792/ [7301793] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:30:33 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301793/ [7301794] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:35:28 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301794/ [7301795] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:27:41 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301795/ [7301796] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:11:06 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301796/ [7301797] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/off mon_election/connectivity task/test_orch_cli_mon} time: 00:46:40 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301797/ [7301799] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects} time: 00:21:31 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301799/ [7301800] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:59 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301800/ [7301801] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:21:22 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301801/ [7301802] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:34:23 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301802/ [7301803] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:12 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301803/ [7301804] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:09:57 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301804/ [7301805] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:31:16 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301805/ [7301806] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:01 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301806/ [7301808] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:22:12 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301808/ [7301809] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:44:09 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301809/ [7301810] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:25:11 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301810/ [7301811] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:10:19 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301811/ [7301812] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:19:26 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301812/ [7301813] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:26:52 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301813/ [7301814] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/on mon_election/classic task/test_rgw_multisite} time: 00:29:59 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301814/ [7301815] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_5925} time: 00:27:25 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301815/ [7301816] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:28:49 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301816/ [7301817] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:18:09 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301817/ [7301818] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:15:43 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301818/ [7301819] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} time: 00:22:29 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301819/ [7301820] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:17:05 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301820/ [7301821] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:41:38 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301821/ [7301822] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:37:39 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301822/ [7301823] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:25 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301823/ [7301824] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:12:47 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301824/ [7301825] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:24:46 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301825/ [7301826] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:49:24 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301826/ [7301827] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:22:13 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301827/ [7301828] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 01:32:10 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301828/ [7301829] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:28:32 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301829/ [7301830] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:58 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301830/ [7301832] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:17:23 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301832/ [7301834] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:19:31 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301834/ [7301835] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:20:47 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301835/ [7301837] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:14:46 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301837/ [7301838] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_adoption} time: 00:11:00 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301838/ [7301839] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:23:49 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301839/ [7301840] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:26:44 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301840/ [7301841] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:12:30 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301841/ [7301842] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:46:05 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301842/ [7301843] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:17:44 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301843/ [7301844] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:47:16 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301844/ [7301845] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:21:25 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301845/ [7301846] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:22:12 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301846/ [7301847] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:30:34 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301847/ [7301848] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:30:32 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301848/ [7301849] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:33:31 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301849/ [7301850] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:15:32 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301850/ [7301851] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_api_tests} time: 00:34:26 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301851/ [7301852] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache} time: 00:13:09 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301852/ [7301853] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} time: 00:31:58 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301853/ [7301854] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_cephadm} time: 00:19:02 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301854/ [7301855] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:11:01 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301855/ [7301856] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:34:55 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301856/ [7301857] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:18:55 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301857/ [7301858] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:18 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301858/ [7301859] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} time: 00:18:43 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301859/ [7301860] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:15:52 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301860/ [7301861] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:15:34 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301861/ [7301862] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:25:54 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301862/ [7301863] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} time: 00:24:26 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301863/ [7301864] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:19:23 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301864/ [7301865] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:18:05 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301865/ [7301866] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:26:33 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301866/ [7301867] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:27:07 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301867/ [7301868] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:21:50 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301868/ [7301869] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:19:10 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301869/ [7301871] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:25 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301871/ [7301872] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:23:31 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301872/ [7301873] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:25:17 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301873/ [7301874] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:14:31 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301874/ [7301875] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_cephadm_repos} time: 00:09:12 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301875/ [7301876] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 01:06:31 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301876/ [7301877] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:28:38 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301877/ [7301878] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:27:57 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301878/ [7301879] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:15:38 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301879/ [7301880] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:11:12 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301880/ [7301881] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} time: 00:29:38 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301881/ [7301882] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:26 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301882/ [7301884] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect} time: 00:13:54 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301884/ [7301885] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:16:30 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301885/ [7301886] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:19:00 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301886/ [7301887] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_osdmap_prune} time: 01:10:48 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301887/ [7301888] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:31:51 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301888/ [7301889] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:13:51 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301889/ [7301890] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:44:22 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301890/ [7301891] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:20:18 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301891/ [7301892] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:06 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301892/ [7301893] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:00 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301893/ [7301894] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:13:38 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301894/ [7301895] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/progress} time: 00:29:52 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301895/ [7301896] rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:14:55 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301896/ [7301897] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/on mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:19:56 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301897/ [7301898] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:47 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301898/ [7301900] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:17:30 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301900/ [7301901] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:15:39 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301901/ [7301902] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/libcephsqlite} time: 00:18:54 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301902/ [7301903] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:09:24 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301903/ [7301904] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:26:51 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301904/ [7301905] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:56 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301905/ [7301907] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:18:32 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301907/ [7301908] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:31:17 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301908/ [7301909] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} time: 01:16:06 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301909/ [7301910] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:21:03 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301910/ [7301911] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:11:28 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301911/ [7301912] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:22 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301912/ [7301913] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects} time: 00:22:59 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301913/ [7301914] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:19:35 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301914/ [7301915] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:29:49 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301915/ [7301916] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:28 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301916/ [7301917] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:49 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301917/ [7301918] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:16:15 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301918/ [7301919] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:29:30 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301919/ [7301920] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:26:12 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301920/ [7301921] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:09:43 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301921/ [7301922] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_workunits} time: 00:37:15 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301922/ [7301923] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} time: 02:04:19 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301923/ [7301924] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:30:10 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301924/ [7301925] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:34:45 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301925/ [7301926] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_orch_cli} time: 00:20:31 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301926/ [7301927] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{filestore-xfs} tasks/dashboard} time: 01:09:54 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301927/ [7301928] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:23:28 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301928/ [7301930] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:20:31 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301930/ [7301931] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:36:08 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301931/ [7301932] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:09:26 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301932/ [7301933] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:22:31 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301933/ [7301934] rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:19:59 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301934/ [7301935] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:12:26 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301935/ [7301936] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:46 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301936/ [7301937] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:21:44 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301937/ [7301938] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:16:15 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301938/ [7301939] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:36:18 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301939/ [7301940] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:15:10 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301940/ [7301941] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:15:49 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301941/ [7301942] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:26:14 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301942/ [7301943] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:25:50 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301943/ [7301944] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:34:29 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301944/ [7301945] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:20:21 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301945/ [7301946] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:18:36 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301946/ [7301947] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:22:59 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301947/ [7301948] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:57 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301948/ [7301949] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 01:15:16 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301949/ [7301950] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:06 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301950/ [7301951] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:26:44 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301951/ [7301952] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:20:17 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301952/ [7301953] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:30 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301953/ [7301954] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:19:38 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301954/ [7301955] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:22:30 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301955/ [7301956] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} time: 00:25:55 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301956/ [7301957] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_orch_cli_mon} time: 00:33:33 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301957/ [7301958] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:09 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301958/ [7301959] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:24:03 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301959/ [7301960] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:17:38 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301960/ [7301961] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync workloads/snaps-few-objects} time: 00:35:07 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301961/ [7301962] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:27:38 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301962/ [7301963] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:28:55 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301963/ [7301964] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:41:37 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301964/ [7301965] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:40:07 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301965/ [7301966] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:14 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301966/ [7301967] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:37 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301967/ [7301968] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:19:27 info: http://pulpito.ceph.com/akupczyk-2023-06-13_12:20:40-rados-wip-aclamk-os-bluestore-rdr-quincy-distro-default-smithi/7301968/