2023-06-02T17:44:09.306 INFO:root:teuthology version: 0.0.1.dev116+g62814ab 2023-06-02T17:44:09.307 INFO:teuthology.results:subset: '111/120000' 2023-06-02T17:44:09.307 INFO:teuthology.results:seed: '522' 2023-06-02T20:09:22.508 INFO:root:teuthology version: 0.0.1.dev116+g62814ab 2023-06-02T20:09:22.546 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-06-02T22:53:39.108 INFO:teuthology.results:Tests finished! gathering results... 2023-06-02T22:54:04.098 INFO:scrape:Found 311 jobs 2023-06-02T22:54:06.636 INFO:scrape:Found 8 distinct failure reasons 2023-06-02T22:54:06.637 INFO:scrape:Failure: Command failed (workunit test cephadm/test_repos.sh) on smithi184 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2f53aca086f47527e85423521fdf9b2cd18f285 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' 2023-06-02T22:54:06.637 INFO:scrape:2 jobs: ['7294526', '7294661'] 2023-06-02T22:54:06.637 INFO:scrape:suites intersection: ['task/test_cephadm_repos}'] 2023-06-02T22:54:06.638 INFO:scrape:suites union: ['agent/off', 'agent/on', 'mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'task/test_cephadm_repos}'] 2023-06-02T22:54:06.638 INFO:scrape: 2023-06-02T22:54:06.638 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi018.front.sepia.ceph.com: ['type=AVC msg=audit(1685737023.713:20181): avc: denied { ioctl } for pid=110443 comm="iptables" path="/var/lib/containers/storage/overlay/edc41985066bba7aa05641b5602ad9933d4accd59c12b06cea52d63b7e22201d/merged" dev="overlay" ino=3543511 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1685737023.610:20178): avc: denied { ioctl } for pid=110426 comm="iptables" path="/var/lib/containers/storage/overlay/edc41985066bba7aa05641b5602ad9933d4accd59c12b06cea52d63b7e22201d/merged" dev="overlay" ino=3543511 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2023-06-02T22:54:06.639 INFO:scrape:1 jobs: ['7294789'] 2023-06-02T22:54:06.639 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_cephadm}'] 2023-06-02T22:54:06.639 INFO:scrape: 2023-06-02T22:54:06.639 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' 2023-06-02T22:54:06.640 INFO:scrape:2 jobs: ['7294665', '7294701'] 2023-06-02T22:54:06.640 INFO:scrape:suites intersection: ['mon_election/classic', 'rados'] 2023-06-02T22:54:06.640 INFO:scrape:suites union: ['0-size-min-size-overrides/2-size-2-min-size', '1-install/pacific', 'backoff/peering', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'supported-random-distro$/{ubuntu_latest}}', 'thrashers/mapgap', 'thrashosds-health', 'three-plus-one}', 'workloads/rbd_cls}'] 2023-06-02T22:54:06.641 INFO:scrape: 2023-06-02T22:54:06.641 INFO:scrape:Failure: Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest) 2023-06-02T22:54:06.641 INFO:scrape:2 jobs: ['7294733', '7294575'] 2023-06-02T22:54:06.641 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/dashboard}'] 2023-06-02T22:54:06.642 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-bitmap}', 'random-objectstore$/{bluestore-hybrid}', 'tasks/dashboard}'] 2023-06-02T22:54:06.642 INFO:scrape: 2023-06-02T22:54:06.642 INFO:scrape:Failure: Command failed on smithi050 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" 2023-06-02T22:54:06.643 INFO:scrape:4 jobs: ['7294813', '7294734', '7294656', '7294579'] 2023-06-02T22:54:06.643 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', 'k8s/1.21', 'rados/rook/smoke/{0-distro/ubuntu_20.04'] 2023-06-02T22:54:06.643 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/flannel', 'net/host', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}'] 2023-06-02T22:54:06.644 INFO:scrape: 2023-06-02T22:54:06.644 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi071 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2f53aca086f47527e85423521fdf9b2cd18f285 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-06-02T22:54:06.644 INFO:scrape:2 jobs: ['7294811', '7294655'] 2023-06-02T22:54:06.644 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}'] 2023-06-02T22:54:06.645 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-bitmap}', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'tasks/e2e}'] 2023-06-02T22:54:06.645 INFO:scrape: 2023-06-02T22:54:06.645 INFO:scrape:Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi182 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2f53aca086f47527e85423521fdf9b2cd18f285 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' 2023-06-02T22:54:06.646 INFO:scrape:2 jobs: ['7294741', '7294788'] 2023-06-02T22:54:06.646 INFO:scrape:suites intersection: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'rados', 'supported-random-distro$/{ubuntu_20.04}}', 'test_envlibrados_for_rocksdb}'] 2023-06-02T22:54:06.646 INFO:scrape:suites union: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest', 'supported-random-distro$/{ubuntu_20.04}}', 'test_envlibrados_for_rocksdb}'] 2023-06-02T22:54:06.646 INFO:scrape: 2023-06-02T22:54:06.647 INFO:scrape:Failure: "1685731061.3170328 mon.a (mon.0) 508 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log 2023-06-02T22:54:06.647 INFO:scrape:1 jobs: ['7294593'] 2023-06-02T22:54:06.647 INFO:scrape:suites: ['clusters/{fixed-2', 'mon_election/classic', 'msgr-failures/many', 'msgr/async', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rados_cls_all}'] 2023-06-02T22:54:06.648 INFO:scrape: 2023-06-02T22:54:06.659 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/ failed: 16 dead: 0 running: 0 waiting: 0 queued: 0 passed: 295 Fail ================================================================= [7294526] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:49 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294526/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294526/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0ac1c3c68931451e9ba5f4fd245543b5 Command failed (workunit test cephadm/test_repos.sh) on smithi184 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2f53aca086f47527e85423521fdf9b2cd18f285 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [7294575] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/dashboard} ----------------------------------------------------------------- time: 00:33:25 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294575/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294575/ sentry: https://sentry.ceph.com/organizations/ceph/?query=98d5005cd8bb4516a4f6744115d97e22 Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest) [7294579] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:05:53 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294579/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294579/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5ff6333b28e5492faac5a1cc7df1e465 Command failed on smithi163 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7294593] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:22:35 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294593/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294593/ "1685731061.3170328 mon.a (mon.0) 508 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7294655] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/e2e} ----------------------------------------------------------------- time: 00:20:07 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294655/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294655/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e01d9180a54245a59a03830c8c7f925f Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi018 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2f53aca086f47527e85423521fdf9b2cd18f285 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7294656] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:06:15 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294656/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294656/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8e6509421bca4971a938c95e8f556f26 Command failed on smithi047 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7294661] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:51 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294661/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294661/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bdaf318e01ef42f2a68664130c1cfc32 Command failed (workunit test cephadm/test_repos.sh) on smithi148 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2f53aca086f47527e85423521fdf9b2cd18f285 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [7294665] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:41 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294665/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294665/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff7bdf91173a41ac85c2fc6f06d0b69e Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7294701] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:21:39 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294701/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294701/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7a9fc2f6915f4188b8429b662ba126a5 Command failed on smithi155 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_cls_rbd --gtest_filter=-Te stClsRbd.get_features:TestClsRbd.parents:TestClsRbd.mirror'" [7294733] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} tasks/dashboard} ----------------------------------------------------------------- time: 00:30:54 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294733/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294733/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6bdb6d59d9e64ea59c057065d3866a70 Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest) [7294734] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:05:54 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294734/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294734/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8a4dd6d1bed6453da14ef730c93ee54d Command failed on smithi132 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7294741] rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}} ----------------------------------------------------------------- time: 00:09:57 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294741/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294741/ sentry: https://sentry.ceph.com/organizations/ceph/?query=34e7ff0ab86440ef9fd8f8cce3f070b9 Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi182 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2f53aca086f47527e85423521fdf9b2cd18f285 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7294788] rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04}} ----------------------------------------------------------------- time: 00:10:27 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294788/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294788/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1557728c4d164486b40f9977f4a73d37 Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi060 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2f53aca086f47527e85423521fdf9b2cd18f285 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7294789] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:20:37 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294789/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294789/ SELinux denials found on ubuntu@smithi018.front.sepia.ceph.com: ['type=AVC msg=audit(1685737023.713:20181): avc: denied { ioctl } for pid=110443 comm="iptables" path="/var/lib/containers/storage/overlay/edc41985066bba7aa 05641b5602ad9933d4accd59c12b06cea52d63b7e22201d/merged" dev="overlay" ino=3543511 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1685737023.610:20178): avc: denied { ioctl } for pid=110426 comm="iptables" path="/var/lib/containers/storage/o verlay/edc41985066bba7aa05641b5602ad9933d4accd59c12b06cea52d63b7e22201d/mer ged" dev="overlay" ino=3543511 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [7294811] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/e2e} ----------------------------------------------------------------- time: 00:25:44 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294811/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294811/ sentry: https://sentry.ceph.com/organizations/ceph/?query=82b21ce54a7d41998ef902af966fab58 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi071 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2f53aca086f47527e85423521fdf9b2cd18f285 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7294813] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:06:07 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294813/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294813/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1e54a2ac441a4bef9c1bab610894a975 Command failed on smithi050 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" Pass ================================================================= [7294521] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:44:26 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294521/ [7294522] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:25:39 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294522/ [7294523] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:14:37 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294523/ [7294524] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:12:40 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294524/ [7294525] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:38:18 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294525/ [7294527] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:18:52 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294527/ [7294528] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:57 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294528/ [7294529] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:15:23 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294529/ [7294530] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:16 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294530/ [7294531] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:23:34 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294531/ [7294532] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{ubuntu_20.04}} time: 00:08:38 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294532/ [7294533] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:26:53 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294533/ [7294534] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:24:09 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294534/ [7294535] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:17:41 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294535/ [7294536] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:21:34 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294536/ [7294537] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:16 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294537/ [7294538] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache} time: 00:13:46 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294538/ [7294539] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:50 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294539/ [7294540] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} time: 00:17:40 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294540/ [7294541] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:22:21 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294541/ [7294542] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:21:18 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294542/ [7294543] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} time: 01:52:17 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294543/ [7294544] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:13:13 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294544/ [7294545] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:37:11 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294545/ [7294546] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:27 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294546/ [7294547] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/scrub} time: 02:47:12 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294547/ [7294548] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:13:04 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294548/ [7294549] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:21:38 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294549/ [7294550] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} time: 00:13:35 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294550/ [7294551] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:14 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294551/ [7294552] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:43 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294552/ [7294553] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:13:39 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294553/ [7294554] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits} time: 00:32:28 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294554/ [7294555] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs} time: 00:33:34 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294555/ [7294556] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup-io-snaps} time: 00:16:16 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294556/ [7294557] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:16:28 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294557/ [7294558] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:30:41 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294558/ [7294559] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:32:24 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294559/ [7294560] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:25:17 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294560/ [7294561] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:12:38 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294561/ [7294562] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:31:21 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294562/ [7294563] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:32:22 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294563/ [7294564] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} time: 00:19:33 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294564/ [7294565] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:25:25 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294565/ [7294566] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:33:54 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294566/ [7294567] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:03 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294567/ [7294568] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:27:39 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294568/ [7294569] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:34:36 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294569/ [7294570] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:36:18 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294570/ [7294571] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:23 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294571/ [7294572] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:41:53 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294572/ [7294573] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:30:00 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294573/ [7294574] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:10:41 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294574/ [7294576] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/crash} time: 00:14:03 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294576/ [7294577] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_20.04}} time: 00:39:41 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294577/ [7294578] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:17:27 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294578/ [7294580] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:23:50 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294580/ [7294581] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} time: 00:15:35 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294581/ [7294582] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:29:38 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294582/ [7294583] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:22:37 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294583/ [7294584] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:15:25 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294584/ [7294585] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} time: 00:29:13 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294585/ [7294586] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:18:25 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294586/ [7294587] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}} time: 00:12:39 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294587/ [7294588] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:44:36 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294588/ [7294589] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:04 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294589/ [7294590] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:23 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294590/ [7294591] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:01 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294591/ [7294592] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/one workloads/snaps-few-objects} time: 00:34:54 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294592/ [7294594] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04}} time: 00:12:49 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294594/ [7294595] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} time: 00:12:54 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294595/ [7294596] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:10:40 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294596/ [7294597] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench} time: 00:36:48 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294597/ [7294598] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:41 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294598/ [7294599] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:09 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294599/ [7294600] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:30 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294600/ [7294601] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:16:21 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294601/ [7294602] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294602/ [7294603] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:48 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294603/ [7294604] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:28:50 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294604/ [7294605] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_rgw_multisite} time: 00:18:03 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294605/ [7294606] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:23 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294606/ [7294607] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:15:50 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294607/ [7294608] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:45 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294608/ [7294609] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:24:23 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294609/ [7294610] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:16:09 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294610/ [7294611] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:11:07 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294611/ [7294612] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:14:48 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294612/ [7294613] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:45 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294613/ [7294614] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:21:47 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294614/ [7294615] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:36:54 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294615/ [7294616] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:50:07 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294616/ [7294617] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:17:26 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294617/ [7294618] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:33 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294618/ [7294619] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}} time: 00:14:57 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294619/ [7294620] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_set_mon_crush_locations} time: 00:28:20 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294620/ [7294621] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:15:07 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294621/ [7294622] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:16:25 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294622/ [7294623] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:10:48 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294623/ [7294624] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:08 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294624/ [7294625] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:19:44 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294625/ [7294626] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:19:47 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294626/ [7294627] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:32:49 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294627/ [7294628] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:08:55 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294628/ [7294629] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_adoption} time: 00:17:08 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294629/ [7294630] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:23:05 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294630/ [7294631] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:11:03 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294631/ [7294632] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:18:39 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294632/ [7294633] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:15:23 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294633/ [7294634] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:06 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294634/ [7294635] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:24:05 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294635/ [7294636] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294636/ [7294637] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:26:44 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294637/ [7294638] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:32:16 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294638/ [7294639] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}} time: 00:23:48 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294639/ [7294640] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:22:02 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294640/ [7294641] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 01:31:15 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294641/ [7294642] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:11 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294642/ [7294643] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm} time: 00:19:11 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294643/ [7294644] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:37:24 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294644/ [7294645] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:38:11 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294645/ [7294646] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:20:30 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294646/ [7294647] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:06 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294647/ [7294648] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:20:32 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294648/ [7294649] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:27:24 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294649/ [7294650] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:33 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294650/ [7294651] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:20:56 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294651/ [7294652] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:11:01 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294652/ [7294653] rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:11:24 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294653/ [7294654] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:23:01 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294654/ [7294657] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:15:48 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294657/ [7294658] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 02:12:59 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294658/ [7294659] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:21:46 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294659/ [7294660] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/sync workloads/rados_5925} time: 00:11:39 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294660/ [7294662] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:18:34 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294662/ [7294663] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04}} time: 00:15:18 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294663/ [7294664] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} tasks/mon_clock_no_skews} time: 00:08:43 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294664/ [7294666] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:28:43 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294666/ [7294667] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:34:34 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294667/ [7294668] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:17:09 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294668/ [7294669] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:15:39 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294669/ [7294670] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:19:29 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294670/ [7294671] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:20:42 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294671/ [7294672] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:12:40 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294672/ [7294673] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 02:38:15 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294673/ [7294674] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:26 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294674/ [7294675] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:10:59 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294675/ [7294676] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:50 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294676/ [7294677] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:28:38 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294677/ [7294678] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:11:01 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294678/ [7294679] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:52 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294679/ [7294680] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:15:40 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294680/ [7294681] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:19:33 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294681/ [7294682] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:27:31 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294682/ [7294683] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:37:26 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294683/ [7294684] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:36:22 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294684/ [7294685] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:17:51 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294685/ [7294686] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:27:46 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294686/ [7294687] rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04}} time: 00:15:31 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294687/ [7294688] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:35:10 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294688/ [7294689] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:08 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294689/ [7294690] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:25:01 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294690/ [7294691] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_nfs} time: 00:34:10 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294691/ [7294692] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:36:18 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294692/ [7294693] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:32:18 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294693/ [7294694] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:40 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294694/ [7294695] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_20.04} tasks/per_module_finisher_stats} time: 00:10:22 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294695/ [7294696] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:24:52 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294696/ [7294697] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:15:44 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294697/ [7294698] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:24:15 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294698/ [7294699] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:19:41 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294699/ [7294700] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:16:43 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294700/ [7294702] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/misc} time: 01:07:32 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294702/ [7294703] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 00:16:57 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294703/ [7294704] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:14:58 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294704/ [7294705] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:15:03 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294705/ [7294706] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:22:41 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294706/ [7294707] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:55 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294707/ [7294708] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:21:33 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294708/ [7294709] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} time: 00:22:10 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294709/ [7294710] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:29:41 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294710/ [7294711] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli} time: 00:18:25 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294711/ [7294712] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:22:35 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294712/ [7294713] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:36:24 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294713/ [7294714] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:30:19 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294714/ [7294715] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:35:19 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294715/ [7294716] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:02 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294716/ [7294717] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:17:06 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294717/ [7294718] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:12:35 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294718/ [7294719] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:12 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294719/ [7294720] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:17:37 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294720/ [7294721] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:35:44 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294721/ [7294722] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/progress} time: 00:30:38 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294722/ [7294723] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:38:13 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294723/ [7294724] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04}} time: 00:11:09 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294724/ [7294725] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:12:05 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294725/ [7294726] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:37 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294726/ [7294727] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:59:32 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294727/ [7294728] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:27:34 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294728/ [7294729] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:20 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294729/ [7294730] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:10 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294730/ [7294731] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:17:07 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294731/ [7294732] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:34:14 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294732/ [7294735] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:27:01 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294735/ [7294736] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon-stretch} time: 00:23:19 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294736/ [7294737] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:29:20 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294737/ [7294738] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_rgw_multisite} time: 00:22:28 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294738/ [7294739] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:30:59 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294739/ [7294740] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:10:55 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294740/ [7294742] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:33 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294742/ [7294743] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:22:44 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294743/ [7294744] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:02 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294744/ [7294745] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} time: 00:12:48 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294745/ [7294746] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:43:21 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294746/ [7294747] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:22 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294747/ [7294748] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:57:13 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294748/ [7294749] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:23:14 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294749/ [7294750] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:15:12 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294750/ [7294751] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:48 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294751/ [7294752] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:18:28 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294752/ [7294753] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 01:50:01 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294753/ [7294754] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_20.04} tasks/prometheus} time: 00:12:39 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294754/ [7294755] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:42:11 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294755/ [7294756] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:18:22 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294756/ [7294757] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_20.04}} time: 02:25:55 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294757/ [7294758] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:26:26 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294758/ [7294759] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:16:07 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294759/ [7294760] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:27 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294760/ [7294761] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:43 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294761/ [7294762] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:18:37 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294762/ [7294763] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/one workloads/rados_mon_workunits} time: 00:30:05 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294763/ [7294764] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:23:00 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294764/ [7294765] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 01:10:56 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294765/ [7294766] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache} time: 00:18:47 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294766/ [7294767] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:15:35 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294767/ [7294768] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_adoption} time: 00:16:49 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294768/ [7294769] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:08:43 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294769/ [7294770] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:45 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294770/ [7294771] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:23:20 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294771/ [7294772] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:13:51 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294772/ [7294773] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/dedup-io-mixed} time: 00:13:23 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294773/ [7294774] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:01 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294774/ [7294775] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:21:57 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294775/ [7294776] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:52 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294776/ [7294777] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:11:00 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294777/ [7294778] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:35 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294778/ [7294779] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:18:50 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294779/ [7294780] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:57 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294780/ [7294781] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:29 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294781/ [7294782] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/workunits} time: 00:12:30 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294782/ [7294783] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/dedup-io-snaps} time: 00:17:37 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294783/ [7294784] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:21:42 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294784/ [7294785] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:09 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294785/ [7294786] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:21:54 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294786/ [7294787] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:17:11 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294787/ [7294790] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:25:51 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294790/ [7294791] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:28:11 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294791/ [7294792] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:24:54 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294792/ [7294793] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:52 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294793/ [7294794] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:52 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294794/ [7294795] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd-backfill} time: 02:38:17 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294795/ [7294796] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:37:22 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294796/ [7294797] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/sync-many workloads/pool-create-delete} time: 00:17:50 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294797/ [7294798] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:50 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294798/ [7294799] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} time: 00:09:28 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294799/ [7294800] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:10:34 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294800/ [7294801] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:32:02 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294801/ [7294802] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:24:34 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294802/ [7294803] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:44 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294803/ [7294804] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:12:32 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294804/ [7294805] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:15:01 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294805/ [7294806] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos} time: 00:07:17 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294806/ [7294807] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:40 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294807/ [7294808] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:25:44 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294808/ [7294809] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:48 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294809/ [7294810] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:21:17 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294810/ [7294812] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_20.04} tasks/crash} time: 00:11:36 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294812/ [7294814] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:37 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294814/ [7294815] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:26:49 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294815/ [7294816] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:26:50 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294816/ [7294817] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:07 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294817/ [7294818] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:15:29 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294818/ [7294819] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:15:33 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294819/ [7294820] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:02 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294820/ [7294821] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/radosbench} time: 00:47:22 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294821/ [7294822] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:15:01 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294822/ [7294823] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 00:48:13 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294823/ [7294824] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:13:42 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294824/ [7294825] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:35 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294825/ [7294826] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:12:37 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294826/ [7294827] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} time: 02:37:04 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294827/ [7294828] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/libcephsqlite} time: 00:15:39 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294828/ [7294829] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:14:16 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294829/ [7294830] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect} time: 00:15:30 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294830/ [7294831] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2023-06-02_17:42:39-rados-reef-distro-default-smithi/7294831/