2023-06-15T10:55:54.841 INFO:root:teuthology version: 0.0.1.dev124+g961f4fb 2023-06-15T10:55:54.842 INFO:teuthology.results:subset: '1/150000' 2023-06-15T10:55:54.843 INFO:teuthology.results:seed: '8294' 2023-06-15T12:45:02.554 INFO:root:teuthology version: 0.0.1.dev124+g961f4fb 2023-06-15T12:45:02.584 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-06-16T00:28:00.614 INFO:teuthology.results:Tests finished! gathering results... 2023-06-16T00:28:04.544 INFO:scrape:Found 50 jobs 2023-06-16T00:28:05.260 INFO:scrape:Found 4 distinct failure reasons 2023-06-16T00:28:05.261 INFO:scrape:Failure: Command failed on smithi005 with status 1: 'sudo yum -y install cephfs-java' 2023-06-16T00:28:05.262 INFO:scrape:3 jobs: ['7303947', '7303949', '7303948'] 2023-06-16T00:28:05.262 INFO:scrape:suites intersection: [] 2023-06-16T00:28:05.262 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async-v1only', 'no_pools', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/dashboard/{0-single-container-host', 'rados/multimon/{clusters/21', 'rados/verify/{centos_latest', 'random-objectstore$/{bluestore-comp-lz4}', 'supported-random-distro$/{rhel_8}', 'tasks/dashboard}', 'tasks/mon_clock_no_skews}', 'tasks/mon_recovery', 'validater/valgrind}'] 2023-06-16T00:28:05.262 INFO:scrape: 2023-06-16T00:28:05.263 INFO:scrape:Dead: b'2023-06-16T00:23:54.019 DEBUG:teuthology.exit:Finished running handlers' 2023-06-16T00:28:05.263 INFO:scrape:1 jobs: ['7303953'] 2023-06-16T00:28:05.263 INFO:scrape:suites: ['mon_election/classic', 'rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'supported-random-distro$/{rhel_8}}'] 2023-06-16T00:28:05.264 INFO:scrape: 2023-06-16T00:28:05.264 INFO:scrape:Failure: Command failed on smithi083 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" 2023-06-16T00:28:05.264 INFO:scrape:1 jobs: ['7303952'] 2023-06-16T00:28:05.265 INFO:scrape:suites: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', 'cluster/1-node', 'k8s/1.21', 'net/flannel', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}'] 2023-06-16T00:28:05.265 INFO:scrape: 2023-06-16T00:28:05.265 INFO:scrape:Failure: "1686833760.6342864 mon.a (mon.0) 559 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log 2023-06-16T00:28:05.265 INFO:scrape:1 jobs: ['7303969'] 2023-06-16T00:28:05.266 INFO:scrape:suites: ['clusters/{fixed-2', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rados_cls_all}'] 2023-06-16T00:28:05.266 INFO:scrape: 2023-06-16T00:28:05.268 INFO:teuthology.results:Sending results to chunmei.liu@intel.com: Test Run: yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/ failed: 5 dead: 1 running: 0 waiting: 0 queued: 0 passed: 44 Fail ================================================================= [7303947] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:15:03 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303947/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303947/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6e155f9b4191480aa05d54fb2bdc532c Command failed on smithi005 with status 1: 'sudo yum -y install cephfs- java' [7303948] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:13:27 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303948/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303948/ sentry: https://sentry.ceph.com/organizations/ceph/?query=76678a917d874179bcd8d9955d4012f5 Command failed on smithi131 with status 1: 'sudo yum -y install cephfs- java' [7303949] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} tasks/dashboard} ----------------------------------------------------------------- time: 00:09:18 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303949/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303949/ sentry: https://sentry.ceph.com/organizations/ceph/?query=49711618bf1a4152a515a5df0b0f6607 Command failed on smithi151 with status 1: 'sudo yum -y install cephfs- java' [7303952] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/1-node k8s/1.21 net/flannel rook/1.7.2} ----------------------------------------------------------------- time: 00:05:55 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303952/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303952/ sentry: https://sentry.ceph.com/organizations/ceph/?query=88deec20b38c45af9631e87afef52676 Command failed on smithi083 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7303969] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:22:04 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303969/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303969/ "1686833760.6342864 mon.a (mon.0) 559 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log Dead ================================================================= [7303953] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303953/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303953/ hit max job timeout Pass ================================================================= [7303936] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:27:03 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303936/ [7303937] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:45 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303937/ [7303938] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:15 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303938/ [7303939] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:46 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303939/ [7303940] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:53 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303940/ [7303941] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:26:17 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303941/ [7303942] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:29:13 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303942/ [7303943] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:27:22 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303943/ [7303944] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}} time: 00:19:13 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303944/ [7303945] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:53:43 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303945/ [7303946] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:26:08 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303946/ [7303950] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:43:19 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303950/ [7303951] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:23:33 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303951/ [7303954] rados/standalone/{supported-random-distro$/{centos_8} workloads/c2c} time: 00:17:30 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303954/ [7303955] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:24:28 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303955/ [7303956] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:30:46 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303956/ [7303957] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:17:38 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303957/ [7303958] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:24:58 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303958/ [7303959] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:12:49 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303959/ [7303960] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos} time: 00:08:51 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303960/ [7303961] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:13:52 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303961/ [7303962] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_20.04} tasks/module_selftest} time: 00:27:19 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303962/ [7303963] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:12:35 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303963/ [7303964] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:16:33 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303964/ [7303965] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:16 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303965/ [7303966] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:29:56 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303966/ [7303967] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:59 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303967/ [7303968] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:32 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303968/ [7303970] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:17:34 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303970/ [7303971] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:17:34 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303971/ [7303972] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:17:36 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303972/ [7303973] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:23:03 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303973/ [7303974] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:22 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303974/ [7303975] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:20:35 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303975/ [7303976] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:47 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303976/ [7303977] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} time: 00:28:10 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303977/ [7303978] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:25:02 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303978/ [7303979] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:55 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303979/ [7303980] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:12:45 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303980/ [7303981] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:32:55 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303981/ [7303982] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:27:36 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303982/ [7303983] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} tasks/mon_clock_with_skews} time: 00:08:43 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303983/ [7303984] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/lockdep} time: 00:28:19 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303984/ [7303985] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:24 info: http://pulpito.ceph.com/yingxin-2023-06-14_08:38:48-rados-wip-chunmei-ceph-pr-distro-default-smithi/7303985/