2023-03-03T18:48:12.086 INFO:root:teuthology version: 0.0.1.dev51+ga2dfb05 2023-03-03T18:48:12.089 INFO:teuthology.results:subset: '111/120000' 2023-03-03T18:48:12.089 INFO:teuthology.results:seed: '5666' 2023-03-04T02:27:16.699 INFO:root:teuthology version: 0.0.1.dev51+ga2dfb05 2023-03-04T02:27:16.725 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-03-04T05:41:36.132 INFO:teuthology.results:Tests finished! gathering results... 2023-03-04T05:41:59.213 INFO:scrape:Found 305 jobs 2023-03-04T05:42:00.347 WARNING:scrape:Misunderstood line: 2023-03-04T05:42:01.336 INFO:scrape:Found 6 distinct failure reasons 2023-03-04T05:42:01.337 INFO:scrape:Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi150 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=33b4b31b1b99e4ff173679b906b23158701d6c0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' 2023-03-04T05:42:01.338 INFO:scrape:2 jobs: ['7193138', '7193189'] 2023-03-04T05:42:01.338 INFO:scrape:suites intersection: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'rados', 'test_envlibrados_for_rocksdb}'] 2023-03-04T05:42:01.338 INFO:scrape:suites union: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}}', 'test_envlibrados_for_rocksdb}'] 2023-03-04T05:42:01.339 INFO:scrape: 2023-03-04T05:42:01.339 INFO:scrape:Failure: Command failed on smithi191 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2023-03-04T05:42:01.339 INFO:scrape:7 jobs: ['7193160', '7193132', '7193213', '7193142', '7192952', '7192724', '7192868'] 2023-03-04T05:42:01.340 INFO:scrape:suites intersection: [] 2023-03-04T05:42:01.340 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'agent/on', 'ceph', 'cluster/1-node', 'cluster/3-node', 'clusters/{fixed-2', 'k8s/1.21', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/osd-dispatch-delay', 'msgr/async-v2only', 'net/calico', 'net/flannel', 'net/host', 'no_pools', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'rados/multimon/{clusters/21', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'recovery-overrides/{more-async-partial-recovery}', 'rook/1.7.2}', 'rook/master}', 'supported-random-distro$/{rhel_8}', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'tasks/mon_recovery}', 'test_iscsi_pids_limit}}', 'thrashers/careful', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}'] 2023-03-04T05:42:01.340 INFO:scrape: 2023-03-04T05:42:01.340 INFO:scrape:Failure: Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI) 2023-03-04T05:42:01.341 INFO:scrape:1 jobs: ['7192620'] 2023-03-04T05:42:01.341 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_orch_cli}'] 2023-03-04T05:42:01.341 INFO:scrape: 2023-03-04T05:42:01.342 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi117.front.sepia.ceph.com: ['type=AVC msg=audit(1677878322.260:19773): avc: denied { ioctl } for pid=109271 comm="iptables" path="/var/lib/containers/storage/overlay/d48c6d223dd05593a6139a9ac9ca5720c97a5ae6342c1e626c4c2e054d63ce85/merged" dev="overlay" ino=3412125 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2023-03-04T05:42:01.342 INFO:scrape:1 jobs: ['7192742'] 2023-03-04T05:42:01.342 INFO:scrape:suites: ['agent/off', 'mon_election/classic', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_cephadm}'] 2023-03-04T05:42:01.343 INFO:scrape: 2023-03-04T05:42:01.343 INFO:scrape:Valgrind: mon (Leak_StillReachable) 2023-03-04T05:42:01.343 INFO:scrape:1 jobs: ['7193033'] 2023-03-04T05:42:01.343 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'validater/valgrind}'] 2023-03-04T05:42:01.344 INFO:scrape: 2023-03-04T05:42:01.344 INFO:scrape:Failure: Command failed (workunit test mon/test_mon_osdmap_prune.sh) on smithi112 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=33b4b31b1b99e4ff173679b906b23158701d6c0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh' 2023-03-04T05:42:01.344 INFO:scrape:1 jobs: ['7193126'] 2023-03-04T05:42:01.345 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/mon-delay', 'msgr/async-v1only', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{centos_8}', 'thrashers/many', 'workloads/rados_mon_osdmap_prune}'] 2023-03-04T05:42:01.345 INFO:scrape: 2023-03-04T05:42:01.358 INFO:teuthology.results:Sending results to yweinstein@radhat.com: Test Run: yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/ failed: 13 dead: 0 running: 0 waiting: 0 queued: 0 passed: 292 Fail ================================================================= [7192620] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:17:18 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192620/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192620/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6d3fab7b0bbd4633b21980172bb8db95 Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI) [7192724] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:06:05 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192724/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192724/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7f18dfa33b284270993045efcad9c706 Command failed on smithi111 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7192742] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:19:14 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192742/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192742/ SELinux denials found on ubuntu@smithi117.front.sepia.ceph.com: ['type=AVC msg=audit(1677878322.260:19773): avc: denied { ioctl } for pid=109271 comm="iptables" path="/var/lib/containers/storage/overlay/d48c6d223dd05593a 6139a9ac9ca5720c97a5ae6342c1e626c4c2e054d63ce85/merged" dev="overlay" ino=3412125 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [7192868] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_recovery} ----------------------------------------------------------------- time: 00:08:19 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192868/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192868/ sentry: https://sentry.ceph.com/organizations/ceph/?query=92c6d75b8d794b33aba647134b0d04af Command failed on smithi027 with status 1: 'sudo yum -y install ceph- radosgw' [7192952] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:06:12 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192952/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192952/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4a5ee7fba6f24b1cac01b49dbe989012 Command failed on smithi037 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7193033] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:32:03 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193033/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193033/ saw valgrind issues [7193126] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:56:40 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193126/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193126/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a81dedebdb1747188bcf296e3eb61421 Command failed (workunit test mon/test_mon_osdmap_prune.sh) on smithi112 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=33b4b31b1b99e4ff173679b906b23158701d6c0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh' [7193132] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:06:04 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193132/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193132/ sentry: https://sentry.ceph.com/organizations/ceph/?query=01286682e9bb42a492be4c3e81adc1af Command failed on smithi093 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7193138] rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:13:25 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193138/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193138/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d49dd50054214adaad35a80eac770ae2 Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi150 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=33b4b31b1b99e4ff173679b906b23158701d6c0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7193142] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:39:13 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193142/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193142/ Command failed on smithi061 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' [7193160] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} ----------------------------------------------------------------- time: 00:07:23 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193160/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193160/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a946fe1e2fcb437b8478c50cb422a1da Command failed on smithi191 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7193189] rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:09:47 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193189/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193189/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d69c9206fd4042b0a029fddd6391b303 Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi159 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=33b4b31b1b99e4ff173679b906b23158701d6c0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7193213] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:06:12 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193213/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193213/ sentry: https://sentry.ceph.com/organizations/ceph/?query=75035dccda6b4cb2a769bd1207911c0e Command failed on smithi039 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' Pass ================================================================= [7192569] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:27:40 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192569/ [7192572] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_nfs} time: 00:31:59 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192572/ [7192575] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:27 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192575/ [7192578] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:10:17 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192578/ [7192581] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:26:00 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192581/ [7192584] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:15 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192584/ [7192587] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} time: 02:53:57 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192587/ [7192589] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:28:28 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192589/ [7192592] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:11:34 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192592/ [7192595] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:15:13 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192595/ [7192598] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:19 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192598/ [7192600] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:24:24 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192600/ [7192602] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:13:01 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192602/ [7192604] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:15:33 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192604/ [7192606] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:17:53 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192606/ [7192608] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:13:48 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192608/ [7192610] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:46:17 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192610/ [7192611] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:27:52 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192611/ [7192612] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:13:45 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192612/ [7192613] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:31 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192613/ [7192614] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:36:39 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192614/ [7192615] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:17:24 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192615/ [7192616] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:21 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192616/ [7192617] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:21 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192617/ [7192618] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:09:56 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192618/ [7192619] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:24:33 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192619/ [7192621] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{rhel_8}} time: 00:11:51 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192621/ [7192622] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:21:45 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192622/ [7192623] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:23:26 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192623/ [7192624] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:53:22 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192624/ [7192625] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:07 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192625/ [7192626] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:17:52 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192626/ [7192627] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache} time: 00:11:01 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192627/ [7192628] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:35 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192628/ [7192629] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} time: 00:16:57 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192629/ [7192630] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:23:21 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192630/ [7192631] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 02:43:34 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192631/ [7192632] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} time: 02:05:27 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192632/ [7192633] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{rhel_8} tasks/workunits} time: 00:14:14 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192633/ [7192634] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:10:43 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192634/ [7192635] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli_mon} time: 00:26:32 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192635/ [7192636] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:59:48 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192636/ [7192637] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:16 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192637/ [7192639] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} time: 00:12:06 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192639/ [7192641] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:37 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192641/ [7192643] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:13 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192643/ [7192645] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:17 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192645/ [7192648] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:12:05 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192648/ [7192651] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} time: 00:33:52 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192651/ [7192654] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/dedup-io-snaps} time: 00:16:35 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192654/ [7192657] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} time: 00:14:15 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192657/ [7192660] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:08:32 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192660/ [7192663] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:30:45 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192663/ [7192666] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 01:00:59 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192666/ [7192669] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:24:03 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192669/ [7192672] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:51 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192672/ [7192676] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:27:47 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192676/ [7192679] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:31:23 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192679/ [7192682] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:23:09 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192682/ [7192685] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:32:50 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192685/ [7192688] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:31 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192688/ [7192691] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:26:16 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192691/ [7192694] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:32:49 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192694/ [7192697] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:37 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192697/ [7192700] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:45 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192700/ [7192703] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:55 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192703/ [7192706] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:28:42 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192706/ [7192709] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:08:38 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192709/ [7192712] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} tasks/dashboard} time: 01:08:35 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192712/ [7192715] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/crash} time: 00:14:07 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192715/ [7192718] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:40:02 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192718/ [7192721] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:16:40 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192721/ [7192727] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:18:51 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192727/ [7192730] rados/standalone/{supported-random-distro$/{rhel_8} workloads/c2c} time: 00:16:27 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192730/ [7192733] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:28:26 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192733/ [7192736] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:22:16 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192736/ [7192739] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:15:47 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192739/ [7192745] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:07 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192745/ [7192748] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:16:38 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192748/ [7192751] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:38:02 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192751/ [7192754] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:17 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192754/ [7192757] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:03 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192757/ [7192760] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:09:03 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192760/ [7192763] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} time: 00:35:31 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192763/ [7192766] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:20:33 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192766/ [7192769] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:15:20 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192769/ [7192772] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:14:02 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192772/ [7192775] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:11:25 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192775/ [7192778] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench} time: 00:25:41 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192778/ [7192781] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:25:56 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192781/ [7192784] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:39 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192784/ [7192787] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:03 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192787/ [7192790] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:14:57 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192790/ [7192793] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:16:40 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192793/ [7192796] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:31 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192796/ [7192799] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:33:48 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192799/ [7192802] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:06:37 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192802/ [7192805] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:34 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192805/ [7192808] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:14:31 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192808/ [7192811] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:54 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192811/ [7192814] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:07 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192814/ [7192817] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:13:31 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192817/ [7192820] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:54 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192820/ [7192823] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:20:33 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192823/ [7192826] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:16:09 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192826/ [7192829] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:33:17 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192829/ [7192832] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:48:33 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192832/ [7192835] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:16 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192835/ [7192838] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:15:57 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192838/ [7192841] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:40 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192841/ [7192844] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:17:39 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192844/ [7192847] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:16:52 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192847/ [7192850] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:53 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192850/ [7192853] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:14:17 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192853/ [7192856] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:12:20 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192856/ [7192859] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:14:45 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192859/ [7192862] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:15:44 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192862/ [7192865] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:12 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192865/ [7192871] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:12:44 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192871/ [7192874] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:15:46 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192874/ [7192877] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:09:06 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192877/ [7192880] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:19:14 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192880/ [7192883] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:18:45 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192883/ [7192886] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:18:18 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192886/ [7192889] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:12:49 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192889/ [7192892] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:29:59 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192892/ [7192895] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:12 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192895/ [7192898] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 01:00:04 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192898/ [7192901] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:24:22 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192901/ [7192904] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} time: 00:30:32 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192904/ [7192907] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:52 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192907/ [7192910] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:38 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192910/ [7192913] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:13:16 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192913/ [7192916] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:35:21 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192916/ [7192920] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:18:05 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192920/ [7192923] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:05 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192923/ [7192926] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:02 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192926/ [7192928] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 01:27:16 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192928/ [7192931] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:21:22 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192931/ [7192934] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:22:36 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192934/ [7192937] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:20 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192937/ [7192940] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:09:11 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192940/ [7192943] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:41 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192943/ [7192946] rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:09:03 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192946/ [7192949] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/e2e} time: 00:25:10 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192949/ [7192955] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:26 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192955/ [7192958] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 01:52:27 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192958/ [7192961] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:23:52 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192961/ [7192964] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_5925} time: 00:15:06 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192964/ [7192967] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} time: 00:19:03 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192967/ [7192970] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:11:11 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192970/ [7192973] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:17:51 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192973/ [7192976] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:08:23 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192976/ [7192979] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:14:44 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192979/ [7192982] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:34:55 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192982/ [7192985] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:16:01 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192985/ [7192988] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:16:53 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192988/ [7192991] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:14:32 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192991/ [7192994] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:47 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192994/ [7192997] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 01:24:33 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7192997/ [7193000] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:22 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193000/ [7193003] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:09:06 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193003/ [7193006] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:46 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193006/ [7193009] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:30:07 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193009/ [7193012] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:08:45 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193012/ [7193015] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:26:45 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193015/ [7193018] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:28 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193018/ [7193021] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:28:12 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193021/ [7193024] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:42 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193024/ [7193027] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:17:52 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193027/ [7193030] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:23:17 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193030/ [7193036] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:35:51 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193036/ [7193039] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:33 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193039/ [7193042] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:27:06 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193042/ [7193045] rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:17:48 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193045/ [7193048] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:31:42 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193048/ [7193051] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:33 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193051/ [7193054] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:31:54 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193054/ [7193057] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:28:50 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193057/ [7193059] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:26:49 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193059/ [7193061] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:18:59 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193061/ [7193063] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} time: 00:10:13 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193063/ [7193065] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:24:02 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193065/ [7193067] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:09:03 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193067/ [7193069] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:21:43 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193069/ [7193071] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:13 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193071/ [7193073] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:17:51 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193073/ [7193075] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:25:47 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193075/ [7193077] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 00:14:55 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193077/ [7193079] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:00 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193079/ [7193081] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:03 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193081/ [7193083] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:21:18 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193083/ [7193085] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:22 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193085/ [7193087] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 01:10:42 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193087/ [7193089] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:22:52 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193089/ [7193091] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/progress} time: 00:27:38 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193091/ [7193093] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:28:09 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193093/ [7193095] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:28:20 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193095/ [7193097] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:37 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193097/ [7193099] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm} time: 00:18:11 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193099/ [7193101] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:38:56 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193101/ [7193103] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} time: 01:10:29 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193103/ [7193105] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:28:34 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193105/ [7193107] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:12:57 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193107/ [7193109] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:42 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193109/ [7193111] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:03 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193111/ [7193113] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:24 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193113/ [7193115] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:13:03 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193115/ [7193117] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:32:42 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193117/ [7193119] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:14:41 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193119/ [7193121] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:36 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193121/ [7193123] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:25:42 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193123/ [7193125] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:06 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193125/ [7193127] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:28:08 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193127/ [7193128] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:08:57 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193128/ [7193129] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:15:16 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193129/ [7193130] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:28:37 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193130/ [7193131] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/dashboard} time: 01:09:00 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193131/ [7193133] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:20:53 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193133/ [7193134] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:24:33 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193134/ [7193135] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos} time: 00:09:51 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193135/ [7193136] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:33:13 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193136/ [7193137] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:09:13 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193137/ [7193139] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193139/ [7193140] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:19 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193140/ [7193141] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:25:07 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193141/ [7193143] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:16:28 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193143/ [7193144] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:38:45 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193144/ [7193145] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:57 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193145/ [7193146] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:57:18 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193146/ [7193147] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:15:59 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193147/ [7193148] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:25:39 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193148/ [7193149] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:32 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193149/ [7193150] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:15:46 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193150/ [7193151] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 01:21:09 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193151/ [7193152] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:10:16 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193152/ [7193153] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:18:18 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193153/ [7193154] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:32:19 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193154/ [7193155] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} time: 02:21:47 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193155/ [7193156] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:18:58 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193156/ [7193157] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:13:46 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193157/ [7193158] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:22 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193158/ [7193159] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:55 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193159/ [7193161] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits} time: 00:30:35 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193161/ [7193162] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:23:32 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193162/ [7193163] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} time: 00:13:12 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193163/ [7193164] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:13:18 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193164/ [7193166] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs} time: 00:32:01 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193166/ [7193168] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:10 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193168/ [7193170] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:24:23 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193170/ [7193171] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:21:49 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193171/ [7193172] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:14:50 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193172/ [7193173] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed} time: 00:16:22 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193173/ [7193174] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:59 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193174/ [7193175] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:25:33 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193175/ [7193176] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:14:16 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193176/ [7193177] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/workunits} time: 00:12:44 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193177/ [7193178] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:08:50 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193178/ [7193179] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:19:16 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193179/ [7193180] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:35 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193180/ [7193181] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:38 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193181/ [7193182] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:35 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193182/ [7193183] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-snaps} time: 00:18:29 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193183/ [7193184] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:01 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193184/ [7193185] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:11 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193185/ [7193186] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd-backfill} time: 03:29:43 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193186/ [7193187] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:22:08 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193187/ [7193188] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:15:46 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193188/ [7193190] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} time: 00:18:43 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193190/ [7193191] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:20:25 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193191/ [7193192] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:32:38 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193192/ [7193193] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:12:27 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193193/ [7193194] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:14:04 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193194/ [7193195] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:24:51 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193195/ [7193196] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:37:51 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193196/ [7193197] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:16:57 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193197/ [7193198] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_8}} time: 00:10:10 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193198/ [7193199] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:58 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193199/ [7193200] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:12:35 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193200/ [7193201] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:30:52 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193201/ [7193202] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:29:31 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193202/ [7193203] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:53 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193203/ [7193204] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:35 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193204/ [7193205] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:14:02 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193205/ [7193206] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} time: 00:26:07 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193206/ [7193207] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:13:01 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193207/ [7193208] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:26:42 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193208/ [7193209] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:20 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193209/ [7193210] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:21:11 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193210/ [7193211] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/e2e} time: 00:25:10 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193211/ [7193212] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:11:02 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193212/ [7193214] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:11 info: http://pulpito.ceph.com/yuriw-2023-03-03_17:39:09-rados-reef-distro-default-smithi/7193214/