2022-09-12T00:59:30.162 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-12T00:59:30.164 INFO:teuthology.results:subset: '111/120000' 2022-09-12T00:59:30.164 INFO:teuthology.results:seed: '5347' 2022-09-12T05:43:53.810 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-12T05:43:53.837 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-09-12T09:09:12.902 INFO:teuthology.results:Tests finished! gathering results... 2022-09-12T09:09:38.484 INFO:scrape:Found 320 jobs 2022-09-12T09:09:40.065 INFO:scrape:Found 8 distinct failure reasons 2022-09-12T09:09:40.066 INFO:scrape:Failure: Command failed on smithi062 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' 2022-09-12T09:09:40.067 INFO:scrape:3 jobs: ['7026614', '7026696', '7026456'] 2022-09-12T09:09:40.067 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', 'k8s/1.21', 'rados/rook/smoke/{0-distro/ubuntu_20.04'] 2022-09-12T09:09:40.068 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/host', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}'] 2022-09-12T09:09:40.068 INFO:scrape: 2022-09-12T09:09:40.068 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi017 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=10f7d25d6a0f340676cd251eab5a787ba01ace95 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2022-09-12T09:09:40.069 INFO:scrape:2 jobs: ['7026694', '7026535'] 2022-09-12T09:09:40.069 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}'] 2022-09-12T09:09:40.070 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-bitmap}', 'random-objectstore$/{bluestore-hybrid}', 'tasks/e2e}'] 2022-09-12T09:09:40.070 INFO:scrape: 2022-09-12T09:09:40.071 INFO:scrape:Failure: Command failed on smithi050 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'egrep \'"\'"\'(defer backfill|defer recovery)\'"\'"\' /var/log/ceph/ceph-osd.*.log\'' 2022-09-12T09:09:40.071 INFO:scrape:1 jobs: ['7026487'] 2022-09-12T09:09:40.071 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/many', 'msgr/async-v1only', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/singleton/{all/recovery-preemption', 'supported-random-distro$/{centos_8}}'] 2022-09-12T09:09:40.072 INFO:scrape: 2022-09-12T09:09:40.072 INFO:scrape:Failure: Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI) 2022-09-12T09:09:40.073 INFO:scrape:1 jobs: ['7026671'] 2022-09-12T09:09:40.073 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_orch_cli}'] 2022-09-12T09:09:40.074 INFO:scrape: 2022-09-12T09:09:40.074 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi164.front.sepia.ceph.com: ['type=AVC msg=audit(1662955090.947:7293): avc: denied { ioctl } for pid=58776 comm="iptables" path="/var/lib/containers/storage/overlay/86a7639e5d25b2d4f50d0c215465adaca23695d63761039ae70081ebc47a60f0/merged" dev="overlay" ino=3281439 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2022-09-12T09:09:40.074 INFO:scrape:1 jobs: ['7026594'] 2022-09-12T09:09:40.075 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-09-12T09:09:40.075 INFO:scrape: 2022-09-12T09:09:40.076 INFO:scrape:Failure: Command failed (workunit test rados/test_librados_build.sh) on smithi179 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=10f7d25d6a0f340676cd251eab5a787ba01ace95 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_librados_build.sh' 2022-09-12T09:09:40.076 INFO:scrape:1 jobs: ['7026552'] 2022-09-12T09:09:40.077 INFO:scrape:suites: ['mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/librados_hello_world', 'supported-random-distro$/{ubuntu_latest}}'] 2022-09-12T09:09:40.077 INFO:scrape: 2022-09-12T09:09:40.077 INFO:scrape:Failure: 'check osd count' reached maximum tries (90) after waiting for 900 seconds 2022-09-12T09:09:40.078 INFO:scrape:1 jobs: ['7026536'] 2022-09-12T09:09:40.078 INFO:scrape:suites: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', 'cluster/3-node', 'k8s/1.21', 'net/flannel', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2022-09-12T09:09:40.079 INFO:scrape: 2022-09-12T09:09:40.079 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi160 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=10f7d25d6a0f340676cd251eab5a787ba01ace95 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2022-09-12T09:09:40.080 INFO:scrape:1 jobs: ['7026682'] 2022-09-12T09:09:40.080 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}'] 2022-09-12T09:09:40.081 INFO:scrape: 2022-09-12T09:09:40.090 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/ failed: 11 dead: 0 running: 0 waiting: 0 queued: 0 passed: 309 Fail ================================================================= [7026456] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:03:59 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026456/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026456/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6080e774e52c4b8db2bc3a9c31f9a2d1 Command failed on smithi152 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' [7026487] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:59:44 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026487/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026487/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0425ef11a4a349b6a719c0ea1a83e9a2 Command failed on smithi050 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'egrep \'"\'"\'(defer backfill|defer recovery)\'"\'"\' /var/log/ceph/ceph-osd.*.log\'' [7026535] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/e2e} ----------------------------------------------------------------- time: 00:19:20 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026535/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026535/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5a4e0ab4279e4ff789b8d31651cb4e15 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi066 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=10f7d25d6a0f340676cd251eab5a787ba01ace95 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7026536] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:24:45 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026536/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026536/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7d9650aaaac74d48ac14e235d39653b9 'check osd count' reached maximum tries (90) after waiting for 900 seconds [7026552] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:08:49 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026552/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026552/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7971fc749bd14fe29f3ab6cdc94973f6 Command failed (workunit test rados/test_librados_build.sh) on smithi179 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=10f7d25d6a0f340676cd251eab5a787ba01ace95 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_librados_build.sh' [7026594] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:13:41 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026594/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026594/ SELinux denials found on ubuntu@smithi164.front.sepia.ceph.com: ['type=AVC msg=audit(1662955090.947:7293): avc: denied { ioctl } for pid=58776 comm="iptables" path="/var/lib/containers/storage/overlay/86a7639e5d25b2d4f 50d0c215465adaca23695d63761039ae70081ebc47a60f0/merged" dev="overlay" ino=3281439 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [7026614] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:04:04 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026614/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026614/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd67006d37d44b4ea4e13e29330e3034 Command failed on smithi062 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' [7026671] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:15:22 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026671/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026671/ sentry: https://sentry.ceph.com/organizations/ceph/?query=80f5dc8493d24aac9209cead395ba52e Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI) [7026682] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 01:15:15 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026682/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026682/ sentry: https://sentry.ceph.com/organizations/ceph/?query=28734f22d8cf403e803e65b1308224e6 Command failed (workunit test rados/test.sh) on smithi160 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=10f7d25d6a0f340676cd251eab5a787ba01ace95 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [7026694] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/e2e} ----------------------------------------------------------------- time: 00:19:06 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026694/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026694/ sentry: https://sentry.ceph.com/organizations/ceph/?query=80f925f77ef74ff6b311eccb147225d8 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi017 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=10f7d25d6a0f340676cd251eab5a787ba01ace95 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7026696] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:04:39 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026696/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026696/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f2e334258af54434b77317cfd37e5954 Command failed on smithi087 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' Pass ================================================================= [7026419] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:07:02 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026419/ [7026420] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:12 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026420/ [7026421] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:18:42 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026421/ [7026422] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli_mon} time: 00:22:46 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026422/ [7026423] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:28:02 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026423/ [7026424] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{centos_8}} time: 00:29:53 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026424/ [7026425] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:41:12 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026425/ [7026426] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:30:16 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026426/ [7026427] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:28:31 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026427/ [7026428] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:22:48 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026428/ [7026429] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:15 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026429/ [7026430] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:39 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026430/ [7026431] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:07:50 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026431/ [7026432] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:10 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026432/ [7026433] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:00:00 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026433/ [7026434] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:47 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026434/ [7026435] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026435/ [7026436] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:34:15 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026436/ [7026437] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:01 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026437/ [7026438] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:30:39 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026438/ [7026439] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:10:22 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026439/ [7026440] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:22:20 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026440/ [7026441] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:07:45 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026441/ [7026442] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:18:24 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026442/ [7026443] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:12:48 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026443/ [7026444] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:19 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026444/ [7026445] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:04 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026445/ [7026446] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:30:26 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026446/ [7026447] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:18:11 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026447/ [7026448] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:43 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026448/ [7026449] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:14:26 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026449/ [7026450] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:22:21 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026450/ [7026451] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:07:19 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026451/ [7026452] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} tasks/dashboard} time: 01:10:11 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026452/ [7026453] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:09:05 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026453/ [7026454] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:13:24 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026454/ [7026455] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:09:58 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026455/ [7026457] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:17:02 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026457/ [7026458] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} time: 00:10:31 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026458/ [7026459] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:17:21 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026459/ [7026460] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:18:35 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026460/ [7026461] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} time: 00:19:20 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026461/ [7026462] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:25:25 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026462/ [7026463] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:31:59 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026463/ [7026464] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:22:49 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026464/ [7026465] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:25 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026465/ [7026466] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:26:51 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026466/ [7026467] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:45 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026467/ [7026468] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:03 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026468/ [7026469] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:02 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026469/ [7026470] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:06:03 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026470/ [7026471] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:12:24 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026471/ [7026472] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:18:13 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026472/ [7026473] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:16:07 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026473/ [7026474] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:23:02 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026474/ [7026475] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:26:47 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026475/ [7026476] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:49 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026476/ [7026477] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:18:30 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026477/ [7026478] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:12:48 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026478/ [7026479] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:11:22 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026479/ [7026480] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:07 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026480/ [7026481] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026481/ [7026482] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:01 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026482/ [7026483] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:17:28 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026483/ [7026484] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:10:38 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026484/ [7026485] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:03:41 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026485/ [7026486] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:06:54 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026486/ [7026488] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:06:06 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026488/ [7026489] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:11:15 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026489/ [7026490] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} time: 00:33:29 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026490/ [7026491] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:06:41 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026491/ [7026492] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} time: 00:23:56 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026492/ [7026493] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects} time: 00:25:19 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026493/ [7026494] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:36:55 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026494/ [7026495] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:48:50 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026495/ [7026496] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:57 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026496/ [7026497] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:57 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026497/ [7026498] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:26 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026498/ [7026499] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:34 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026499/ [7026500] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:11:50 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026500/ [7026501] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:29:39 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026501/ [7026502] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:10 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026502/ [7026503] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:18:47 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026503/ [7026504] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:07:33 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026504/ [7026505] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:33:31 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026505/ [7026506] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:33 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026506/ [7026507] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:28:21 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026507/ [7026508] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:12:15 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026508/ [7026509] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:06:13 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026509/ [7026510] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:44 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026510/ [7026511] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:07:44 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026511/ [7026512] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:28 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026512/ [7026513] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} time: 00:12:51 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026513/ [7026514] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:24:43 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026514/ [7026515] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:06:48 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026515/ [7026516] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:12:55 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026516/ [7026517] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:19:13 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026517/ [7026518] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} time: 00:24:41 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026518/ [7026519] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:19:57 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026519/ [7026520] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:15:34 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026520/ [7026521] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} time: 00:33:33 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026521/ [7026522] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:17:43 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026522/ [7026523] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{rhel_8} tasks/insights} time: 00:18:12 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026523/ [7026524] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:36 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026524/ [7026525] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:07:05 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026525/ [7026526] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:29:50 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026526/ [7026527] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:04 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026527/ [7026528] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:38 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026528/ [7026529] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} time: 01:27:06 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026529/ [7026530] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 01:20:15 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026530/ [7026531] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:17 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026531/ [7026532] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:44:34 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026532/ [7026533] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:06:02 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026533/ [7026534] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:18:35 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026534/ [7026537] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:22 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026537/ [7026538] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 01:41:59 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026538/ [7026539] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:30:18 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026539/ [7026540] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} time: 01:15:43 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026540/ [7026541] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} time: 00:18:09 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026541/ [7026542] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:23:16 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026542/ [7026543] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:40 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026543/ [7026544] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:18:27 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026544/ [7026545] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:19:09 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026545/ [7026546] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:12 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026546/ [7026547] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:11:04 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026547/ [7026548] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:19:22 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026548/ [7026549] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:17:46 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026549/ [7026550] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:27:40 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026550/ [7026551] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:18:59 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026551/ [7026553] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:43 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026553/ [7026554] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:26:17 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026554/ [7026555] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:06:16 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026555/ [7026556] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:12:28 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026556/ [7026557] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:09 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026557/ [7026558] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:30:17 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026558/ [7026559] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:27:19 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026559/ [7026560] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:07:50 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026560/ [7026561] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:28:28 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026561/ [7026562] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:33:04 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026562/ [7026563] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:30 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026563/ [7026564] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:12:15 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026564/ [7026565] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:17:17 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026565/ [7026566] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:30:12 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026566/ [7026567] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:19:24 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026567/ [7026568] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:20:50 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026568/ [7026569] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:24:37 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026569/ [7026570] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:12:29 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026570/ [7026571] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:32:37 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026571/ [7026572] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:30:04 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026572/ [7026573] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:18:34 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026573/ [7026574] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:33 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026574/ [7026575] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} time: 00:18:18 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026575/ [7026576] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} time: 00:07:08 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026576/ [7026577] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:21:07 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026577/ [7026578] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:20:16 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026578/ [7026579] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:54 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026579/ [7026580] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:58 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026580/ [7026581] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:03 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026581/ [7026582] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:19:45 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026582/ [7026583] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:19:05 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026583/ [7026584] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:07:37 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026584/ [7026585] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:23:22 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026585/ [7026586] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:52 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026586/ [7026587] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} time: 00:08:06 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026587/ [7026588] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026588/ [7026589] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:19 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026589/ [7026590] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache} time: 00:13:48 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026590/ [7026591] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:21:33 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026591/ [7026592] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:16:01 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026592/ [7026593] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026593/ [7026595] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:32:38 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026595/ [7026596] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 00:59:08 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026596/ [7026597] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} time: 00:10:50 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026597/ [7026598] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:29:06 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026598/ [7026599] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:07:32 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026599/ [7026600] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:18:38 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026600/ [7026601] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:11:54 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026601/ [7026602] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:08:32 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026602/ [7026603] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:11:54 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026603/ [7026604] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:36:26 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026604/ [7026605] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:18 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026605/ [7026606] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} time: 00:11:53 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026606/ [7026607] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:03 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026607/ [7026608] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:27:23 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026608/ [7026609] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:34 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026609/ [7026610] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:09:28 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026610/ [7026611] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:06:45 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026611/ [7026612] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:27:12 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026612/ [7026613] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/dashboard} time: 01:10:09 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026613/ [7026615] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:16:43 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026615/ [7026616] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:23:34 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026616/ [7026617] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos} time: 00:04:43 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026617/ [7026618] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:17:59 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026618/ [7026619] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:17:43 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026619/ [7026620] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:00 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026620/ [7026621] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:30:28 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026621/ [7026622] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:06:06 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026622/ [7026623] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:37:34 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026623/ [7026624] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:15:03 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026624/ [7026625] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:15:05 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026625/ [7026626] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:56 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026626/ [7026627] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:47 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026627/ [7026628] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:59:46 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026628/ [7026629] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:16:38 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026629/ [7026630] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:44:54 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026630/ [7026631] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:12:21 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026631/ [7026632] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:16:50 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026632/ [7026633] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:37:55 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026633/ [7026634] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:21:26 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026634/ [7026635] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:33 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026635/ [7026636] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 01:09:29 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026636/ [7026637] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:06:37 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026637/ [7026638] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:31 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026638/ [7026639] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:38 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026639/ [7026640] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 01:45:42 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026640/ [7026641] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:55:54 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026641/ [7026642] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:12:46 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026642/ [7026643] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:07:55 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026643/ [7026644] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:14:08 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026644/ [7026645] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026645/ [7026646] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:19:39 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026646/ [7026647] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect} time: 00:10:48 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026647/ [7026648] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:46 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026648/ [7026649] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:09:58 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026649/ [7026650] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 01:02:43 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026650/ [7026651] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:53:02 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026651/ [7026652] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs} time: 00:30:10 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026652/ [7026653] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:06:38 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026653/ [7026654] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:26:12 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026654/ [7026655] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:14:40 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026655/ [7026656] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:30 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026656/ [7026657] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:10:59 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026657/ [7026658] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:05:55 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026658/ [7026659] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:27:26 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026659/ [7026660] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:30 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026660/ [7026661] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:06:52 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026661/ [7026662] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:18:01 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026662/ [7026663] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:12:13 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026663/ [7026664] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:18:44 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026664/ [7026665] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:07:27 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026665/ [7026666] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:11:00 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026666/ [7026667] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:31 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026667/ [7026668] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd-backfill} time: 04:23:38 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026668/ [7026669] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:18:55 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026669/ [7026670] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:04 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026670/ [7026672] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:09:25 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026672/ [7026673] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:17:32 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026673/ [7026674] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:15:52 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026674/ [7026675] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:11:10 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026675/ [7026676] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:12:27 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026676/ [7026677] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:12:58 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026677/ [7026678] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:23:50 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026678/ [7026679] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:04 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026679/ [7026680] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:37:00 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026680/ [7026681] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:21:46 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026681/ [7026683] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} time: 00:32:16 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026683/ [7026684] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:07:42 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026684/ [7026685] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:13 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026685/ [7026686] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:53 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026686/ [7026687] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:07:37 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026687/ [7026688] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{rhel_8}} time: 02:17:17 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026688/ [7026689] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:16 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026689/ [7026690] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:18:06 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026690/ [7026691] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:52 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026691/ [7026692] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} time: 00:23:33 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026692/ [7026693] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:37:24 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026693/ [7026695] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/crash} time: 00:10:40 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026695/ [7026697] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:05 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026697/ [7026698] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} time: 00:19:37 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026698/ [7026699] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects} time: 00:21:49 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026699/ [7026700] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:23:59 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026700/ [7026701] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:13:45 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026701/ [7026702] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:18:00 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026702/ [7026703] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:17 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026703/ [7026704] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:08 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026704/ [7026705] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:16:03 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026705/ [7026706] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:22:17 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026706/ [7026707] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:15:29 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026707/ [7026708] rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:13:34 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026708/ [7026709] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:22 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026709/ [7026710] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:07:46 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026710/ [7026711] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:47 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026711/ [7026712] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:16:23 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026712/ [7026713] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026713/ [7026714] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:44 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026714/ [7026715] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:30:17 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026715/ [7026716] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} time: 00:24:17 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026716/ [7026717] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:42:43 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026717/ [7026718] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{rhel_8}} time: 02:23:48 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026718/ [7026719] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:28:50 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026719/ [7026720] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption} time: 00:08:37 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026720/ [7026721] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:14 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026721/ [7026722] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:30:06 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026722/ [7026723] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:28:05 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026723/ [7026724] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:43 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026724/ [7026725] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:48:59 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026725/ [7026726] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:13:13 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026726/ [7026727] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:25:20 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026727/ [7026728] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:12:02 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026728/ [7026729] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/failover} time: 00:12:35 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026729/ [7026730] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:18:54 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026730/ [7026731] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:35:22 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026731/ [7026732] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:07:42 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026732/ [7026733] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:12 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026733/ [7026734] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_cephadm} time: 00:20:28 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026734/ [7026735] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:20:29 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026735/ [7026736] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:09:48 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026736/ [7026737] rados/singleton/{all/peer mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:07:43 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026737/ [7026738] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:57 info: http://pulpito.ceph.com/yuriw-2022-09-11_20:19:29-rados-main-distro-default-smithi/7026738/