2022-10-06T11:11:35.234 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-06T11:11:35.235 INFO:teuthology.results:subset: '111/120000' 2022-10-06T11:11:35.236 INFO:teuthology.results:seed: '4180' 2022-10-06T15:09:11.409 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-06T15:09:11.430 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-10-06T18:16:29.033 INFO:teuthology.results:Tests finished! gathering results... 2022-10-06T18:16:55.183 INFO:scrape:Found 320 jobs 2022-10-06T18:16:57.498 INFO:scrape:Found 10 distinct failure reasons 2022-10-06T18:16:57.499 INFO:scrape:Failure: Command failed on smithi085 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2022-10-06T18:16:57.500 INFO:scrape:1 jobs: ['7056331'] 2022-10-06T18:16:57.500 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'test_iscsi_pids_limit}}'] 2022-10-06T18:16:57.500 INFO:scrape: 2022-10-06T18:16:57.501 INFO:scrape:Failure: No module named 'tasks.cephfs_test_runner' 2022-10-06T18:16:57.501 INFO:scrape:4 jobs: ['7056140', '7056163', '7056142', '7056162'] 2022-10-06T18:16:57.502 INFO:scrape:suites intersection: [] 2022-10-06T18:16:57.502 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'debug/mgr', 'fast/fast', 'mgr_ttl_cache/disable', 'mon_election/classic', 'msgr-failures/osd-delay', 'openstack}', 'rados', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/rest/{mgr-restful', 'rados/singleton-nomsgr/{all/cache-fs-trunc', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'random-objectstore$/{bluestore-comp-zstd}', 'recovery-overrides/{default}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/crash}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/ec-small-objects-fast-read-overwrites}'] 2022-10-06T18:16:57.503 INFO:scrape: 2022-10-06T18:16:57.503 INFO:scrape:Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi112 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9cfd351ab2cf5da8059a5166ce2646107a06f800 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' 2022-10-06T18:16:57.504 INFO:scrape:1 jobs: ['7056206'] 2022-10-06T18:16:57.504 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/none', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb', 'supported-random-distro$/{ubuntu_latest}}'] 2022-10-06T18:16:57.505 INFO:scrape: 2022-10-06T18:16:57.505 INFO:scrape:Failure: 'check osd count' reached maximum tries (90) after waiting for 900 seconds 2022-10-06T18:16:57.506 INFO:scrape:2 jobs: ['7056383', '7056223'] 2022-10-06T18:16:57.506 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', 'cluster/3-node', 'k8s/1.21', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2022-10-06T18:16:57.507 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/flannel', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2022-10-06T18:16:57.507 INFO:scrape: 2022-10-06T18:16:57.507 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi006.front.sepia.ceph.com: ['type=AVC msg=audit(1665062712.909:7036): avc: denied { ioctl } for pid=58205 comm="iptables" path="/var/lib/containers/storage/overlay/328d81270c24f402de03a5dca0da1258bef6120041b89619aec666b1e5b44376/merged" dev="overlay" ino=3411012 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1665062712.831:7034): avc: denied { ioctl } for pid=58190 comm="iptables" path="/var/lib/containers/storage/overlay/328d81270c24f402de03a5dca0da1258bef6120041b89619aec666b1e5b44376/merged" dev="overlay" ino=3411012 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2022-10-06T18:16:57.508 INFO:scrape:1 jobs: ['7056281'] 2022-10-06T18:16:57.508 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-10-06T18:16:57.509 INFO:scrape: 2022-10-06T18:16:57.509 INFO:scrape:Failure: Command failed on smithi050 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml' 2022-10-06T18:16:57.510 INFO:scrape:2 jobs: ['7056143', '7056301'] 2022-10-06T18:16:57.510 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/radosbench', 'cluster/1-node', 'k8s/1.21', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}'] 2022-10-06T18:16:57.511 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/radosbench', 'cluster/1-node', 'k8s/1.21', 'net/calico', 'net/host', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}'] 2022-10-06T18:16:57.511 INFO:scrape: 2022-10-06T18:16:57.512 INFO:scrape:Failure: Command failed on smithi057 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-285-g9cfd351a-1focal ceph-mds=18.0.0-285-g9cfd351a-1focal ceph-common=18.0.0-285-g9cfd351a-1focal ceph-fuse=18.0.0-285-g9cfd351a-1focal ceph-test=18.0.0-285-g9cfd351a-1focal radosgw=18.0.0-285-g9cfd351a-1focal python-ceph=18.0.0-285-g9cfd351a-1focal libcephfs1=18.0.0-285-g9cfd351a-1focal libcephfs-java=18.0.0-285-g9cfd351a-1focal libcephfs-jni=18.0.0-285-g9cfd351a-1focal librados2=18.0.0-285-g9cfd351a-1focal librbd1=18.0.0-285-g9cfd351a-1focal rbd-fuse=18.0.0-285-g9cfd351a-1focal' 2022-10-06T18:16:57.512 INFO:scrape:1 jobs: ['7056157'] 2022-10-06T18:16:57.512 INFO:scrape:suites: ['mon_election/classic', 'objectstore/bluestore-stupid', 'openstack', 'rados/perf/{ceph', 'scheduler/wpq_default_shards', 'settings/optimized', 'ubuntu_latest', 'workloads/radosbench_4K_rand_read}'] 2022-10-06T18:16:57.513 INFO:scrape: 2022-10-06T18:16:57.513 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9cfd351ab2cf5da8059a5166ce2646107a06f800 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2022-10-06T18:16:57.514 INFO:scrape:1 jobs: ['7056369'] 2022-10-06T18:16:57.514 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}'] 2022-10-06T18:16:57.515 INFO:scrape: 2022-10-06T18:16:57.515 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi103 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9cfd351ab2cf5da8059a5166ce2646107a06f800 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2022-10-06T18:16:57.516 INFO:scrape:1 jobs: ['7056381'] 2022-10-06T18:16:57.516 INFO:scrape:suites: ['debug/mgr', 'mon_election/classic', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-bitmap}', 'tasks/e2e}'] 2022-10-06T18:16:57.517 INFO:scrape: 2022-10-06T18:16:57.517 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi055.front.sepia.ceph.com: ['type=AVC msg=audit(1665058349.778:19060): avc: denied { ioctl } for pid=112169 comm="iptables" path="/var/lib/containers/storage/overlay/d33ccbf9169d7f5eb678a00686ea8e340fe89a8a907900aebedb63c2f933a03d/merged" dev="overlay" ino=3410241 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2022-10-06T18:16:57.518 INFO:scrape:1 jobs: ['7056148'] 2022-10-06T18:16:57.518 INFO:scrape:suites: ['agent/off', 'mon_election/classic', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_cephadm}'] 2022-10-06T18:16:57.518 INFO:scrape: 2022-10-06T18:16:57.529 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/ failed: 15 dead: 0 running: 0 waiting: 0 queued: 0 passed: 305 Fail ================================================================= [7056140] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/crash} ----------------------------------------------------------------- time: 00:07:11 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056140/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056140/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1fbca0f8260748489ee6eed4b7df72c8 No module named 'tasks.cephfs_test_runner' [7056142] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:39 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056142/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056142/ sentry: https://sentry.ceph.com/organizations/ceph/?query=229eb0a866ac43d9b694a42ff367ee66 No module named 'tasks.workunit' [7056143] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:04:38 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056143/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056143/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ba3914d173a9474fa41f700a312dbee6 Command failed on smithi050 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml' [7056148] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:20:10 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056148/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056148/ SELinux denials found on ubuntu@smithi055.front.sepia.ceph.com: ['type=AVC msg=audit(1665058349.778:19060): avc: denied { ioctl } for pid=112169 comm="iptables" path="/var/lib/containers/storage/overlay/d33ccbf9169d7f5eb 678a00686ea8e340fe89a8a907900aebedb63c2f933a03d/merged" dev="overlay" ino=3410241 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [7056157] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} ----------------------------------------------------------------- time: 00:02:39 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056157/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056157/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e2f44fd742814125929c8f9001720b12 Command failed on smithi057 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-285-g9cfd351a-1focal ceph-mds=18.0.0-285-g9cfd351a-1focal ceph- common=18.0.0-285-g9cfd351a-1focal ceph-fuse=18.0.0-285-g9cfd351a-1focal ceph-test=18.0.0-285-g9cfd351a-1focal radosgw=18.0.0-285-g9cfd351a-1focal python-ceph=18.0.0-285-g9cfd351a-1focal libcephfs1=18.0.0-285-g9cfd351a-1focal libcephfs- java=18.0.0-285-g9cfd351a-1focal libcephfs-jni=18.0.0-285-g9cfd351a-1focal librados2=18.0.0-285-g9cfd351a-1focal librbd1=18.0.0-285-g9cfd351a-1focal rbd-fuse=18.0.0-285-g9cfd351a-1focal' [7056162] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} ----------------------------------------------------------------- time: 00:04:39 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056162/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056162/ sentry: https://sentry.ceph.com/organizations/ceph/?query=62461d8ff8cd4bffa0165957962cbb6f No module named 'tasks' [7056163] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:04:25 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056163/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056163/ sentry: https://sentry.ceph.com/organizations/ceph/?query=17c5a76910f04b56a66a1c13f4f369e2 No module named 'tasks' [7056206] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:06:44 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056206/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056206/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0d441ed3782a468d8fa5bca97c63ffe9 Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi112 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9cfd351ab2cf5da8059a5166ce2646107a06f800 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7056223] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:24:55 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056223/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056223/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a896dbbd5d144ebe87d371044c731d28 'check osd count' reached maximum tries (90) after waiting for 900 seconds [7056281] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056281/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056281/ SELinux denials found on ubuntu@smithi006.front.sepia.ceph.com: ['type=AVC msg=audit(1665062712.909:7036): avc: denied { ioctl } for pid=58205 comm="iptables" path="/var/lib/containers/storage/overlay/328d81270c24f402d e03a5dca0da1258bef6120041b89619aec666b1e5b44376/merged" dev="overlay" ino=3411012 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1665062712.831:7034): avc: denied { ioctl } for pid=58190 comm="iptables" path="/var/lib/containers/storage/ov erlay/328d81270c24f402de03a5dca0da1258bef6120041b89619aec666b1e5b44376/merg ed" dev="overlay" ino=3411012 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [7056301] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:04:31 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056301/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056301/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2c0aa18c84c64d5db921ac97fc7c3aed Command failed on smithi047 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml' [7056331] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} ----------------------------------------------------------------- time: 00:03:14 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056331/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056331/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6f55d3fd25c64863896b405f6139c3d3 Command failed on smithi085 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7056369] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:53:09 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056369/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056369/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8bde5f77e2ed4b98bca90bcd6756e639 Command failed (workunit test rados/test.sh) on smithi007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9cfd351ab2cf5da8059a5166ce2646107a06f800 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [7056381] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/e2e} ----------------------------------------------------------------- time: 00:21:16 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056381/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056381/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5beb0f55f16e40e2b38b87dc8e2bd6b6 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi103 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9cfd351ab2cf5da8059a5166ce2646107a06f800 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7056383] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:26:06 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056383/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056383/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cb7958f5c9394d1f96d748eabba8e858 'check osd count' reached maximum tries (90) after waiting for 900 seconds Pass ================================================================= [7056106] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/workunits} time: 00:13:50 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056106/ [7056107] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:07:45 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056107/ [7056108] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:17:27 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056108/ [7056109] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli_mon} time: 00:28:22 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056109/ [7056110] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:28:01 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056110/ [7056111] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{rhel_8}} time: 00:35:19 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056111/ [7056112] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:48:17 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056112/ [7056113] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:27:59 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056113/ [7056114] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:26:49 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056114/ [7056115] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:23:22 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056115/ [7056116] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:05 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056116/ [7056117] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:14:42 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056117/ [7056118] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:06:13 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056118/ [7056119] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:16 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056119/ [7056120] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:04:40 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056120/ [7056121] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:12 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056121/ [7056122] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} time: 00:14:43 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056122/ [7056123] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:33:06 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056123/ [7056124] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:13:36 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056124/ [7056125] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:26:23 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056125/ [7056126] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect} time: 00:18:06 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056126/ [7056127] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:21:22 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056127/ [7056128] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:08:03 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056128/ [7056129] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:17:55 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056129/ [7056130] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:13:43 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056130/ [7056131] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:12 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056131/ [7056132] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:36 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056132/ [7056133] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:32:35 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056133/ [7056134] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:11:26 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056134/ [7056135] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:10:52 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056135/ [7056136] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:19:24 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056136/ [7056137] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:20:49 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056137/ [7056138] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:12:39 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056138/ [7056139] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{filestore-xfs} tasks/dashboard} time: 01:14:38 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056139/ [7056141] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:06:13 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056141/ [7056144] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:17 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056144/ [7056145] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} time: 00:10:39 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056145/ [7056146] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:25:05 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056146/ [7056147] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:17:50 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056147/ [7056149] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:20:50 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056149/ [7056150] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:26:30 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056150/ [7056151] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:22:59 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056151/ [7056152] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:38 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056152/ [7056153] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:19:49 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056153/ [7056154] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:07 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056154/ [7056155] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:11 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056155/ [7056156] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:42 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056156/ [7056158] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:11:56 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056158/ [7056159] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:27:04 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056159/ [7056160] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:15:16 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056160/ [7056161] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:27:59 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056161/ [7056164] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:18:14 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056164/ [7056165] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:17:45 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056165/ [7056166] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:10:22 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056166/ [7056167] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:25 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056167/ [7056168] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:18:56 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056168/ [7056169] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:21 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056169/ [7056170] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:18:50 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056170/ [7056171] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:11:56 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056171/ [7056172] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:03:52 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056172/ [7056173] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:12:17 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056173/ [7056174] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:35:20 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056174/ [7056175] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:06:03 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056175/ [7056176] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:11:33 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056176/ [7056177] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} time: 00:35:22 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056177/ [7056178] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:06:42 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056178/ [7056179] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} time: 00:24:47 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056179/ [7056180] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects} time: 00:18:06 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056180/ [7056181] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:36:38 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056181/ [7056182] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:48:46 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056182/ [7056183] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:12:47 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056183/ [7056184] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:04 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056184/ [7056185] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:08:30 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056185/ [7056186] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:51 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056186/ [7056187] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:12:22 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056187/ [7056188] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:33:00 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056188/ [7056189] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:41 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056189/ [7056190] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:19:18 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056190/ [7056191] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:07:38 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056191/ [7056192] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:32:59 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056192/ [7056193] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:40 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056193/ [7056194] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:30:03 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056194/ [7056195] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:12:49 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056195/ [7056196] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:06:14 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056196/ [7056197] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:03 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056197/ [7056198] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:21 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056198/ [7056199] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:18:48 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056199/ [7056200] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} time: 00:13:22 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056200/ [7056201] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:33:42 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056201/ [7056202] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:19 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056202/ [7056203] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:41 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056203/ [7056204] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:09 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056204/ [7056205] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} time: 00:26:49 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056205/ [7056207] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:15:55 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056207/ [7056208] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} time: 00:32:31 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056208/ [7056209] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:13:01 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056209/ [7056210] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:12:47 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056210/ [7056211] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:54 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056211/ [7056212] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:07:44 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056212/ [7056213] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:32:13 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056213/ [7056214] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:47 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056214/ [7056215] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:47 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056215/ [7056216] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 01:26:53 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056216/ [7056217] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 01:21:09 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056217/ [7056218] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:37 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056218/ [7056219] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:49:28 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056219/ [7056220] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:06:16 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056220/ [7056221] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:18:44 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056221/ [7056222] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} tasks/e2e} time: 00:20:44 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056222/ [7056224] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:51 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056224/ [7056225] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 01:54:55 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056225/ [7056226] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:40:35 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056226/ [7056227] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 02:16:25 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056227/ [7056228] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} time: 00:18:38 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056228/ [7056229] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:16:55 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056229/ [7056230] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:45 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056230/ [7056231] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:38:08 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056231/ [7056232] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:25:04 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056232/ [7056233] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:01 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056233/ [7056234] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:11:15 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056234/ [7056235] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:13:32 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056235/ [7056236] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:17:36 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056236/ [7056237] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:32:55 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056237/ [7056238] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:20:10 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056238/ [7056239] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:01 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056239/ [7056240] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:15 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056240/ [7056241] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:27:37 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056241/ [7056242] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:06:28 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056242/ [7056243] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:14:57 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056243/ [7056244] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:30 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056244/ [7056245] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:29:18 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056245/ [7056246] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:28:28 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056246/ [7056247] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:13:49 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056247/ [7056248] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:28:55 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056248/ [7056249] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:36:33 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056249/ [7056250] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:14:01 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056250/ [7056251] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} time: 00:19:57 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056251/ [7056252] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:20:31 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056252/ [7056253] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:29:14 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056253/ [7056254] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:20:20 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056254/ [7056255] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:20:50 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056255/ [7056256] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:20:18 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056256/ [7056257] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:07:09 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056257/ [7056258] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:29:57 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056258/ [7056259] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:37:50 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056259/ [7056260] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:18:11 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056260/ [7056261] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:56 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056261/ [7056262] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:18:30 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056262/ [7056263] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} time: 00:07:05 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056263/ [7056264] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:21:30 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056264/ [7056265] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:20:02 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056265/ [7056266] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:16:03 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056266/ [7056267] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:13:14 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056267/ [7056268] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:58 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056268/ [7056269] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:25:47 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056269/ [7056270] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:19:33 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056270/ [7056271] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:08:03 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056271/ [7056272] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:23:36 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056272/ [7056273] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:53 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056273/ [7056274] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_5925} time: 00:15:31 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056274/ [7056275] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:43 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056275/ [7056276] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:07:46 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056276/ [7056277] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache} time: 00:11:46 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056277/ [7056278] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{centos_8} tasks/progress} time: 00:17:46 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056278/ [7056279] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:46 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056279/ [7056280] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:07:01 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056280/ [7056282] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:27:32 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056282/ [7056283] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:59:12 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056283/ [7056284] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} time: 00:16:45 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056284/ [7056285] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:28:51 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056285/ [7056286] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:07:50 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056286/ [7056287] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:56 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056287/ [7056288] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:07:11 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056288/ [7056289] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:08:41 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056289/ [7056290] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:10:59 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056290/ [7056291] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:32:53 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056291/ [7056292] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:20 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056292/ [7056293] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} time: 00:10:21 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056293/ [7056294] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:24 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056294/ [7056295] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:01 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056295/ [7056296] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:12:36 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056296/ [7056297] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:09:13 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056297/ [7056298] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:45 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056298/ [7056299] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:26:05 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056299/ [7056300] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/dashboard} time: 01:12:18 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056300/ [7056302] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:16:16 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056302/ [7056303] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:19:54 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056303/ [7056304] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos} time: 00:05:03 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056304/ [7056305] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:59:22 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056305/ [7056306] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:15:40 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056306/ [7056307] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:29 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056307/ [7056308] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:26:22 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056308/ [7056309] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:06:08 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056309/ [7056310] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:32:03 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056310/ [7056311] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:14:48 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056311/ [7056312] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:10:06 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056312/ [7056313] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:49 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056313/ [7056314] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:59 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056314/ [7056315] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:57:51 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056315/ [7056316] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{filestore-xfs} supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:09:43 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056316/ [7056317] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:35:04 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056317/ [7056318] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:11:31 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056318/ [7056319] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:12:36 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056319/ [7056320] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:37:22 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056320/ [7056321] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:21:04 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056321/ [7056322] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:50 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056322/ [7056323] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 01:19:46 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056323/ [7056324] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:11:56 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056324/ [7056325] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:20 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056325/ [7056326] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:03 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056326/ [7056327] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 01:25:01 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056327/ [7056328] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 01:06:33 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056328/ [7056329] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:14:22 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056329/ [7056330] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:08:05 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056330/ [7056332] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:11:41 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056332/ [7056333] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:14:33 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056333/ [7056334] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect} time: 00:11:41 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056334/ [7056335] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:22 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056335/ [7056336] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:10:20 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056336/ [7056337] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 01:16:12 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056337/ [7056338] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:57:01 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056338/ [7056339] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs} time: 00:31:14 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056339/ [7056340] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:07:49 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056340/ [7056341] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:27:09 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056341/ [7056342] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:21:37 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056342/ [7056343] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:12 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056343/ [7056344] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:10:34 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056344/ [7056345] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:27 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056345/ [7056346] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:23:26 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056346/ [7056347] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:48 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056347/ [7056348] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_8} tasks/workunits} time: 00:08:52 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056348/ [7056349] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:20:06 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056349/ [7056350] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:11:29 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056350/ [7056351] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:18:03 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056351/ [7056352] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:08:26 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056352/ [7056353] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:11:06 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056353/ [7056354] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:34 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056354/ [7056355] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd-backfill} time: 04:21:31 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056355/ [7056356] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:18:31 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056356/ [7056357] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:22 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056357/ [7056358] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} time: 00:16:34 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056358/ [7056359] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:09:38 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056359/ [7056360] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:11:11 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056360/ [7056361] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:16:46 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056361/ [7056362] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:09:39 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056362/ [7056363] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:48 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056363/ [7056364] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:06 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056364/ [7056365] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:22:35 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056365/ [7056366] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:59 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056366/ [7056367] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:36:56 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056367/ [7056368] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:26:42 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056368/ [7056370] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits} time: 00:25:35 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056370/ [7056371] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:08:43 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056371/ [7056372] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:23 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056372/ [7056373] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:54 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056373/ [7056374] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:07:43 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056374/ [7056375] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} time: 02:12:01 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056375/ [7056376] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:35:09 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056376/ [7056377] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:18:28 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056377/ [7056378] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:14:40 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056378/ [7056379] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} time: 00:22:23 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056379/ [7056380] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:31:21 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056380/ [7056382] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_8} tasks/crash} time: 00:11:11 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056382/ [7056384] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:29 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056384/ [7056385] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} time: 00:21:27 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056385/ [7056386] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects} time: 00:23:25 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056386/ [7056387] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:28:53 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056387/ [7056388] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:13:31 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056388/ [7056389] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:13:38 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056389/ [7056390] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:04 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056390/ [7056391] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:46 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056391/ [7056392] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} time: 03:14:34 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056392/ [7056393] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:33:22 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056393/ [7056394] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:16:03 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056394/ [7056395] rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:10:26 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056395/ [7056396] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:13:57 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056396/ [7056397] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:08 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056397/ [7056398] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:17:31 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056398/ [7056399] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:17:55 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056399/ [7056400] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:10 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056400/ [7056401] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:50 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056401/ [7056402] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:30:17 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056402/ [7056403] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} time: 00:27:42 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056403/ [7056404] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:58:39 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056404/ [7056405] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{rhel_8}} time: 02:17:41 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056405/ [7056406] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:28:51 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056406/ [7056407] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption} time: 00:08:48 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056407/ [7056408] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:31 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056408/ [7056409] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:25:24 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056409/ [7056410] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:21:40 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056410/ [7056411] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:49 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056411/ [7056412] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:34:27 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056412/ [7056413] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:12:57 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056413/ [7056414] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:22:55 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056414/ [7056415] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:11:54 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056415/ [7056416] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/failover} time: 00:12:48 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056416/ [7056417] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:28:26 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056417/ [7056418] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:33:13 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056418/ [7056419] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:07:41 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056419/ [7056420] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:48 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056420/ [7056421] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_cephadm} time: 00:19:25 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056421/ [7056422] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:22:02 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056422/ [7056423] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:08:47 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056423/ [7056424] rados/singleton/{all/peer mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:07:50 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056424/ [7056425] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:22:36 info: http://pulpito.ceph.com/yuriw-2022-10-05_21:09:57-rados-main-distro-default-smithi/7056425/