2023-02-24T23:43:42.031 INFO:root:teuthology version: 0.0.1.dev43+ge06b2e0 2023-02-24T23:43:42.052 INFO:teuthology.results:subset: '111/120000' 2023-02-24T23:43:42.053 INFO:teuthology.results:seed: '4676' 2023-02-25T06:09:02.572 INFO:root:teuthology version: 0.0.1.dev43+ge06b2e0 2023-02-25T06:09:02.626 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-02-25T09:11:18.616 INFO:teuthology.results:Tests finished! gathering results... 2023-02-25T09:11:41.121 INFO:scrape:Found 304 jobs 2023-02-25T09:11:44.013 INFO:scrape:Found 7 distinct failure reasons 2023-02-25T09:11:44.014 INFO:scrape:Failure: too many values to unpack (expected 1) 2023-02-25T09:11:44.014 INFO:scrape:8 jobs: ['7187095', '7187212', '7186818', '7186882', '7186965', '7187277', '7187164', '7187026'] 2023-02-25T09:11:44.014 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/small-cluster', 'conf/{client', 'debug/mgr', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'per_module_finisher_thread/{begin/{0-install', 'rados/mgr/{clusters/{2-node-mgr}', 'tasks/per_module_finisher_stats}'] 2023-02-25T09:11:44.015 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/small-cluster', 'conf/{client', 'debug/mgr', 'distro/{centos_8}', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'ignorelist_wrongly_marked_down', 'mds', 'mgr_ttl_cache/disable', 'mgr_ttl_cache/enable', 'mon', 'mon_election/classic', 'mon_election/connectivity', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'per_module_finisher_thread/{begin/{0-install', 'rados/mgr/{clusters/{2-node-mgr}', 'random-objectstore$/{bluestore-comp-zlib}', 'random-objectstore$/{bluestore-comp-zstd}', 'random-objectstore$/{bluestore-hybrid}', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'random-objectstore$/{bluestore-stupid}', 'rhel_8}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/crash}', 'tasks/failover}', 'tasks/insights}', 'tasks/module_selftest}', 'tasks/per_module_finisher_stats}', 'tasks/progress}', 'tasks/prometheus}', 'tasks/workunits}'] 2023-02-25T09:11:44.015 INFO:scrape: 2023-02-25T09:11:44.015 INFO:scrape:Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi072 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b3ca880087261ea2f7f7789ce33fd359acb61861 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' 2023-02-25T09:11:44.016 INFO:scrape:2 jobs: ['7187195', '7187288'] 2023-02-25T09:11:44.016 INFO:scrape:suites intersection: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'rados', 'supported-random-distro$/{rhel_8}}', 'test_envlibrados_for_rocksdb}'] 2023-02-25T09:11:44.016 INFO:scrape:suites union: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest', 'supported-random-distro$/{rhel_8}}', 'test_envlibrados_for_rocksdb}'] 2023-02-25T09:11:44.017 INFO:scrape: 2023-02-25T09:11:44.017 INFO:scrape:Failure: Command failed (workunit test scrub/osd-scrub-dump.sh) on smithi088 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b3ca880087261ea2f7f7789ce33fd359acb61861 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh' 2023-02-25T09:11:44.017 INFO:scrape:1 jobs: ['7186848'] 2023-02-25T09:11:44.018 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{ubuntu_latest}', 'workloads/scrub}'] 2023-02-25T09:11:44.018 INFO:scrape: 2023-02-25T09:11:44.018 INFO:scrape:Failure: Command failed on smithi173 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b3ca880087261ea2f7f7789ce33fd359acb61861 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid daade486-b4c7-11ed-9ae8-001a4aab830c -- ceph mon dump -f json' 2023-02-25T09:11:44.019 INFO:scrape:2 jobs: ['7187222', '7187091'] 2023-02-25T09:11:44.019 INFO:scrape:suites intersection: ['0-nvme-loop'] 2023-02-25T09:11:44.019 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', 'agent/on', 'fixed-2', 'mon_election/connectivity', 'rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8', 'rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0', 'start}'] 2023-02-25T09:11:44.020 INFO:scrape: 2023-02-25T09:11:44.020 INFO:scrape:Failure: Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI) 2023-02-25T09:11:44.020 INFO:scrape:1 jobs: ['7186826'] 2023-02-25T09:11:44.020 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_orch_cli}'] 2023-02-25T09:11:44.021 INFO:scrape: 2023-02-25T09:11:44.021 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi114 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b3ca880087261ea2f7f7789ce33fd359acb61861 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-02-25T09:11:44.021 INFO:scrape:2 jobs: ['7187068', '7186762'] 2023-02-25T09:11:44.022 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}'] 2023-02-25T09:11:44.022 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-lz4}', 'random-objectstore$/{bluestore-comp-zstd}', 'tasks/e2e}'] 2023-02-25T09:11:44.022 INFO:scrape: 2023-02-25T09:11:44.023 INFO:scrape:Failure: Command failed on smithi103 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' 2023-02-25T09:11:44.023 INFO:scrape:6 jobs: ['7186918', '7187143', '7187070', '7187189', '7186764', '7187236'] 2023-02-25T09:11:44.023 INFO:scrape:suites intersection: [] 2023-02-25T09:11:44.024 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '1-start', '2-ops/rm-zap-flag}', '2-workload/none', '2-workload/radosbench', 'agent/on', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'mon_election/connectivity', 'net/calico', 'net/flannel', 'net/host', 'rados/cephadm/osds/{0-distro/ubuntu_20.04', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'test_iscsi_pids_limit}}'] 2023-02-25T09:11:44.024 INFO:scrape: 2023-02-25T09:11:44.038 INFO:teuthology.results:Sending results to yweinstein@radhat.com: Test Run: yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/ failed: 22 dead: 0 running: 0 waiting: 0 queued: 0 passed: 282 Fail ================================================================= [7186762] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} tasks/e2e} ----------------------------------------------------------------- time: 00:19:39 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186762/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186762/ sentry: https://sentry.ceph.com/organizations/ceph/?query=69a01f8b831442dabaabfea3da06248a Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi121 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b3ca880087261ea2f7f7789ce33fd359acb61861 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7186764] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/master} ----------------------------------------------------------------- time: 00:06:01 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186764/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186764/ sentry: https://sentry.ceph.com/organizations/ceph/?query=12da570276864e29a462a046b79b2e67 Command failed on smithi089 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7186818] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity per_module_finisher_thread/{begin/{0-install 1-ceph 2-logrotate} clusters/small-cluster conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/per_module_finisher_stats} random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/crash} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186818/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186818/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2ec0e8cb20c94f5b96baa528e9cce176 too many values to unpack (expected 1) [7186826] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:17:42 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186826/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186826/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9c1c95ac768a4268895e9951a7f82eb7 Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI) [7186848] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} ----------------------------------------------------------------- time: 00:33:55 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186848/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186848/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a217b7dbc9a84902b26cf37c3ff2486d Command failed (workunit test scrub/osd-scrub-dump.sh) on smithi088 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b3ca880087261ea2f7f7789ce33fd359acb61861 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh' [7186882] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic per_module_finisher_thread/{begin/{0-install 1-ceph 2-logrotate} clusters/small-cluster conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/per_module_finisher_stats} random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/failover} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186882/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186882/ sentry: https://sentry.ceph.com/organizations/ceph/?query=af1dfb41b0894741a41a68113d46ebec too many values to unpack (expected 1) [7186918] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:06:04 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186918/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186918/ sentry: https://sentry.ceph.com/organizations/ceph/?query=389ac9211a244595964f793086abd60b Command failed on smithi103 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7186965] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity per_module_finisher_thread/{begin/{0-install 1-ceph 2-logrotate} clusters/small-cluster conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/per_module_finisher_stats} random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/insights} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186965/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186965/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff463ef4f573451d88a2ae599c51e336 too many values to unpack (expected 1) [7187026] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic per_module_finisher_thread/{begin/{0-install 1-ceph 2-logrotate} clusters/small-cluster conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/per_module_finisher_stats} random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/module_selftest} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187026/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187026/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5215bfcbcb97453588931ea34cde9ddf too many values to unpack (expected 1) [7187068] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/e2e} ----------------------------------------------------------------- time: 00:19:31 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187068/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187068/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4d151f23a03a414e8a0f625e080557c0 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi114 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b3ca880087261ea2f7f7789ce33fd359acb61861 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7187070] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:06:07 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187070/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187070/ sentry: https://sentry.ceph.com/organizations/ceph/?query=21b131a8f548482da73fbea97f507fd8 Command failed on smithi057 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7187091] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:15:21 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187091/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187091/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0ded4cacff8446f4b808a52cd6f042c3 Command failed on smithi119 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:b3ca880087261ea2f7f7789ce33fd359acb61861 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf688b00-b4bc-11ed-9ae8-001a4aab830c -- ceph osd stat -f json' [7187095] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity per_module_finisher_thread/{begin/{0-install 1-ceph 2-logrotate} clusters/small-cluster conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/per_module_finisher_stats} random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/progress} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187095/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187095/ sentry: https://sentry.ceph.com/organizations/ceph/?query=32002a28aa674cf2949824c17e999a49 too many values to unpack (expected 1) [7187143] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 02:19:01 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187143/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187143/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b115b2687d204f8b97477534b6ae6b62 Command failed on smithi132 with status 5: 'sudo systemctl stop ceph-a525ad5a-b4c0-11ed-9ae8-001a4aab830c@mon.smithi132' [7187164] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic per_module_finisher_thread/{begin/{0-install 1-ceph 2-logrotate} clusters/small-cluster conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/per_module_finisher_stats} random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_8} tasks/prometheus} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187164/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187164/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a766decf9bc44da094359b3a953bb1b0 too many values to unpack (expected 1) [7187189] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:05:54 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187189/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187189/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e06f0c96c0a74aa9bc8f94f47b46d17d Command failed on smithi174 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7187195] rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:12:52 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187195/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187195/ sentry: https://sentry.ceph.com/organizations/ceph/?query=56d7d2dfc3bf40c4be950d475d6c8283 Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi072 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b3ca880087261ea2f7f7789ce33fd359acb61861 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7187212] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity per_module_finisher_thread/{begin/{0-install 1-ceph 2-logrotate} clusters/small-cluster conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/per_module_finisher_stats} random-objectstore$/{bluestore-hybrid} supported-random-distro$/{rhel_8} tasks/workunits} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187212/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187212/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f27df354373e43269129e80a4a6abb39 too many values to unpack (expected 1) [7187222] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:10:47 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187222/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187222/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b024210c8d644bd7a62b4a051fce2359 Command failed on smithi173 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:b3ca880087261ea2f7f7789ce33fd359acb61861 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid daade486-b4c7-11ed-9ae8-001a4aab830c -- ceph mon dump -f json' [7187236] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} ----------------------------------------------------------------- time: 00:07:05 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187236/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187236/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a3e1089f68d54d2b90a1ddc86e3591b3 Command failed on smithi120 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7187277] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic per_module_finisher_thread/{begin/{0-install 1-ceph 2-logrotate} clusters/small-cluster conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/per_module_finisher_stats} random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/crash} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187277/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187277/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7ef5d26a43e24b0899aa59f86994cf84 too many values to unpack (expected 1) [7187288] rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:13:40 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187288/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187288/ sentry: https://sentry.ceph.com/organizations/ceph/?query=81f622d634544940b5554a0ea6826286 Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi029 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b3ca880087261ea2f7f7789ce33fd359acb61861 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' Pass ================================================================= [7186758] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:11 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186758/ [7186760] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:40:12 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186760/ [7186766] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:00 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186766/ [7186768] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:25:21 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186768/ [7186770] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:10:55 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186770/ [7186772] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:40 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186772/ [7186774] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:29:48 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186774/ [7186776] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_nfs} time: 00:32:29 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186776/ [7186778] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:48 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186778/ [7186780] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:13:32 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186780/ [7186782] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:28:07 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186782/ [7186784] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:55 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186784/ [7186786] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} time: 02:57:04 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186786/ [7186788] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:28:37 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186788/ [7186790] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:18:44 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186790/ [7186792] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:42 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186792/ [7186794] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:23:41 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186794/ [7186796] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:14:05 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186796/ [7186798] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:15:12 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186798/ [7186800] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:17:40 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186800/ [7186802] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:11:55 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186802/ [7186804] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:41:36 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186804/ [7186806] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:28:12 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186806/ [7186808] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:13:36 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186808/ [7186810] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:19 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186810/ [7186812] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:34:27 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186812/ [7186814] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:17:18 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186814/ [7186816] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:56 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186816/ [7186820] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:17:47 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186820/ [7186822] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:14:10 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186822/ [7186824] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:25:04 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186824/ [7186828] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{ubuntu_latest}} time: 00:08:07 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186828/ [7186830] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:26:42 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186830/ [7186832] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:25:02 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186832/ [7186834] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:52:55 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186834/ [7186836] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:55 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186836/ [7186838] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:17:18 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186838/ [7186840] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache} time: 00:14:01 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186840/ [7186842] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:46 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186842/ [7186844] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:14:38 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186844/ [7186846] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:22:23 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186846/ [7186850] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} time: 02:01:50 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186850/ [7186852] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:10:42 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186852/ [7186854] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli_mon} time: 00:26:12 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186854/ [7186856] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:39:21 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186856/ [7186858] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:42 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186858/ [7186860] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} time: 00:14:36 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186860/ [7186862] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:25:51 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186862/ [7186864] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:24 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186864/ [7186866] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:24 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186866/ [7186868] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:10:47 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186868/ [7186870] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} time: 00:28:14 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186870/ [7186872] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-snaps} time: 00:16:52 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186872/ [7186874] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} time: 00:14:43 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186874/ [7186876] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:12:26 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186876/ [7186878] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:32:00 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186878/ [7186880] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 01:00:52 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186880/ [7186884] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:24:21 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186884/ [7186886] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:34 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186886/ [7186888] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:29:27 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186888/ [7186890] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:31:56 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186890/ [7186892] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:22:37 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186892/ [7186894] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:33:45 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186894/ [7186896] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:22 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186896/ [7186899] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:28:36 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186899/ [7186901] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:35:22 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186901/ [7186903] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:00 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186903/ [7186905] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:28 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186905/ [7186906] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:51 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186906/ [7186908] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:31:40 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186908/ [7186910] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:12:58 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186910/ [7186912] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} time: 01:06:40 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186912/ [7186914] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:38:59 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186914/ [7186916] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:15:05 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186916/ [7186920] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:21:58 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186920/ [7186922] rados/standalone/{supported-random-distro$/{rhel_8} workloads/c2c} time: 00:16:20 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186922/ [7186924] rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:37:39 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186924/ [7186926] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:21:35 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186926/ [7186928] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:15:38 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186928/ [7186930] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} time: 00:20:11 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186930/ [7186932] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:01 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186932/ [7186934] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:16:19 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186934/ [7186936] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:38:13 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186936/ [7186938] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:28 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186938/ [7186940] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:13:09 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186940/ [7186942] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:08:40 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186942/ [7186945] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} time: 00:32:12 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186945/ [7186946] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:19:46 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186946/ [7186948] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:15:10 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186948/ [7186950] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} time: 00:14:26 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186950/ [7186952] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:12:11 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186952/ [7186954] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench} time: 00:25:43 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186954/ [7186956] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:22 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186956/ [7186959] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:14:57 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186959/ [7186961] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:20 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186961/ [7186962] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:14:30 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186962/ [7186966] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:12:57 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186966/ [7186968] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:05 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186968/ [7186970] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:24:53 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186970/ [7186972] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:06:30 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186972/ [7186974] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:11 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186974/ [7186976] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:13:47 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186976/ [7186978] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:30 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186978/ [7186980] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:08:52 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186980/ [7186982] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:49 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186982/ [7186984] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} time: 00:23:09 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186984/ [7186986] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:13:30 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186986/ [7186988] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:32:44 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186988/ [7186991] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:48:38 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186991/ [7186992] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:06 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186992/ [7186994] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:16:51 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186994/ [7186996] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:01 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186996/ [7186998] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:18:14 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7186998/ [7187000] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:17:06 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187000/ [7187002] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:30 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187002/ [7187004] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:18:26 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187004/ [7187006] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:08:05 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187006/ [7187008] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:14:59 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187008/ [7187010] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/pool-create-delete} time: 00:21:57 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187010/ [7187012] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:17 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187012/ [7187014] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:27:33 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187014/ [7187016] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:26 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187016/ [7187018] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:17:59 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187018/ [7187020] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:08:49 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187020/ [7187022] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:20:32 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187022/ [7187024] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:31 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187024/ [7187028] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:18:51 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187028/ [7187030] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:02 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187030/ [7187032] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:25:32 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187032/ [7187034] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:26:14 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187034/ [7187036] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:24:47 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187036/ [7187038] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:21:53 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187038/ [7187040] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} time: 00:31:04 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187040/ [7187042] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:52 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187042/ [7187044] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:52 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187044/ [7187046] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:36:47 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187046/ [7187048] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:15:21 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187048/ [7187050] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:12 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187050/ [7187052] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:26 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187052/ [7187054] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} time: 01:28:07 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187054/ [7187056] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:21:05 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187056/ [7187058] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:22:28 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187058/ [7187060] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:06 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187060/ [7187062] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:08:48 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187062/ [7187064] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:44 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187064/ [7187066] rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:13:33 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187066/ [7187072] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:05 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187072/ [7187074] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 01:31:53 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187074/ [7187076] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:21:03 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187076/ [7187078] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925} time: 00:13:40 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187078/ [7187079] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} time: 00:19:13 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187079/ [7187080] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:11:11 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187080/ [7187081] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:17:50 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187081/ [7187082] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:08:26 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187082/ [7187083] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:14:25 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187083/ [7187084] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:33:31 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187084/ [7187085] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:16:10 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187085/ [7187086] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:16:43 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187086/ [7187087] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:18:34 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187087/ [7187088] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:58 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187088/ [7187089] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 01:11:02 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187089/ [7187093] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:08:42 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187093/ [7187097] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:27 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187097/ [7187099] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:29:02 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187099/ [7187101] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:08:40 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187101/ [7187104] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:17:14 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187104/ [7187106] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:28:31 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187106/ [7187107] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:18:30 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187107/ [7187109] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:18:42 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187109/ [7187111] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:24:03 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187111/ [7187113] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:31:59 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187113/ [7187115] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:32:56 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187115/ [7187117] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:33 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187117/ [7187119] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:28:28 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187119/ [7187121] rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:16:53 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187121/ [7187123] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:32:50 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187123/ [7187125] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:37 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187125/ [7187127] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:24:33 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187127/ [7187129] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:30:37 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187129/ [7187131] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:26:16 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187131/ [7187133] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:18:48 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187133/ [7187135] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} time: 00:10:25 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187135/ [7187137] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:11 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187137/ [7187139] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:08:32 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187139/ [7187141] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:19:10 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187141/ [7187145] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:14:12 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187145/ [7187147] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:23:19 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187147/ [7187149] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 00:18:14 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187149/ [7187151] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:16:41 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187151/ [7187153] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:17 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187153/ [7187156] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:25:03 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187156/ [7187158] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:01 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187158/ [7187160] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:36:27 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187160/ [7187162] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:21:17 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187162/ [7187166] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:28:12 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187166/ [7187167] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:18:48 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187167/ [7187168] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:40:59 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187168/ [7187169] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm} time: 00:18:13 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187169/ [7187170] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:27:16 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187170/ [7187171] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 01:10:21 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187171/ [7187172] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:31:10 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187172/ [7187173] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:09:15 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187173/ [7187174] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:10 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187174/ [7187175] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:10:25 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187175/ [7187176] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:16:13 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187176/ [7187177] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:13:48 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187177/ [7187178] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:35:45 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187178/ [7187179] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:13:06 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187179/ [7187180] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:15:30 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187180/ [7187181] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:26:03 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187181/ [7187182] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:02 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187182/ [7187183] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:54:40 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187183/ [7187184] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:28:39 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187184/ [7187185] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:11:47 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187185/ [7187186] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:19:51 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187186/ [7187187] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:29:56 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187187/ [7187188] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/dashboard} time: 01:06:13 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187188/ [7187190] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:22:02 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187190/ [7187191] rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:35:15 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187191/ [7187192] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos} time: 00:09:49 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187192/ [7187193] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:27:48 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187193/ [7187194] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:39 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187194/ [7187196] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:17:50 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187196/ [7187197] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:16 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187197/ [7187198] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:23 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187198/ [7187199] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:00 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187199/ [7187201] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:38:38 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187201/ [7187203] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:33 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187203/ [7187205] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:57:30 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187205/ [7187208] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:03 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187208/ [7187210] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:23:02 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187210/ [7187214] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:30 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187214/ [7187216] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:53 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187216/ [7187218] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} time: 01:19:32 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187218/ [7187220] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:07:12 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187220/ [7187224] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:33:33 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187224/ [7187226] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_8}} time: 02:57:05 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187226/ [7187228] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:23:28 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187228/ [7187230] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:14:23 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187230/ [7187232] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:14:02 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187232/ [7187234] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:29 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187234/ [7187238] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} time: 00:32:21 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187238/ [7187240] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:23:10 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187240/ [7187242] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache} time: 00:15:02 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187242/ [7187244] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:11:33 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187244/ [7187246] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs} time: 00:30:36 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187246/ [7187248] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:12:18 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187248/ [7187250] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:21:59 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187250/ [7187252] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:21:05 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187252/ [7187254] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:14:41 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187254/ [7187256] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed} time: 00:16:38 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187256/ [7187258] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:32 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187258/ [7187260] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:25:23 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187260/ [7187261] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:47 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187261/ [7187264] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:11:45 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187264/ [7187266] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/repair_test} time: 00:19:12 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187266/ [7187268] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:16:58 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187268/ [7187270] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:38 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187270/ [7187272] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:10:31 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187272/ [7187274] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/dedup-io-snaps} time: 00:16:47 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187274/ [7187276] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:40 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187276/ [7187280] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:12:29 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187280/ [7187282] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} time: 03:30:12 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187282/ [7187284] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:20:55 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187284/ [7187286] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:16:04 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187286/ [7187290] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} time: 00:19:18 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187290/ [7187292] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:20:56 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187292/ [7187294] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:32:45 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187294/ [7187296] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:08:10 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187296/ [7187298] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:04 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187298/ [7187299] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:11 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187299/ [7187301] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:32:10 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187301/ [7187304] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:17:13 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187304/ [7187306] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} time: 00:07:16 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187306/ [7187308] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:16 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187308/ [7187310] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:10:48 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187310/ [7187312] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:27:16 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187312/ [7187314] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:39:38 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187314/ [7187316] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:05 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187316/ [7187318] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:52 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187318/ [7187320] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:13:22 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187320/ [7187322] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} time: 00:25:33 info: http://pulpito.ceph.com/yuriw-2023-02-24_17:53:09-rados-wip-yuri6-testing-2023-02-24-0805-distro-default-smithi/7187322/