2023-02-04T20:40:24.070 INFO:root:teuthology version: 0.0.1.dev37+g00690ec 2023-02-04T20:40:24.071 INFO:teuthology.results:subset: '111/120000' 2023-02-04T20:40:24.072 INFO:teuthology.results:seed: '2231' 2023-02-05T00:50:13.427 INFO:root:teuthology version: 0.0.1.dev37+g00690ec 2023-02-05T00:50:13.547 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-02-05T03:42:28.491 INFO:teuthology.results:Tests finished! gathering results... 2023-02-05T03:42:52.501 INFO:scrape:Found 321 jobs 2023-02-05T03:42:54.595 INFO:scrape:Found 6 distinct failure reasons 2023-02-05T03:42:54.596 INFO:scrape:Failure: 502 Server Error: Bad Gateway for url: https://chacra.ceph.com/repos/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/repo 2023-02-05T03:42:54.597 INFO:scrape:5 jobs: ['7147208', '7147485', '7147260', '7147441', '7147305'] 2023-02-05T03:42:54.597 INFO:scrape:suites intersection: ['ceph', 'clusters/{openstack', 'rados', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'thrashosds-health', 'three-plus-one}'] 2023-02-05T03:42:54.597 INFO:scrape:suites union: ['0-size-min-size-overrides/2-size-2-min-size', '0-size-min-size-overrides/3-size-2-min-size', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-install/octopus', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'thrashers/careful', 'thrashers/default', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/test_rbd_api}'] 2023-02-05T03:42:54.598 INFO:scrape: 2023-02-05T03:42:54.598 INFO:scrape:Failure: Command failed on smithi090 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2023-02-05T03:42:54.599 INFO:scrape:5 jobs: ['7147410', '7147221', '7147302', '7147380', '7147462'] 2023-02-05T03:42:54.599 INFO:scrape:suites intersection: [] 2023-02-05T03:42:54.599 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'agent/on', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'mon_election/connectivity', 'net/calico', 'net/flannel', 'net/host', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'test_iscsi_pids_limit}}'] 2023-02-05T03:42:54.600 INFO:scrape: 2023-02-05T03:42:54.600 INFO:scrape:Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi182 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=94699750e2153341ae55dd492525e2ed5d483974 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' 2023-02-05T03:42:54.601 INFO:scrape:2 jobs: ['7147278', '7147326'] 2023-02-05T03:42:54.601 INFO:scrape:suites intersection: ['mon_election/classic', 'msgr-failures/none', 'msgr/async-v2only', 'rados', 'supported-random-distro$/{rhel_8}}', 'test_envlibrados_for_rocksdb}'] 2023-02-05T03:42:54.601 INFO:scrape:suites union: ['mon_election/classic', 'msgr-failures/none', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zlib', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest', 'supported-random-distro$/{rhel_8}}', 'test_envlibrados_for_rocksdb}'] 2023-02-05T03:42:54.602 INFO:scrape: 2023-02-05T03:42:54.602 INFO:scrape:Failure: Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI) 2023-02-05T03:42:54.602 INFO:scrape:1 jobs: ['7147437'] 2023-02-05T03:42:54.603 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_orch_cli}'] 2023-02-05T03:42:54.603 INFO:scrape: 2023-02-05T03:42:54.603 INFO:scrape:Failure: {'smithi172.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:01:11.881488', 'end': '2023-02-05 00:28:23.189634', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-02-05 00:27:11.308146', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Request to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 failed: 504 - HTTP Error 504: Gateway Timeout', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Request to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 failed: 504 - HTTP Error 504: Gateway Timeout'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}, 'smithi085.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:01:12.483865', 'end': '2023-02-05 00:28:23.204583', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-02-05 00:27:10.720718', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Request to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 failed: 504 - HTTP Error 504: Gateway Timeout', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Request to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 failed: 504 - HTTP Error 504: Gateway Timeout'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}} 2023-02-05T03:42:54.604 INFO:scrape:2 jobs: ['7147450', '7147449'] 2023-02-05T03:42:54.604 INFO:scrape:suites intersection: ['objectstore/bluestore-low-osd-mem-target', 'rados'] 2023-02-05T03:42:54.605 INFO:scrape:suites union: ['ceph', 'clusters/3-mons', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/mon-delay', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/monthrash/{ceph', 'rados/verify/{centos_latest', 'supported-random-distro$/{centos_8}', 'tasks/rados_api_tests', 'thrashers/one', 'thrashosds-health}', 'validater/valgrind}', 'workloads/rados_mon_workunits}'] 2023-02-05T03:42:54.605 INFO:scrape: 2023-02-05T03:42:54.605 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi033 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=94699750e2153341ae55dd492525e2ed5d483974 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-02-05T03:42:54.606 INFO:scrape:2 jobs: ['7147301', '7147460'] 2023-02-05T03:42:54.606 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}'] 2023-02-05T03:42:54.606 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-snappy}', 'random-objectstore$/{bluestore-comp-zlib}', 'tasks/e2e}'] 2023-02-05T03:42:54.607 INFO:scrape: 2023-02-05T03:42:54.616 INFO:teuthology.results:Sending results to yweinstein@radhat.com: Test Run: yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/ failed: 15 dead: 2 running: 0 waiting: 0 queued: 0 passed: 304 Fail ================================================================= [7147208] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:08:01 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147208/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147208/ sentry: https://sentry.ceph.com/organizations/ceph/?query=81c60712f6024c5198f4feb607f435a6 502 Server Error: Bad Gateway for url: https://chacra.ceph.com/repos/ceph/n autilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/r epo [7147221] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:05:43 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147221/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147221/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f9179af14e5d416eb0e8254c5b599474 Command failed on smithi187 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7147260] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:08:01 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147260/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147260/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0f936a3a65254c808af7a284fc4b7f3d 502 Server Error: Bad Gateway for url: https://chacra.ceph.com/repos/ceph/n autilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/r epo [7147278] rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest test_envlibrados_for_rocksdb} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:12:54 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147278/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147278/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f9a45a507ab547db9c19e26ff8ea8a58 Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi182 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=94699750e2153341ae55dd492525e2ed5d483974 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7147301] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/e2e} ----------------------------------------------------------------- time: 00:19:27 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147301/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147301/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b784a55d85d0409cb9d9d94edf75dfa9 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi033 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=94699750e2153341ae55dd492525e2ed5d483974 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7147302] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:05:57 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147302/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147302/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1e7eb9cc5b7a49a8a9b823c39dd5f299 Command failed on smithi008 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7147305] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:08:05 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147305/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147305/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0a8bc49bb114249b96bb4a10b8e9955 502 Server Error: Bad Gateway for url: https://chacra.ceph.com/repos/ceph/o ctopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/re po [7147326] rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest test_envlibrados_for_rocksdb} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:13:12 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147326/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147326/ sentry: https://sentry.ceph.com/organizations/ceph/?query=88ee8c10faad43599e7351928694f027 Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi046 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=94699750e2153341ae55dd492525e2ed5d483974 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7147380] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:05:54 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147380/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147380/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5267c9f1ff664d74b158045089c02225 Command failed on smithi002 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7147410] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} ----------------------------------------------------------------- time: 00:06:43 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147410/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147410/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9b48bc72cba243329ec83be7a64ae463 Command failed on smithi090 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7147437] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:18:19 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147437/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147437/ sentry: https://sentry.ceph.com/organizations/ceph/?query=045da5c0e07b4e2ba822e412108efad1 Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI) [7147441] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:08:09 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147441/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147441/ sentry: https://sentry.ceph.com/organizations/ceph/?query=72468883765b4c7495f3f66f7096dc1f 502 Server Error: Bad Gateway for url: https://chacra.ceph.com/repos/ceph/n autilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/r epo [7147460] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/e2e} ----------------------------------------------------------------- time: 00:18:36 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147460/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147460/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d772ab1efec9411b9a4864ecf760715d Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi174 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=94699750e2153341ae55dd492525e2ed5d483974 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7147462] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:05:56 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147462/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147462/ sentry: https://sentry.ceph.com/organizations/ceph/?query=71298e250fa144008bf318d3837eb8e8 Command failed on smithi042 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7147485] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:08:09 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147485/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147485/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aff052d8cac04560860281db60ab6495 502 Server Error: Bad Gateway for url: https://chacra.ceph.com/repos/ceph/n autilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/r epo Dead ================================================================= [7147449] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:07:45 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147449/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147449/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8e234158e91e4961bdecfb51ab7d33e6 {'smithi088.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:01:04.557741', 'end': '2023-02-05 00:28:55.745753', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-02-05 00:27:51.188012', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Request to https://copr.fedorainfracloud.org/coprs/ceph /python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 failed: 504 - HTTP Error 504: Gateway Timeout', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Request to https://copr.fedorainfracloud.org/coprs/ce ph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 failed: 504 - HTTP Error 504: Gateway Timeout'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}} [7147450] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:06:29 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147450/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147450/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bb0095be5c1440eba15e5219a488b883 {'smithi172.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:01:11.881488', 'end': '2023-02-05 00:28:23.189634', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-02-05 00:27:11.308146', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Request to https://copr.fedorainfracloud.org/coprs/ceph /python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 failed: 504 - HTTP Error 504: Gateway Timeout', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Request to https://copr.fedorainfracloud.org/coprs/ce ph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 failed: 504 - HTTP Error 504: Gateway Timeout'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}, 'smithi085.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:01:12.483865', 'end': '2023-02-05 00:28:23.204583', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-02-05 00:27:10.720718', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Request to https://copr.fedorainfracloud.org/coprs/ceph /python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 failed: 504 - HTTP Error 504: Gateway Timeout', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', ',', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Request to https://copr.fedorainfracloud.org/coprs/ce ph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 failed: 504 - HTTP Error 504: Gateway Timeout'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}} Pass ================================================================= [7147181] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:22:21 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147181/ [7147182] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:20:50 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147182/ [7147183] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 02:35:11 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147183/ [7147184] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:14:55 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147184/ [7147185] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/workunits} time: 00:11:41 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147185/ [7147186] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:10:16 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147186/ [7147187] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli_mon} time: 00:26:15 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147187/ [7147188] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:27:15 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147188/ [7147189] rados/singleton/{all/peer mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:08:37 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147189/ [7147190] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{centos_8}} time: 00:34:12 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147190/ [7147191] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:46:04 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147191/ [7147192] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:27:46 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147192/ [7147193] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:29:55 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147193/ [7147194] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:12 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147194/ [7147195] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:09 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147195/ [7147196] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:16 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147196/ [7147197] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:38 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147197/ [7147198] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench} time: 00:51:54 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147198/ [7147199] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:16:46 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147199/ [7147200] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:40:28 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147200/ [7147201] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} time: 00:13:41 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147201/ [7147202] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:33:21 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147202/ [7147203] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:29:17 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147203/ [7147204] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:16:39 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147204/ [7147205] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect} time: 00:14:52 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147205/ [7147206] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:23:40 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147206/ [7147207] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:11 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147207/ [7147209] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:59 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147209/ [7147210] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:14:59 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147210/ [7147211] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:34:59 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147211/ [7147212] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:12:02 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147212/ [7147213] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:13:47 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147213/ [7147214] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:22 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147214/ [7147215] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:19:32 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147215/ [7147216] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:22:51 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147216/ [7147217] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} time: 01:12:19 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147217/ [7147218] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/crash} time: 00:14:20 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147218/ [7147219] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:08:46 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147219/ [7147220] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:15:59 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147220/ [7147222] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:19:46 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147222/ [7147223] rados/standalone/{supported-random-distro$/{rhel_8} workloads/c2c} time: 00:15:32 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147223/ [7147224] rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:26:55 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147224/ [7147225] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:21:39 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147225/ [7147226] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} time: 00:20:00 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147226/ [7147227] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:21:00 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147227/ [7147228] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:22:11 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147228/ [7147229] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:30:39 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147229/ [7147230] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:26:39 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147230/ [7147231] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:02 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147231/ [7147232] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:16 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147232/ [7147233] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:15 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147233/ [7147234] rados/singleton/{all/random-eio mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:26:09 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147234/ [7147235] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:56 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147235/ [7147236] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:08:46 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147236/ [7147237] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:17:36 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147237/ [7147238] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:18:16 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147238/ [7147239] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:29:39 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147239/ [7147240] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:24:09 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147240/ [7147241] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:18:47 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147241/ [7147242] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:50 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147242/ [7147243] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:22:01 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147243/ [7147244] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:17:26 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147244/ [7147245] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:11 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147245/ [7147246] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:30 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147246/ [7147247] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:22:10 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147247/ [7147248] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:08 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147248/ [7147249] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:24:35 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147249/ [7147250] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:17:16 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147250/ [7147251] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:06:22 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147251/ [7147252] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:12:07 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147252/ [7147253] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:08:33 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147253/ [7147254] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:11:57 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147254/ [7147255] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{rhel_8} tasks/failover} time: 00:17:41 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147255/ [7147256] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} time: 00:33:56 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147256/ [7147257] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:34 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147257/ [7147258] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} time: 00:24:12 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147258/ [7147259] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects} time: 00:24:14 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147259/ [7147261] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:53:30 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147261/ [7147262] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:32 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147262/ [7147263] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:53 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147263/ [7147264] rados/singleton/{all/test-crash mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:12:50 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147264/ [7147265] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:52 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147265/ [7147266] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:16:37 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147266/ [7147267] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:26:32 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147267/ [7147268] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:15 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147268/ [7147269] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:17:34 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147269/ [7147270] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:30:29 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147270/ [7147271] rados/singleton/{all/test-noautoscale-flag mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:11:38 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147271/ [7147272] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:28 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147272/ [7147273] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:29:39 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147273/ [7147274] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:21 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147274/ [7147275] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:08:49 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147275/ [7147276] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:58 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147276/ [7147277] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:21 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147277/ [7147279] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} time: 00:12:13 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147279/ [7147280] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:29:53 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147280/ [7147281] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:12:06 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147281/ [7147282] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:03 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147282/ [7147283] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:25:30 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147283/ [7147284] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} time: 00:31:19 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147284/ [7147285] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 01:17:24 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147285/ [7147286] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:20:01 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147286/ [7147287] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} time: 00:34:43 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147287/ [7147288] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:17:43 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147288/ [7147289] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/insights} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147289/ [7147290] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:15 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147290/ [7147291] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:11:09 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147291/ [7147292] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:37:16 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147292/ [7147293] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:23 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147293/ [7147294] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:51 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147294/ [7147295] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} time: 01:29:40 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147295/ [7147296] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:40:52 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147296/ [7147297] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:59 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147297/ [7147298] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:27:08 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147298/ [7147299] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:08:36 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147299/ [7147300] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:10 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147300/ [7147303] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:35 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147303/ [7147304] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 01:06:20 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147304/ [7147306] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:23:35 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147306/ [7147307] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} time: 00:18:48 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147307/ [7147308] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:20:31 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147308/ [7147309] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:24 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147309/ [7147310] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:40:02 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147310/ [7147311] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:53 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147311/ [7147312] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:23:10 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147312/ [7147313] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:15:05 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147313/ [7147314] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:17:16 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147314/ [7147315] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:17:15 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147315/ [7147316] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:31:32 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147316/ [7147317] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:10:46 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147317/ [7147318] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:14:26 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147318/ [7147319] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:14:55 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147319/ [7147320] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:31:12 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147320/ [7147321] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:08:48 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147321/ [7147322] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/pool-create-delete} time: 00:18:54 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147322/ [7147323] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:11 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147323/ [7147324] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:29:22 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147324/ [7147325] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:32:06 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147325/ [7147327] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:27:58 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147327/ [7147328] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:15 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147328/ [7147329] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:51 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147329/ [7147330] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:15:10 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147330/ [7147331] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:21:56 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147331/ [7147332] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:31:43 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147332/ [7147333] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:25:51 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147333/ [7147334] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:23:46 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147334/ [7147335] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:24:40 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147335/ [7147336] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:10:56 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147336/ [7147337] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:30:57 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147337/ [7147338] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:23:18 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147338/ [7147339] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:19:51 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147339/ [7147340] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:10 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147340/ [7147341] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:22:10 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147341/ [7147342] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} time: 00:09:51 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147342/ [7147343] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:28:41 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147343/ [7147344] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:25 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147344/ [7147345] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:20:55 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147345/ [7147346] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:08:28 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147346/ [7147347] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:10 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147347/ [7147348] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:24:55 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147348/ [7147349] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:23:12 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147349/ [7147350] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:14:13 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147350/ [7147351] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:27:07 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147351/ [7147352] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:11 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147352/ [7147353] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} time: 00:11:18 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147353/ [7147354] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:35 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147354/ [7147355] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:50 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147355/ [7147356] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache} time: 00:17:32 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147356/ [7147357] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:10:08 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147357/ [7147358] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/progress} time: 00:27:19 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147358/ [7147359] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:03 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147359/ [7147360] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm} time: 00:18:35 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147360/ [7147361] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:30:30 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147361/ [7147362] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} time: 01:09:16 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147362/ [7147363] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} time: 00:14:36 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147363/ [7147364] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:27:28 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147364/ [7147365] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:10:21 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147365/ [7147366] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:23:33 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147366/ [7147367] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:13:19 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147367/ [7147368] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:10:40 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147368/ [7147369] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:14 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147369/ [7147370] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:31:45 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147370/ [7147371] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:31 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147371/ [7147372] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} time: 00:12:27 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147372/ [7147373] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:37 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147373/ [7147374] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:16 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147374/ [7147375] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:12:31 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147375/ [7147376] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:13 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147376/ [7147377] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:11:57 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147377/ [7147378] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:29:54 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147378/ [7147379] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{filestore-xfs} tasks/dashboard} time: 01:13:42 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147379/ [7147381] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:26 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147381/ [7147382] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:26:02 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147382/ [7147383] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos} time: 00:09:20 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147383/ [7147384] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:19:38 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147384/ [7147385] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:28:23 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147385/ [7147386] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147386/ [7147387] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:30:47 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147387/ [7147388] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:35 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147388/ [7147389] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:33:44 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147389/ [7147390] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:14:20 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147390/ [7147391] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:12:40 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147391/ [7147392] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:32:41 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147392/ [7147393] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:17 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147393/ [7147394] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:10 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147394/ [7147395] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:16:43 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147395/ [7147396] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:39:03 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147396/ [7147397] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:04 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147397/ [7147398] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:16:46 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147398/ [7147399] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:32:40 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147399/ [7147400] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:22:12 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147400/ [7147401] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:11:44 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147401/ [7147402] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:13:13 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147402/ [7147403] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} time: 01:18:00 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147403/ [7147404] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:30 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147404/ [7147405] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:54 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147405/ [7147406] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} time: 00:55:31 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147406/ [7147407] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 01:02:27 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147407/ [7147408] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:07 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147408/ [7147409] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:14 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147409/ [7147411] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:15:14 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147411/ [7147412] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:16:54 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147412/ [7147413] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect} time: 00:13:43 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147413/ [7147414] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:31:51 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147414/ [7147415] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:26 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147415/ [7147416] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:13:41 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147416/ [7147417] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:55:16 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147417/ [7147418] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs} time: 00:30:27 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147418/ [7147419] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:11 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147419/ [7147420] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:36 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147420/ [7147421] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:15:37 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147421/ [7147422] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:11:55 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147422/ [7147423] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:52 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147423/ [7147424] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:14:53 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147424/ [7147425] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:26:18 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147425/ [7147426] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:12:57 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147426/ [7147427] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/workunits} time: 00:11:50 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147427/ [7147428] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:24:18 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147428/ [7147429] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:15:49 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147429/ [7147430] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:15:57 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147430/ [7147431] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:03 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147431/ [7147432] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:10:29 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147432/ [7147433] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:20 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147433/ [7147434] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} time: 03:30:50 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147434/ [7147435] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:21:07 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147435/ [7147436] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:13 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147436/ [7147438] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:15:46 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147438/ [7147439] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:11:37 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147439/ [7147440] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147440/ [7147442] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:10:56 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147442/ [7147443] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:12:23 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147443/ [7147444] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:26:31 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147444/ [7147445] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:13:05 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147445/ [7147446] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:33 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147446/ [7147447] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:36:34 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147447/ [7147448] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:21:08 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147448/ [7147451] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:41 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147451/ [7147452] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:47 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147452/ [7147453] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:14 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147453/ [7147454] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:16:23 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147454/ [7147455] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} time: 02:20:52 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147455/ [7147456] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:34:12 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147456/ [7147457] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:24:24 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147457/ [7147458] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} time: 00:26:12 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147458/ [7147459] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:31:22 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147459/ [7147461] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/crash} time: 00:14:20 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147461/ [7147463] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:58 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147463/ [7147464] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:16:34 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147464/ [7147465] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} time: 00:16:25 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147465/ [7147466] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects} time: 00:26:34 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147466/ [7147467] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:23 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147467/ [7147468] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:17:37 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147468/ [7147469] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:18 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147469/ [7147470] rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:12:11 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147470/ [7147471] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:14 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147471/ [7147472] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} time: 02:59:30 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147472/ [7147473] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:25:25 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147473/ [7147474] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:15:51 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147474/ [7147475] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:08:27 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147475/ [7147476] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:10:25 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147476/ [7147477] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:30 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147477/ [7147478] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:43:12 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147478/ [7147479] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:22:14 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147479/ [7147480] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:01 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147480/ [7147481] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:37 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147481/ [7147482] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:30:01 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147482/ [7147483] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/snaps-few-objects} time: 00:33:05 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147483/ [7147484] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{rhel_8}} time: 02:23:36 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147484/ [7147486] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:41:05 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147486/ [7147487] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption} time: 00:12:56 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147487/ [7147488] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:28 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147488/ [7147489] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:28:41 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147489/ [7147490] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:26:31 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147490/ [7147491] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:50 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147491/ [7147492] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:17:02 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147492/ [7147493] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:28:17 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147493/ [7147494] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:21:10 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147494/ [7147495] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:30 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147495/ [7147496] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{rhel_8} tasks/failover} time: 00:17:39 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147496/ [7147497] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:23:53 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147497/ [7147498] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:11 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147498/ [7147499] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:02 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147499/ [7147500] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_cephadm} time: 00:20:16 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147500/ [7147501] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:08:51 info: http://pulpito.ceph.com/yuriw-2023-02-03_17:34:29-rados-main-distro-default-smithi/7147501/