2023-05-11T15:49:03.649 INFO:root:teuthology version: 0.0.1.dev98+g69caab8
2023-05-11T15:49:03.651 INFO:teuthology.results:subset: '111/120000'
2023-05-11T15:49:03.651 INFO:teuthology.results:seed: '3477'
2023-05-11T19:46:32.779 INFO:root:teuthology version: 0.0.1.dev98+g69caab8
2023-05-11T19:46:32.805 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-05-12T07:11:17.785 INFO:teuthology.results:Tests finished! gathering results...
2023-05-12T07:11:40.145 INFO:scrape:Found 311 jobs
2023-05-12T07:11:40.348 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271211/teuthology.log
2023-05-12T07:11:47.596 INFO:scrape:Found 15 distinct failure reasons
2023-05-12T07:11:47.597 INFO:scrape:Failure: {'smithi121.front.sepia.ceph.com': {'changed': False, 'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in filesystem\n  Run `vgcreate --help' for more information.\n", 'failed': True, 'invocation': {'module_args': {'force': False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme' failed", 'rc': 3}]}, 'smithi007.front.sepia.ceph.com': {'changed': False, 'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in filesystem\n  Run `vgcreate --help' for more information.\n", 'failed': True, 'invocation': {'module_args': {'force': False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme' failed", 'rc': 3}]}}
2023-05-12T07:11:47.597 INFO:scrape:10 jobs: ['7271274', '7271246', '7271301', '7271331', '7271213', '7271311', '7271328', '7271299', '7271273', '7271287']
2023-05-12T07:11:47.598 INFO:scrape:suites intersection: []
2023-05-12T07:11:47.598 INFO:scrape:suites union: ['0-nvme-loop', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-recovery}', '2-recovery-overrides/{more-partial-recovery}', '3-scrub-overrides/{default}', 'agent/off', 'agent/on', 'backoff/normal', 'backoff/peering', 'ceph', 'cluster/{12-osds', 'clusters/3-mons', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'debug/mgr', 'fixed-2', 'mgr_ttl_cache/disable', 'mgr_ttl_cache/enable', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/mon-delay', 'msgr-failures/none', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/cephadm/smoke/{0-distro/ubuntu_20.04', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/singleton/{all/thrash-eio', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'random-objectstore$/{bluestore-stupid}', 'recovery-overrides/{more-partial-recovery}', 'start}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_20.04}', 'supported-random-distro$/{ubuntu_latest}', 'task/test_adoption}', 'tasks/prometheus}', 'tasks/scrub_test}', 'tasks/workunits}', 'thrashers/default', 'thrashers/many', 'thrashers/morepggrow', 'thrashers/none', 'thrashosds-health', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/rados_mon_osdmap_prune}', 'workloads/radosbench-high-concurrency}', 'workloads/write_fadvise_dontneed}']
2023-05-12T07:11:47.599 INFO:scrape:
2023-05-12T07:11:47.599 INFO:scrape:Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi144 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c36284dac0d5cb692d3962260f6ebccd7a3cc3e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'
2023-05-12T07:11:47.599 INFO:scrape:2 jobs: ['7271307', '7271260']
2023-05-12T07:11:47.599 INFO:scrape:suites intersection: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'rados', 'supported-random-distro$/{rhel_8}}', 'test_envlibrados_for_rocksdb}']
2023-05-12T07:11:47.600 INFO:scrape:suites union: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest', 'supported-random-distro$/{rhel_8}}', 'test_envlibrados_for_rocksdb}']
2023-05-12T07:11:47.600 INFO:scrape:
2023-05-12T07:11:47.600 INFO:scrape:Dead: None
2023-05-12T07:11:47.601 INFO:scrape:25 jobs: ['7271211', '7271286', '7271243', '7271197', '7271282', '7271271', '7271320', '7271339', '7271247', '7271212', '7271298', '7271245', '7271215', '7271325', '7271210', '7271198', '7271289', '7271216', '7271322', '7271288', '7271303', '7271306', '7271209', '7271304', '7271321']
2023-05-12T07:11:47.601 INFO:scrape:
2023-05-12T07:11:47.601 INFO:scrape:Failure: {'smithi107.front.sepia.ceph.com': {'changed': False, 'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in filesystem\n  Run `vgcreate --help' for more information.\n", 'failed': True, 'invocation': {'module_args': {'force': False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme' failed", 'rc': 3}]}, 'smithi131.front.sepia.ceph.com': {'changed': False, 'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in filesystem\n  Run `vgcreate --help' for more information.\n", 'failed': True, 'invocation': {'module_args': {'force': False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme' failed", 'rc': 3}]}}
2023-05-12T07:11:47.602 INFO:scrape:2 jobs: ['7271310', '7271292']
2023-05-12T07:11:47.602 INFO:scrape:suites intersection: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-partial-recovery}', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'thrashosds-health']
2023-05-12T07:11:47.602 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-partial-recovery}', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/normal', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v1only', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'thrashers/careful', 'thrashers/mapgap', 'thrashosds-health', 'workloads/dedup-io-mixed}', 'workloads/pool-snaps-few-objects}']
2023-05-12T07:11:47.603 INFO:scrape:
2023-05-12T07:11:47.603 INFO:scrape:Failure: failed to install new kernel version within timeout
2023-05-12T07:11:47.603 INFO:scrape:10 jobs: ['7271326', '7271272', '7271297', '7271327', '7271276', '7271275', '7271319', '7271309', '7271293', '7271214']
2023-05-12T07:11:47.603 INFO:scrape:suites intersection: []
2023-05-12T07:11:47.604 INFO:scrape:suites union: ['0-nvme-loop', '0-size-min-size-overrides/2-size-2-min-size', '1-install/nautilus-v1only', 'agent/off', 'agent/on', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-thrash/none', 'debug/mgr', 'fixed-2', 'mgr_ttl_cache/disable', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v1only', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'openstack', 'openstack}', 'rados', 'rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0', 'rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/objectstore/{backends/objectstore-bluestore-a', 'rados/perf/{ceph', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton-nomsgr/{all/health-warnings', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'rados/verify/{centos_latest', 'random-objectstore$/{bluestore-comp-lz4}', 'recovery-overrides/{more-async-recovery}', 'scheduler/dmclock_1Shard_16Threads', 'settings/optimized', 'start}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_20.04}}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/per_module_finisher_stats}', 'tasks/rados_cls_all', 'thrashers/default', 'thrashers/none', 'thrashosds-health', 'three-plus-one}', 'ubuntu_latest', 'validater/valgrind}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/fio_4M_rand_read}', 'workloads/test_rbd_api}']
2023-05-12T07:11:47.604 INFO:scrape:
2023-05-12T07:11:47.604 INFO:scrape:Failure: Cannot connect to remote host smithi072
2023-05-12T07:11:47.605 INFO:scrape:3 jobs: ['7271277', '7271222', '7271258']
2023-05-12T07:11:47.605 INFO:scrape:suites intersection: ['1-pg-log-overrides/normal_pg_log', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_8}', 'thrashosds-health']
2023-05-12T07:11:47.605 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_8}', 'thrashers/mapgap', 'thrashers/none', 'thrashosds-health', 'workloads/admin_socket_objecter_requests}', 'workloads/cache-pool-snaps}', 'workloads/cache-snaps}']
2023-05-12T07:11:47.606 INFO:scrape:
2023-05-12T07:11:47.606 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats'
2023-05-12T07:11:47.606 INFO:scrape:2 jobs: ['7271184', '7271220']
2023-05-12T07:11:47.606 INFO:scrape:suites intersection: ['mon_election/classic', 'rados']
2023-05-12T07:11:47.607 INFO:scrape:suites union: ['0-size-min-size-overrides/2-size-2-min-size', '1-install/pacific', 'backoff/peering', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'supported-random-distro$/{ubuntu_latest}}', 'thrashers/mapgap', 'thrashosds-health', 'three-plus-one}', 'workloads/rbd_cls}']
2023-05-12T07:11:47.607 INFO:scrape:
2023-05-12T07:11:47.607 INFO:scrape:Failure: Command failed on smithi112 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'
2023-05-12T07:11:47.608 INFO:scrape:7 jobs: ['7271253', '7271336', '7271250', '7271098', '7271223', '7271175', '7271281']
2023-05-12T07:11:47.608 INFO:scrape:suites intersection: []
2023-05-12T07:11:47.608 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'agent/on', 'cluster/1-node', 'cluster/3-node', 'fixed-2', 'k8s/1.21', 'mon_election/connectivity', 'msgr-failures/many', 'msgr/async-v2only', 'net/calico', 'net/flannel', 'net/host', 'no_pools', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'rados/multimon/{clusters/9', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}', 'start}', 'supported-random-distro$/{rhel_8}', 'task/test_set_mon_crush_locations}', 'tasks/mon_recovery}']
2023-05-12T07:11:47.609 INFO:scrape:
2023-05-12T07:11:47.609 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi083 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c36284dac0d5cb692d3962260f6ebccd7a3cc3e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'
2023-05-12T07:11:47.609 INFO:scrape:2 jobs: ['7271334', '7271174']
2023-05-12T07:11:47.610 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}']
2023-05-12T07:11:47.610 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-lz4}', 'random-objectstore$/{bluestore-stupid}', 'tasks/e2e}']
2023-05-12T07:11:47.610 INFO:scrape:
2023-05-12T07:11:47.610 INFO:scrape:Dead: b'2023-05-12T07:08:09.969 DEBUG:teuthology.exit:Finished running handlers'
2023-05-12T07:11:47.611 INFO:scrape:4 jobs: ['7271256', '7271099', '7271254', '7271101']
2023-05-12T07:11:47.611 INFO:scrape:suites intersection: []
2023-05-12T07:11:47.611 INFO:scrape:suites union: ['0-start', '1-tasks', 'mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools}', 'rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'supported-random-distro$/{ubuntu_20.04}}', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default']
2023-05-12T07:11:47.612 INFO:scrape:
2023-05-12T07:11:47.612 INFO:scrape:Failure: Stale jobs detected, aborting.
2023-05-12T07:11:47.612 INFO:scrape:5 jobs: ['7271324', '7271291', '7271300', '7271290', '7271323']
2023-05-12T07:11:47.612 INFO:scrape:suites intersection: []
2023-05-12T07:11:47.613 INFO:scrape:suites union: ['0-nvme-loop', '1-pg-log-overrides/short_pg_log', '1-start', '2-ops/repave-all}', '2-recovery-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/many', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'no_pools', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'openstack', 'openstack}', 'rados', 'rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun', 'rados/multimon/{clusters/3', 'rados/perf/{ceph', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'scheduler/wpq_default_shards', 'settings/optimized', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}}', 'tasks/mon_clock_with_skews}', 'thrashers/morepggrow', 'thrashosds-health', 'ubuntu_latest', 'workloads/fio_4K_rand_rw}', 'workloads/rados_api_tests}']
2023-05-12T07:11:47.613 INFO:scrape:
2023-05-12T07:11:47.613 INFO:scrape:Dead: b"TypeError: argument of type 'NoneType' is not iterable"
2023-05-12T07:11:47.614 INFO:scrape:1 jobs: ['7271308']
2023-05-12T07:11:47.614 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_cephadm}']
2023-05-12T07:11:47.614 INFO:scrape:
2023-05-12T07:11:47.614 INFO:scrape:Failure: "1683832695.9914374 osd.4 (osd.4) 64 : cluster [WRN] osd.4 PgScrubber: 2.6 timeout on reserving replicsa (since 2023-05-11T19:18:10.988957+0000)" in cluster log
2023-05-12T07:11:47.615 INFO:scrape:1 jobs: ['7271192']
2023-05-12T07:11:47.615 INFO:scrape:suites: ['clusters/{fixed-2', 'fast/normal', 'mon_election/connectivity', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashosds-health', 'workloads/ec-radosbench}']
2023-05-12T07:11:47.615 INFO:scrape:
2023-05-12T07:11:47.616 INFO:scrape:Failure: Command failed on smithi125 with status 95: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c36284dac0d5cb692d3962260f6ebccd7a3cc3e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b9c9486-f025-11ed-9b02-001a4aab830c -- ceph rgw realm bootstrap -i -'
2023-05-12T07:11:47.616 INFO:scrape:2 jobs: ['7271124', '7271257']
2023-05-12T07:11:47.616 INFO:scrape:suites intersection: ['task/test_rgw_multisite}']
2023-05-12T07:11:47.616 INFO:scrape:suites union: ['agent/off', 'agent/on', 'mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'task/test_rgw_multisite}']
2023-05-12T07:11:47.617 INFO:scrape:
2023-05-12T07:11:47.617 INFO:scrape:Failure: Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI)
2023-05-12T07:11:47.617 INFO:scrape:2 jobs: ['7271230', '7271083']
2023-05-12T07:11:47.618 INFO:scrape:suites intersection: ['task/test_orch_cli}']
2023-05-12T07:11:47.618 INFO:scrape:suites union: ['agent/off', 'agent/on', 'mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_orch_cli}']
2023-05-12T07:11:47.618 INFO:scrape:
2023-05-12T07:11:47.629 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/
failed:  37
dead:    41
running: 0
waiting: 0
queued:  0
passed:  233


Fail
=================================================================
[7271083]  rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli}
-----------------------------------------------------------------
time:   00:17:32
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271083/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271083/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3de92dddab93401c8ca5cdf72747b782

    Test failure: test_cephfs_mirror
    (tasks.cephadm_cases.test_cli.TestCephadmCLI)

[7271098]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2}
-----------------------------------------------------------------
time:   00:06:54
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271098/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271098/
sentry: https://sentry.ceph.com/organizations/ceph/?query=96770b7306bd48159218b558b7da1874

    Command failed on smithi153 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7271124]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_rgw_multisite}
-----------------------------------------------------------------
time:   00:20:40
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271124/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271124/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6d78ca86223d423bb07136c7c8151b17

    Command failed on smithi125 with status 95: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay-quay-
    quay.apps.os.sepia.ceph.com/ceph-
    ci/ceph:3c36284dac0d5cb692d3962260f6ebccd7a3cc3e shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    1b9c9486-f025-11ed-9b02-001a4aab830c -- ceph rgw realm bootstrap -i -'

[7271174]  rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/e2e}
-----------------------------------------------------------------
time:   00:26:32
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271174/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271174/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8e884fc3ed66429095891315f02598cd

    Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi026
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=3c36284dac0d5cb692d3962260f6ebccd7a3cc3e
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

[7271175]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master}
-----------------------------------------------------------------
time:   00:06:50
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271175/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271175/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f543d17b5a79489b88586fceac1a87e4

    Command failed on smithi083 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7271184]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:11:20
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271184/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271184/
sentry: https://sentry.ceph.com/organizations/ceph/?query=969e7804598f4fd4bd25595c7b7670f4

    Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c
    ceph_test_lazy_omap_stats'

[7271192]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench}
-----------------------------------------------------------------
time:   02:31:13
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271192/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271192/

    "1683832695.9914374 osd.4 (osd.4) 64 : cluster [WRN] osd.4 PgScrubber: 2.6
    timeout on reserving replicsa (since 2023-05-11T19:18:10.988957+0000)" in
    cluster log

[7271214]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{rhel_8} tasks/per_module_finisher_stats}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271214/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271214/
sentry: https://sentry.ceph.com/organizations/ceph/?query=956dca484221431e83b12c4853512385

    failed to install new kernel version within timeout

[7271220]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls}
-----------------------------------------------------------------
time:   00:28:43
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271220/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271220/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b4c0cedad634439b95ac6a7eed174d4c

    Command failed on smithi141 with status 1: "sudo
    TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_cls_rbd --gtest_filter=-Te
    stClsRbd.get_features:TestClsRbd.parents:TestClsRbd.mirror'"

[7271222]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271222/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271222/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0df2179381fd4bf3922bbaa529fad17b

    Cannot connect to remote host smithi072

[7271223]  rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271223/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271223/
sentry: https://sentry.ceph.com/organizations/ceph/?query=80f1fddc60ef4edeb32a2020be315118

    Command failed on smithi072 with status 1: 'sudo yum install -y kernel'

[7271230]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli}
-----------------------------------------------------------------
time:   00:18:58
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271230/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271230/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4d7d0bb2c245470f8f373808c1eae393

    Test failure: test_cephfs_mirror
    (tasks.cephadm_cases.test_cli.TestCephadmCLI)

[7271250]  rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271250/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271250/
sentry: https://sentry.ceph.com/organizations/ceph/?query=14fcbf74b1ab4d3aaa76df53a0936c68

    Command failed on smithi072 with status 1: 'sudo yum install -y kernel'

[7271253]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2}
-----------------------------------------------------------------
time:   00:06:31
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271253/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271253/
sentry: https://sentry.ceph.com/organizations/ceph/?query=24d91ca0fde4402f9854de4791670c41

    Command failed on smithi112 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7271257]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_rgw_multisite}
-----------------------------------------------------------------
time:   00:16:19
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271257/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271257/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2afa57f508244bffa51ce85ae15b063d

    Command failed on smithi085 with status 95: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay-quay-
    quay.apps.os.sepia.ceph.com/ceph-
    ci/ceph:3c36284dac0d5cb692d3962260f6ebccd7a3cc3e shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    08d6e03e-f031-11ed-9b02-001a4aab830c -- ceph rgw realm bootstrap -i -'

[7271258]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271258/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271258/
sentry: https://sentry.ceph.com/organizations/ceph/?query=432b9235aa1d4f459194a7c574a34ed3

    Cannot connect to remote host smithi072

[7271260]  rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:14:34
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271260/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271260/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3323eed5ac6944c3bcb970079ad80eb6

    Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on
    smithi100 with status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=3c36284dac0d5cb692d3962260f6ebccd7a3cc3e
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'

[7271272]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271272/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271272/
sentry: https://sentry.ceph.com/organizations/ceph/?query=18f51d9a9bbe40d3991f490418ba3917

    failed to install new kernel version within timeout

[7271275]  rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271275/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271275/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ccbf9fdfbca5453291feec244181f305

    failed to install new kernel version within timeout

[7271276]  rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271276/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271276/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f983acf06c2b4165b18281ee25f77da9

    failed to install new kernel version within timeout

[7271277]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271277/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271277/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a25b51eae9ec4418824fc6fe57878ece

    Cannot connect to remote host smithi072

[7271281]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_set_mon_crush_locations}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271281/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271281/
sentry: https://sentry.ceph.com/organizations/ceph/?query=426fd383d899418bb52d54be96c32c39

    Command failed on smithi072 with status 1: 'sudo yum install -y kernel'

[7271290]  rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271290/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271290/
sentry: https://sentry.ceph.com/organizations/ceph/?query=35e1e0022f594e73b39ccc3edfca0c0c

    Stale jobs detected, aborting.

[7271291]  rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271291/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271291/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7cdfd5f98e7949aab21f77ab196428c4

    Stale jobs detected, aborting.

[7271293]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271293/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271293/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a1ccc7bddc1d48cfb6750791f3730d93

    failed to install new kernel version within timeout

[7271297]  rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271297/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271297/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a31b0439df1844f7b8baf1214d314dae

    failed to install new kernel version within timeout

[7271300]  rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271300/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271300/
sentry: https://sentry.ceph.com/organizations/ceph/?query=284a85e6bece4c07a2231bcbdd4f4015

    Stale jobs detected, aborting.

[7271307]  rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:14:14
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271307/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271307/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1ed1e7dfacdc465780218e9d7f00eb80

    Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on
    smithi144 with status 1: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=3c36284dac0d5cb692d3962260f6ebccd7a3cc3e
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'

[7271309]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271309/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271309/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4c81a750eb394376b65f5e74acb2e738

    failed to install new kernel version within timeout

[7271319]  rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271319/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271319/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cbd9c334623a4729badbda0a1871d612

    failed to install new kernel version within timeout

[7271323]  rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271323/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271323/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1c603b46996346a4ac80e59e0ad6cc46

    Stale jobs detected, aborting.

[7271324]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271324/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271324/
sentry: https://sentry.ceph.com/organizations/ceph/?query=880ecb1bb3c14f4f8b81af9ece949c22

    Stale jobs detected, aborting.

[7271326]  rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271326/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271326/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6399d3dadd764acf9a305fef3d5f1416

    failed to install new kernel version within timeout

[7271327]  rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271327/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271327/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8bd8901f32f64d04adc20151ab149d51

    failed to install new kernel version within timeout

[7271331]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/radosbench-high-concurrency}
-----------------------------------------------------------------
time:   00:11:43
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271331/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271331/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f8d8cd07ae2d47d0b7fd486a5211da67

    {'smithi148.front.sepia.ceph.com': {'changed': False, 'msg': 'All items
    completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value':
    {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var':
    'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in
    filesystem\n  Run `vgcreate --help' for more information.\n", 'failed':
    True, 'invocation': {'module_args': {'force': False, 'pesize': '4',
    'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state':
    'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme',
    'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme'
    failed", 'rc': 3}]}, 'smithi072.front.sepia.ceph.com': {'_ansible_no_log':
    False, 'msg': "Failed to connect to the host via ssh: Warning: Permanently
    added 'smithi072.front.sepia.ceph.com,172.21.15.72' (ECDSA) to the list of
    known hosts.\r\nubuntu@smithi072.front.sepia.ceph.com: Permission denied
    (publickey,password,keyboard-interactive)."}}

[7271334]  rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} tasks/e2e}
-----------------------------------------------------------------
time:   00:32:36
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271334/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271334/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a699628ab6be40aab05b02ba81e01b81

    Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi083
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=3c36284dac0d5cb692d3962260f6ebccd7a3cc3e
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

[7271336]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master}
-----------------------------------------------------------------
time:   00:07:23
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271336/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271336/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e530021bb259485db2ac5aae5e1789fc

    Command failed on smithi037 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'



Dead
=================================================================
[7271099]  rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271099/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271099/

    hit max job timeout

[7271101]  rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271101/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271101/

    hit max job timeout

[7271197]  rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271197/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271197/

    Error reimaging machines: Failed to power on smithi017

[7271198]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271198/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271198/

    Error reimaging machines: Failed to power on smithi136

[7271209]  rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271209/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271209/

    Error reimaging machines: Failed to power on smithi118

[7271210]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_nfs}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271210/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271210/

    Error reimaging machines: reached maximum tries (100) after waiting for 600
    seconds

[7271211]  rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271211/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271211/

    Error reimaging machines: reached maximum tries (100) after waiting for 600
    seconds

[7271212]  rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271212/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271212/

    Error reimaging machines: reached maximum tries (100) after waiting for 600
    seconds

[7271213]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed}
-----------------------------------------------------------------
time:   00:03:37
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271213/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271213/
sentry: https://sentry.ceph.com/organizations/ceph/?query=94869c1764d84e9892e1d9372aeb520c

    {'smithi121.front.sepia.ceph.com': {'changed': False, 'msg': 'All items
    completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value':
    {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var':
    'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in
    filesystem\n  Run `vgcreate --help' for more information.\n", 'failed':
    True, 'invocation': {'module_args': {'force': False, 'pesize': '4',
    'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state':
    'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme',
    'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme'
    failed", 'rc': 3}]}, 'smithi064.front.sepia.ceph.com': {'changed': False,
    'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key':
    'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False,
    'ansible_loop_var': 'item', 'changed': False, 'err': "  /dev/vg_nvme:
    already exists in filesystem\n  Run `vgcreate --help' for more
    information.\n", 'failed': True, 'invocation': {'module_args': {'force':
    False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs':
    ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}},
    'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg':
    "Creating volume group 'vg_nvme' failed", 'rc': 3}]}}

[7271215]  rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271215/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271215/

    Error reimaging machines: Failed to power on smithi115

[7271216]  rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271216/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271216/

    Error reimaging machines: Failed to power on smithi159

[7271243]  rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271243/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271243/

    Error reimaging machines: Failed to power on smithi033

[7271245]  rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271245/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271245/

    Error reimaging machines: reached maximum tries (100) after waiting for 600
    seconds

[7271246]  rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune}
-----------------------------------------------------------------
time:   00:02:23
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271246/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271246/
sentry: https://sentry.ceph.com/organizations/ceph/?query=02c376afb6fe441ab6840094bd3f945f

    {'smithi190.front.sepia.ceph.com': {'changed': False, 'msg': 'All items
    completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value':
    {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var':
    'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in
    filesystem\n  Run `vgcreate --help' for more information.\n", 'failed':
    True, 'invocation': {'module_args': {'force': False, 'pesize': '4',
    'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state':
    'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme',
    'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme'
    failed", 'rc': 3}]}, 'smithi097.front.sepia.ceph.com': {'changed': False,
    'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key':
    'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False,
    'ansible_loop_var': 'item', 'changed': False, 'err': "  /dev/vg_nvme:
    already exists in filesystem\n  Run `vgcreate --help' for more
    information.\n", 'failed': True, 'invocation': {'module_args': {'force':
    False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs':
    ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}},
    'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg':
    "Creating volume group 'vg_nvme' failed", 'rc': 3}]}}

[7271247]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271247/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271247/

    Error reimaging machines: Failed to power on smithi085

[7271254]  rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271254/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271254/

    hit max job timeout

[7271256]  rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271256/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271256/

    hit max job timeout

[7271271]  rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271271/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271271/

    Error reimaging machines: Failed to power on smithi072

[7271273]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/prometheus}
-----------------------------------------------------------------
time:   00:02:19
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271273/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271273/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b2129ce789e84b9c97cd17cb1b6861e0

    {'smithi174.front.sepia.ceph.com': {'changed': False, 'msg': 'All items
    completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value':
    {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var':
    'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in
    filesystem\n  Run `vgcreate --help' for more information.\n", 'failed':
    True, 'invocation': {'module_args': {'force': False, 'pesize': '4',
    'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state':
    'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme',
    'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme'
    failed", 'rc': 3}]}, 'smithi099.front.sepia.ceph.com': {'changed': False,
    'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key':
    'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False,
    'ansible_loop_var': 'item', 'changed': False, 'err': "  /dev/vg_nvme:
    already exists in filesystem\n  Run `vgcreate --help' for more
    information.\n", 'failed': True, 'invocation': {'module_args': {'force':
    False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs':
    ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}},
    'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg':
    "Creating volume group 'vg_nvme' failed", 'rc': 3}]}}

[7271274]  rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:03:11
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271274/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271274/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3a4606382fbf4850a0e3ca4dcc9ed624

    {'smithi121.front.sepia.ceph.com': {'changed': False, 'msg': 'All items
    completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value':
    {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var':
    'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in
    filesystem\n  Run `vgcreate --help' for more information.\n", 'failed':
    True, 'invocation': {'module_args': {'force': False, 'pesize': '4',
    'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state':
    'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme',
    'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme'
    failed", 'rc': 3}]}, 'smithi007.front.sepia.ceph.com': {'changed': False,
    'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key':
    'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False,
    'ansible_loop_var': 'item', 'changed': False, 'err': "  /dev/vg_nvme:
    already exists in filesystem\n  Run `vgcreate --help' for more
    information.\n", 'failed': True, 'invocation': {'module_args': {'force':
    False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs':
    ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}},
    'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg':
    "Creating volume group 'vg_nvme' failed", 'rc': 3}]}}

[7271282]  rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/one workloads/rados_mon_workunits}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271282/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271282/

    Error reimaging machines: Failed to power on smithi132

[7271286]  rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271286/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271286/

    Error reimaging machines: reached maximum tries (100) after waiting for 600
    seconds

[7271287]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_adoption}
-----------------------------------------------------------------
time:   00:02:58
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271287/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271287/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c9d736430fd747c8bc3f562b6ecfc52a

    {'smithi118.front.sepia.ceph.com': {'changed': False, 'msg': 'All items
    completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value':
    {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var':
    'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in
    filesystem\n  Run `vgcreate --help' for more information.\n", 'failed':
    True, 'invocation': {'module_args': {'force': False, 'pesize': '4',
    'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state':
    'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme',
    'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme'
    failed", 'rc': 3}]}}

[7271288]  rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271288/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271288/

    Error reimaging machines: Failed to power on smithi141

[7271289]  rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271289/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271289/

    Error reimaging machines: reached maximum tries (100) after waiting for 600
    seconds

[7271292]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed}
-----------------------------------------------------------------
time:   00:02:21
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271292/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271292/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e7153c2751124a1e9230cfcc1d7f2dcc

    {'smithi172.front.sepia.ceph.com': {'changed': False, 'msg': 'All items
    completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value':
    {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var':
    'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in
    filesystem\n  Run `vgcreate --help' for more information.\n", 'failed':
    True, 'invocation': {'module_args': {'force': False, 'pesize': '4',
    'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state':
    'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme',
    'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme'
    failed", 'rc': 3}]}, 'smithi181.front.sepia.ceph.com': {'changed': False,
    'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key':
    'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False,
    'ansible_loop_var': 'item', 'changed': False, 'err': "  /dev/vg_nvme:
    already exists in filesystem\n  Run `vgcreate --help' for more
    information.\n", 'failed': True, 'invocation': {'module_args': {'force':
    False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs':
    ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}},
    'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg':
    "Creating volume group 'vg_nvme' failed", 'rc': 3}]}}

[7271298]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/repair_test}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271298/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271298/

    Error reimaging machines: Failed to power on smithi086

[7271299]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
-----------------------------------------------------------------
time:   00:08:41
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271299/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271299/
sentry: https://sentry.ceph.com/organizations/ceph/?query=44fb8af112a8420fad902b3d19c68f78

    {'smithi141.front.sepia.ceph.com': {'changed': False, 'msg': 'All items
    completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value':
    {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var':
    'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in
    filesystem\n  Run `vgcreate --help' for more information.\n", 'failed':
    True, 'invocation': {'module_args': {'force': False, 'pesize': '4',
    'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state':
    'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme',
    'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme'
    failed", 'rc': 3}]}, 'smithi101.front.sepia.ceph.com': {'changed': False,
    'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key':
    'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False,
    'ansible_loop_var': 'item', 'changed': False, 'err': "  /dev/vg_nvme:
    already exists in filesystem\n  Run `vgcreate --help' for more
    information.\n", 'failed': True, 'invocation': {'module_args': {'force':
    False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs':
    ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}},
    'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg':
    "Creating volume group 'vg_nvme' failed", 'rc': 3}]}}

[7271301]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{rhel_8} tasks/workunits}
-----------------------------------------------------------------
time:   00:03:41
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271301/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271301/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3446eca4f7144e3d9fda2c7c12f8e0c0

    {'smithi177.front.sepia.ceph.com': {'changed': False, 'msg': 'All items
    completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value':
    {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var':
    'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in
    filesystem\n  Run `vgcreate --help' for more information.\n", 'failed':
    True, 'invocation': {'module_args': {'force': False, 'pesize': '4',
    'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state':
    'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme',
    'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme'
    failed", 'rc': 3}]}, 'smithi165.front.sepia.ceph.com': {'changed': False,
    'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key':
    'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False,
    'ansible_loop_var': 'item', 'changed': False, 'err': "  /dev/vg_nvme:
    already exists in filesystem\n  Run `vgcreate --help' for more
    information.\n", 'failed': True, 'invocation': {'module_args': {'force':
    False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs':
    ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}},
    'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg':
    "Creating volume group 'vg_nvme' failed", 'rc': 3}]}}

[7271303]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271303/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271303/

    Error reimaging machines: Failed to power on smithi179

[7271304]  rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271304/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271304/

    Error reimaging machines: Failed to power on smithi125

[7271306]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271306/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271306/

    Error reimaging machines: reached maximum tries (100) after waiting for 600
    seconds

[7271308]  rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271308/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271308/

[7271310]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects}
-----------------------------------------------------------------
time:   00:04:21
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271310/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271310/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c7af53d9c7c049c49a32932baef5fa9f

    {'smithi107.front.sepia.ceph.com': {'changed': False, 'msg': 'All items
    completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value':
    {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var':
    'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in
    filesystem\n  Run `vgcreate --help' for more information.\n", 'failed':
    True, 'invocation': {'module_args': {'force': False, 'pesize': '4',
    'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state':
    'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme',
    'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme'
    failed", 'rc': 3}]}, 'smithi131.front.sepia.ceph.com': {'changed': False,
    'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key':
    'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False,
    'ansible_loop_var': 'item', 'changed': False, 'err': "  /dev/vg_nvme:
    already exists in filesystem\n  Run `vgcreate --help' for more
    information.\n", 'failed': True, 'invocation': {'module_args': {'force':
    False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs':
    ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}},
    'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg':
    "Creating volume group 'vg_nvme' failed", 'rc': 3}]}}

[7271311]  rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:03:19
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271311/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271311/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6aeadf01c04b47fba6f1fa81bb44e30a

    {'smithi133.front.sepia.ceph.com': {'changed': False, 'msg': 'All items
    completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value':
    {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var':
    'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in
    filesystem\n  Run `vgcreate --help' for more information.\n", 'failed':
    True, 'invocation': {'module_args': {'force': False, 'pesize': '4',
    'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state':
    'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme',
    'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme'
    failed", 'rc': 3}]}, 'smithi003.front.sepia.ceph.com': {'changed': False,
    'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key':
    'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False,
    'ansible_loop_var': 'item', 'changed': False, 'err': "  /dev/vg_nvme:
    already exists in filesystem\n  Run `vgcreate --help' for more
    information.\n", 'failed': True, 'invocation': {'module_args': {'force':
    False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs':
    ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}},
    'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg':
    "Creating volume group 'vg_nvme' failed", 'rc': 3}]}}

[7271320]  rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/pool-create-delete}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271320/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271320/

    Error reimaging machines: Failed to power on smithi125

[7271321]  rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271321/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271321/

    Error reimaging machines: reached maximum tries (100) after waiting for 600
    seconds

[7271322]  rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_20.04}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271322/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271322/

    Error reimaging machines: reached maximum tries (100) after waiting for 600
    seconds

[7271325]  rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271325/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271325/

    Error reimaging machines: Command failed on smithi037 with status 4: "sudo
    sed -i -e 's/localhost.localdomain/smithi037/g' /etc/hosts"

[7271328]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} tasks/scrub_test}
-----------------------------------------------------------------
time:   00:06:20
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271328/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271328/
sentry: https://sentry.ceph.com/organizations/ceph/?query=57094740c50147c88e78ed9ace836fa7

    {'smithi116.front.sepia.ceph.com': {'changed': False, 'msg': 'All items
    completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value':
    {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var':
    'item', 'changed': False, 'err': "  /dev/vg_nvme: already exists in
    filesystem\n  Run `vgcreate --help' for more information.\n", 'failed':
    True, 'invocation': {'module_args': {'force': False, 'pesize': '4',
    'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state':
    'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme',
    'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme'
    failed", 'rc': 3}]}}

[7271339]  rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271339/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271339/

    Error reimaging machines: Failed to power on smithi031



Pass
=================================================================
[7271040] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/force-sync-many workloads/rados_mon_osdmap_prune}
time:   00:42:23
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271040/

[7271041] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced}
time:   00:29:36
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271041/

[7271042] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
time:   00:14:41
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271042/

[7271043] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
time:   00:12:19
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271043/

[7271044] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects}
time:   00:38:18
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271044/

[7271045] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos}
time:   00:08:03
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271045/

[7271046] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:15:06
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271046/

[7271047] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:18:39
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271047/

[7271048] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:26
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271048/

[7271049] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:16:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271049/

[7271050] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps}
time:   00:28:54
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271050/

[7271051] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{rhel_8}}
time:   00:12:23
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271051/

[7271052] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:20:13
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271052/

[7271053] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects}
time:   00:22:18
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271053/

[7271054] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:16:46
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271054/

[7271055] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:19:50
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271055/

[7271056] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:45
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271056/

[7271057] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache}
time:   00:16:49
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271057/

[7271058] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:13:33
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271058/

[7271059] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/libcephsqlite}
time:   00:19:06
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271059/

[7271060] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:17:23
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271060/

[7271061] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:22:34
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271061/

[7271062] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind}
time:   02:02:11
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271062/

[7271063] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:12:29
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271063/

[7271064] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:39:37
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271064/

[7271065] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:50
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271065/

[7271066] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub}
time:   03:01:08
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271066/

[7271067] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/workunits}
time:   00:11:58
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271067/

[7271068] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:19:04
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271068/

[7271069] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed}
time:   00:14:11
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271069/

[7271070] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:27:44
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271070/

[7271071] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:16:22
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271071/

[7271072] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}}
time:   00:08:07
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271072/

[7271073] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits}
time:   00:33:39
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271073/

[7271074] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs}
time:   00:37:49
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271074/

[7271075] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup-io-snaps}
time:   00:18:04
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271075/

[7271076] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} tasks/mon_clock_no_skews}
time:   00:08:49
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271076/

[7271077] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:28:44
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271077/

[7271078] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
time:   00:28:21
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271078/

[7271079] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:24:10
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271079/

[7271080] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:12:30
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271080/

[7271081] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests}
time:   00:29:49
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271081/

[7271082] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/pool-snaps-few-objects}
time:   00:30:21
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271082/

[7271084] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
time:   00:24:10
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271084/

[7271085] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
time:   00:32:45
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271085/

[7271086] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:15:39
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271086/

[7271087] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:26:54
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271087/

[7271088] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:36:20
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271088/

[7271089] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:05
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271089/

[7271090] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:14:03
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271090/

[7271091] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:36:54
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271091/

[7271092] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests}
time:   00:29:23
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271092/

[7271093] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:34
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271093/

[7271094] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/dashboard}
time:   01:22:53
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271094/

[7271095] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/crash}
time:   00:13:14
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271095/

[7271096] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}}
time:   00:42:49
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271096/

[7271097] rados/rest/{mgr-restful supported-random-distro$/{centos_8}}
time:   00:19:53
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271097/

[7271100] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c}
time:   00:15:40
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271100/

[7271102] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
time:   00:27:38
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271102/

[7271103] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep}
time:   00:16:23
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271103/

[7271104] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon}
time:   00:27:29
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271104/

[7271105] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:23:15
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271105/

[7271106] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
time:   00:19:35
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271106/

[7271107] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency}
time:   00:29:51
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271107/

[7271108] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}}
time:   00:10:39
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271108/

[7271109] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:14:21
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271109/

[7271110] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:11:06
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271110/

[7271111] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects}
time:   00:36:34
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271111/

[7271112] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_cls_all}
time:   00:20:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271112/

[7271113] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:14:06
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271113/

[7271114] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final}
time:   00:12:17
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271114/

[7271115] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews}
time:   00:13:45
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271115/

[7271116] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench}
time:   00:27:14
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271116/

[7271117] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:22:41
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271117/

[7271118] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:15:46
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271118/

[7271119] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:13:18
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271119/

[7271120] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:15:31
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271120/

[7271121] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect}
time:   00:23:29
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271121/

[7271122] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:33
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271122/

[7271123] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
time:   00:32:05
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271123/

[7271125] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:25:21
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271125/

[7271126] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/failover}
time:   00:15:17
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271126/

[7271127] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:11:05
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271127/

[7271128] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/crush}
time:   00:20:47
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271128/

[7271129] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:11:35
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271129/

[7271130] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
time:   00:10:52
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271130/

[7271131] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:14:29
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271131/

[7271132] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:09:59
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271132/

[7271133] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests}
time:   00:14:31
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271133/

[7271134] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps}
time:   00:31:37
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271134/

[7271135] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}
time:   00:49:34
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271135/

[7271136] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_python}
time:   00:16:15
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271136/

[7271137] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:17:58
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271137/

[7271138] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}}
time:   00:14:32
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271138/

[7271139] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_set_mon_crush_locations}
time:   00:30:59
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271139/

[7271140] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:16:44
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271140/

[7271141] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object}
time:   00:15:34
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271141/

[7271142] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}}
time:   00:15:24
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271142/

[7271143] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271143/

[7271144] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/pool-create-delete}
time:   00:20:11
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271144/

[7271145] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:18:30
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271145/

[7271146] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} tasks/mon_recovery}
time:   00:23:54
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271146/

[7271147] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:14:03
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271147/

[7271148] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_adoption}
time:   00:17:10
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271148/

[7271149] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/set-chunks-read}
time:   00:17:46
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271149/

[7271150] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
time:   00:11:05
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271150/

[7271151] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:48
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271151/

[7271152] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/insights}
time:   00:15:25
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271152/

[7271153] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:18:48
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271153/

[7271154] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch}
time:   00:21:51
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271154/

[7271155] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:11:16
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271155/

[7271156] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
time:   00:25:29
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271156/

[7271157] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:25:03
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271157/

[7271158] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}}
time:   00:24:04
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271158/

[7271159] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced}
time:   00:22:18
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271159/

[7271160] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/erasure-code}
time:   01:23:47
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271160/

[7271161] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:33:53
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271161/

[7271162] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm}
time:   00:19:22
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271162/

[7271163] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:29:30
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271163/

[7271164] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
time:   00:39:46
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271164/

[7271165] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
time:   00:23:12
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271165/

[7271166] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:19:26
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271166/

[7271167] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}
time:   00:21:33
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271167/

[7271168] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-localized}
time:   00:22:46
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271168/

[7271169] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:15:04
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271169/

[7271170] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:17:36
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271170/

[7271171] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
time:   00:11:28
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271171/

[7271172] rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
time:   00:15:01
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271172/

[7271173] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:17:27
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271173/

[7271176] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:14:55
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271176/

[7271177] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench}
time:   01:22:18
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271177/

[7271178] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/small-objects}
time:   00:21:12
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271178/

[7271179] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/sync workloads/rados_5925}
time:   00:12:01
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271179/

[7271180] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_repos}
time:   00:07:52
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271180/

[7271181] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_striper}
time:   00:10:19
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271181/

[7271182] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:23:11
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271182/

[7271183] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews}
time:   00:10:44
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271183/

[7271185] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_20.04} tasks/module_selftest}
time:   00:27:37
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271185/

[7271186] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:29:01
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271186/

[7271187] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}}
time:   00:19:03
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271187/

[7271188] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final}
time:   00:19:34
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271188/

[7271189] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:19:14
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271189/

[7271190] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr}
time:   00:18:01
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271190/

[7271191] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:19:06
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271191/

[7271193] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:17:34
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271193/

[7271194] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write}
time:   00:11:29
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271194/

[7271195] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:13
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271195/

[7271196] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized}
time:   00:29:24
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271196/

[7271199] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:15:53
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271199/

[7271200] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:20:06
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271200/

[7271201] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
time:   00:21:36
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271201/

[7271202] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}
time:   00:33:05
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271202/

[7271203] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:35:53
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271203/

[7271204] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:16
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271204/

[7271205] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects}
time:   00:29:48
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271205/

[7271206] rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:16:04
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271206/

[7271207] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} tasks/rados_workunit_loadgen_big}
time:   00:32:26
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271207/

[7271208] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:24:56
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271208/

[7271217] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:31:15
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271217/

[7271218] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:19:33
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271218/

[7271219] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}}
time:   00:13:59
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271219/

[7271221] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc}
time:   01:05:42
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271221/

[7271224] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:13:16
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271224/

[7271225] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced}
time:   00:35:07
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271225/

[7271226] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:34:41
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271226/

[7271227] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}}
time:   00:20:03
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271227/

[7271228] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix}
time:   00:22:57
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271228/

[7271229] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}}
time:   00:36:06
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271229/

[7271231] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/cache-agent-big}
time:   00:16:55
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271231/

[7271232] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:32:48
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271232/

[7271233] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:35:30
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271233/

[7271234] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}
time:   00:29:03
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271234/

[7271235] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
time:   00:19:18
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271235/

[7271236] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:28:55
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271236/

[7271237] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio}
time:   00:13:11
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271237/

[7271238] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:14:36
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271238/

[7271239] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-small}
time:   00:16:45
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271239/

[7271240] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}}
time:   00:33:34
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271240/

[7271241] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_20.04} tasks/progress}
time:   00:22:17
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271241/

[7271242] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli_mon}
time:   00:39:15
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271242/

[7271244] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:15:08
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271244/

[7271248] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:15:22
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271248/

[7271249] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}}
time:   00:25:51
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271249/

[7271251] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread}
time:   00:28:55
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271251/

[7271252] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/dashboard}
time:   01:22:45
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271252/

[7271255] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon-stretch}
time:   00:20:52
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271255/

[7271259] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench}
time:   00:11:42
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271259/

[7271261] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:15:05
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271261/

[7271262] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read}
time:   00:23:44
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271262/

[7271263] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:40:14
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271263/

[7271264] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final}
time:   00:12:45
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271264/

[7271265] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
time:   00:41:57
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271265/

[7271266] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:19:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271266/

[7271267] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04}}
time:   01:11:20
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271267/

[7271268] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced}
time:   00:28:21
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271268/

[7271269] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:14:49
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271269/

[7271270] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:32:04
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271270/

[7271278] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/readwrite}
time:   00:15:15
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271278/

[7271279] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:14:54
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271279/

[7271280] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
time:   00:12:42
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271280/

[7271283] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}}
time:   00:30:45
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271283/

[7271284] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon}
time:   01:10:18
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271284/

[7271285] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache}
time:   00:19:57
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271285/

[7271294] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:31:41
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271294/

[7271295] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:20:54
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271295/

[7271296] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
time:   00:16:56
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271296/

[7271302] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/dedup-io-snaps}
time:   00:21:54
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271302/

[7271305] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
time:   00:21:06
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271305/

[7271313] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}}
time:   00:11:57
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271313/

[7271315] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:09:47
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271315/

[7271317] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/osd-backfill}
time:   02:40:45
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271317/

[7271329] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos}
time:   00:03:46
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271329/

[7271330] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04}}
time:   00:17:57
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271330/

[7271332] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:37:43
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271332/

[7271333] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-small-objects}
time:   00:21:30
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271333/

[7271335] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/crash}
time:   00:14:17
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271335/

[7271337] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:10:00
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271337/

[7271338] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:21:24
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271338/

[7271340] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:26:01
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271340/

[7271341] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}}
time:   00:11:10
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271341/

[7271342] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:16:19
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271342/

[7271343] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:32
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271343/

[7271344] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench}
time:   01:09:54
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271344/

[7271345] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:18:16
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271345/

[7271346] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind}
time:   00:48:42
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271346/

[7271347] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final}
time:   00:16:18
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271347/

[7271348] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:36
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271348/

[7271349] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:13:07
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271349/

[7271350] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd}
time:   02:43:02
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271350/

[7271351] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} tasks/libcephsqlite}
time:   00:15:20
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271351/

[7271352] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_20.04}}
time:   00:13:47
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271352/

[7271353] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect}
time:   00:18:18
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271353/

[7271354] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:21:48
info:   http://pulpito.ceph.com/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271354/