2023-04-21T01:15:33.156 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae 2023-04-21T01:15:33.157 INFO:teuthology.results:subset: '111/12000' 2023-04-21T01:15:33.157 INFO:teuthology.results:seed: '9022' 2023-04-21T12:04:25.101 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae 2023-04-21T12:04:25.126 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-04-21T18:13:02.544 INFO:teuthology.results:Tests finished! gathering results... 2023-04-21T18:13:33.821 INFO:scrape:Found 392 jobs 2023-04-21T18:13:37.676 INFO:scrape:Found 11 distinct failure reasons 2023-04-21T18:13:37.677 INFO:scrape:Failure: No module named 'tasks.osd_recovery' 2023-04-21T18:13:37.678 INFO:scrape:3 jobs: ['7246854', '7246853', '7246827'] 2023-04-21T18:13:37.679 INFO:scrape:suites intersection: [] 2023-04-21T18:13:37.680 INFO:scrape:suites union: ['0-nvme-loop', '1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'agent/off', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun', 'rados/singleton/{all/osd-recovery', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'start}', 'supported-random-distro$/{ubuntu_20.04}}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/small-objects-localized}'] 2023-04-21T18:13:37.680 INFO:scrape: 2023-04-21T18:13:37.681 INFO:scrape:Failure: {'smithi148.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools': Yum repo downloading error: Downloading error(s): repodata/144bb6d03f4cceafda5d5248f92ece7a8539e8858d490dfec5ebeb61d487bb20-filelists.xml.gz - Cannot download, all mirrors were already tried without success; repodata/38c2c78c3f89e4d347f07263805d33d8ae17df60ebab2e8a259218c57bcae2fb-comps-PowerTools.x86_64.xml - Cannot download, all mirrors were already tried without success", 'rc': 1, 'results': []}} 2023-04-21T18:13:37.681 INFO:scrape:6 jobs: ['7246581', '7246689', '7246510', '7246509', '7246628', '7246725'] 2023-04-21T18:13:37.682 INFO:scrape:suites intersection: ['rados'] 2023-04-21T18:13:37.682 INFO:scrape:suites union: ['0-size-min-size-overrides/3-size-2-min-size', '1-install/nautilus-v2only', '1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'clusters/{openstack', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'd-balancer/on', 'd-thrash/none', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/verify/{centos_latest', 'supported-random-distro$/{centos_8}', 'tasks/mon_recovery', 'tasks/scrub_test}', 'thrashers/morepggrow', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'validater/valgrind}', 'workloads/cache-pool-snaps-readproxy}', 'workloads/cache-snaps}', 'workloads/set-chunks-read}', 'workloads/snaps-few-objects}'] 2023-04-21T18:13:37.683 INFO:scrape: 2023-04-21T18:13:37.683 INFO:scrape:Failure: Command failed on smithi155 with status 1: 'sudo yum install -y kernel' 2023-04-21T18:13:37.684 INFO:scrape:15 jobs: ['7246584', '7246633', '7246783', '7246596', '7246821', '7246826', '7246820', '7246489', '7246795', '7246684', '7246823', '7246634', '7246587', '7246843', '7246837'] 2023-04-21T18:13:37.684 INFO:scrape:suites intersection: [] 2023-04-21T18:13:37.685 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '0-size-min-size-overrides/2-size-2-min-size', '0-size-min-size-overrides/3-size-2-min-size', '1-install/octopus', '1-install/quincy', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '1-rook', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-partial-recovery}', '2-workload/none', '2-workload/radosbench', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'agent/off', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'cluster/1-node', 'cluster/3-node', 'clusters/3-mons', 'clusters/{fixed-2', 'clusters/{fixed-4', 'clusters/{openstack', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'debug/mgr', 'fast/fast', 'k8s/1.21', 'mgr_ttl_cache/enable', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/mon-delay', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v2only', 'net/calico', 'net/flannel', 'net/host', 'no_pools', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/multimon/{clusters/21', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'random-objectstore$/{bluestore-stupid}', 'recovery-overrides/{default}', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'rook/1.7.2}', 'rook/master}', 'supported-random-distro$/{centos_8}', 'task/test_adoption}', 'tasks/failover}', 'tasks/mon_clock_no_skews}', 'thrashers/careful', 'thrashers/default', 'thrashers/fastread', 'thrashers/force-sync-many', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-small-objects-overwrites}', 'workloads/pool-create-delete}', 'workloads/pool-snaps-few-objects}', 'workloads/rados_api_tests}', 'workloads/radosbench}'] 2023-04-21T18:13:37.686 INFO:scrape: 2023-04-21T18:13:37.686 INFO:scrape:Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi174 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00b255430fedb8268eb6b32ef7e6e87304d08d4b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' 2023-04-21T18:13:37.687 INFO:scrape:2 jobs: ['7246594', '7246652'] 2023-04-21T18:13:37.687 INFO:scrape:suites intersection: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'rados', 'test_envlibrados_for_rocksdb}'] 2023-04-21T18:13:37.687 INFO:scrape:suites union: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{ubuntu_latest}}', 'test_envlibrados_for_rocksdb}'] 2023-04-21T18:13:37.688 INFO:scrape: 2023-04-21T18:13:37.688 INFO:scrape:Failure: Command failed on smithi158 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52ffc624-e01b-11ed-9b00-001a4aab830c -- ceph mon dump -f json' 2023-04-21T18:13:37.689 INFO:scrape:1 jobs: ['7246687'] 2023-04-21T18:13:37.689 INFO:scrape:suites: ['0-start', '1-tasks', 'mon_election/connectivity', 'rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default'] 2023-04-21T18:13:37.690 INFO:scrape: 2023-04-21T18:13:37.690 INFO:scrape:Dead: b'2023-04-21T13:51:32.408 DEBUG:teuthology.exit:Finished running handlers' 2023-04-21T18:13:37.691 INFO:scrape:4 jobs: ['7246498', '7246490', '7246611', '7246685'] 2023-04-21T18:13:37.691 INFO:scrape:suites intersection: ['rados'] 2023-04-21T18:13:37.692 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/none', 'msgr-failures/osd-dispatch-delay', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/singleton/{all/thrash-eio', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'recovery-overrides/{default}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{ubuntu_20.04}', 'supported-random-distro$/{ubuntu_20.04}}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}'] 2023-04-21T18:13:37.693 INFO:scrape: 2023-04-21T18:13:37.693 INFO:scrape:Failure: Command failed (workunit test cephadm/test_repos.sh) on smithi093 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00b255430fedb8268eb6b32ef7e6e87304d08d4b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' 2023-04-21T18:13:37.694 INFO:scrape:3 jobs: ['7246663', '7246514', '7246840'] 2023-04-21T18:13:37.694 INFO:scrape:suites intersection: ['agent/off', 'mon_election/classic', 'task/test_cephadm_repos}'] 2023-04-21T18:13:37.695 INFO:scrape:suites union: ['agent/off', 'mon_election/classic', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_cephadm_repos}'] 2023-04-21T18:13:37.696 INFO:scrape: 2023-04-21T18:13:37.696 INFO:scrape:Failure: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' 2023-04-21T18:13:37.697 INFO:scrape:2 jobs: ['7246599', '7246794'] 2023-04-21T18:13:37.698 INFO:scrape:suites intersection: ['rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{ubuntu_latest}}'] 2023-04-21T18:13:37.698 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{ubuntu_latest}}'] 2023-04-21T18:13:37.699 INFO:scrape: 2023-04-21T18:13:37.699 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00b255430fedb8268eb6b32ef7e6e87304d08d4b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-04-21T18:13:37.700 INFO:scrape:2 jobs: ['7246781', '7246586'] 2023-04-21T18:13:37.701 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}'] 2023-04-21T18:13:37.701 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-zlib}', 'random-objectstore$/{bluestore-comp-zstd}', 'tasks/e2e}'] 2023-04-21T18:13:37.702 INFO:scrape: 2023-04-21T18:13:37.703 INFO:scrape:Failure: Command failed on smithi167 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3526-g00b25543-1jammy ceph-mds=18.0.0-3526-g00b25543-1jammy ceph-common=18.0.0-3526-g00b25543-1jammy ceph-fuse=18.0.0-3526-g00b25543-1jammy ceph-test=18.0.0-3526-g00b25543-1jammy radosgw=18.0.0-3526-g00b25543-1jammy python-ceph=18.0.0-3526-g00b25543-1jammy libcephfs1=18.0.0-3526-g00b25543-1jammy libcephfs-java=18.0.0-3526-g00b25543-1jammy libcephfs-jni=18.0.0-3526-g00b25543-1jammy librados2=18.0.0-3526-g00b25543-1jammy librbd1=18.0.0-3526-g00b25543-1jammy rbd-fuse=18.0.0-3526-g00b25543-1jammy' 2023-04-21T18:13:37.703 INFO:scrape:1 jobs: ['7246855'] 2023-04-21T18:13:37.704 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-recovery}', '3-scrub-overrides/{default}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashosds-health', 'workloads/small-objects}'] 2023-04-21T18:13:37.705 INFO:scrape: 2023-04-21T18:13:37.705 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh 2023-04-21T18:13:37.706 INFO:scrape:1 jobs: ['7246741'] 2023-04-21T18:13:37.706 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/osd-dispatch-delay', 'msgr/async-v2only', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/rados_api_tests}'] 2023-04-21T18:13:37.707 INFO:scrape: 2023-04-21T18:13:37.727 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/ failed: 30 dead: 10 running: 0 waiting: 0 queued: 0 passed: 352 Fail ================================================================= [7246489] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:06:11 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246489/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246489/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fdb367aed9ef419d967c36a0f54439b0 Command failed on smithi141 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7246514] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:39:58 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246514/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246514/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f4c1a68af4834a19b056cb4836f3c0ae Command failed (workunit test cephadm/test_repos.sh) on smithi012 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00b255430fedb8268eb6b32ef7e6e87304d08d4b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [7246584] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246584/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246584/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5837ec9e9d6042039a5cfc610153b00e Command failed on smithi155 with status 1: 'sudo yum install -y kernel' [7246586] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/e2e} ----------------------------------------------------------------- time: 02:05:19 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246586/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246586/ sentry: https://sentry.ceph.com/organizations/ceph/?query=679df3d6342b431a8c5ac94e336635a4 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi138 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00b255430fedb8268eb6b32ef7e6e87304d08d4b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7246587] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:06:20 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246587/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246587/ sentry: https://sentry.ceph.com/organizations/ceph/?query=453ae6e52f044e6f8bd10c4ad8fbf8e4 Command failed on smithi103 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7246594] rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 01:52:51 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246594/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246594/ sentry: https://sentry.ceph.com/organizations/ceph/?query=02d96994400a4ef19414a5091b109b8f Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi174 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00b255430fedb8268eb6b32ef7e6e87304d08d4b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7246596] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246596/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246596/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4a7bcb38b2c44c7f8d7599365a5eda2c Command failed on smithi072 with status 1: 'sudo yum install -y kernel' [7246599] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:10:41 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246599/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246599/ sentry: https://sentry.ceph.com/organizations/ceph/?query=09a9e12a91b643408ef0f2d31b911730 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7246633] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246633/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246633/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b643f9b846b540a4a46b79d5b97f0150 Command failed on smithi114 with status 1: 'sudo yum install -y kernel' [7246634] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246634/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246634/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc1e1a4ce5324864a1cf04c4f100a070 Command failed on smithi097 with status 1: 'sudo yum install -y kernel' [7246652] rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest test_envlibrados_for_rocksdb} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:55 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246652/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246652/ sentry: https://sentry.ceph.com/organizations/ceph/?query=77eb802b98894557af30c461bddfb9f1 Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi150 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00b255430fedb8268eb6b32ef7e6e87304d08d4b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7246663] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:09:12 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246663/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246663/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6bc43c864ac345f6875aa2576a86ffed Command failed (workunit test cephadm/test_repos.sh) on smithi093 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00b255430fedb8268eb6b32ef7e6e87304d08d4b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [7246684] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:06:14 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246684/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246684/ sentry: https://sentry.ceph.com/organizations/ceph/?query=695bfec95cb24c869f4c0a442a3415b4 Command failed on smithi186 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7246687] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 01:32:04 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246687/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246687/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1cb1243e3c4c4d1a9c7d5fbf545f097b Command failed on smithi158 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52ffc624-e01b-11ed-9b00-001a4aab830c -- ceph mon dump -f json' [7246741] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 03:16:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246741/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246741/ sentry: https://sentry.ceph.com/organizations/ceph/?query=449f054c4bef467da4c93106cb9a0744 Command failed (workunit test rados/test.sh) on smithi087 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00b255430fedb8268eb6b32ef7e6e87304d08d4b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [7246781] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} tasks/e2e} ----------------------------------------------------------------- time: 02:07:40 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246781/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246781/ sentry: https://sentry.ceph.com/organizations/ceph/?query=27f830b47a6e41f8841400f680f84740 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00b255430fedb8268eb6b32ef7e6e87304d08d4b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7246783] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:06:36 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246783/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246783/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b76825b57b4d4d25a595701d95384213 Command failed on smithi097 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7246794] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:10:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246794/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246794/ sentry: https://sentry.ceph.com/organizations/ceph/?query=951d07e920cc455f8b09a0b343206180 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' [7246795] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246795/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246795/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b629369ffec64a0d8e720e1195f31a72 Command failed on smithi073 with status 1: 'sudo yum install -y kernel' [7246820] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/pool-create-delete} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246820/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246820/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0b7935fc17f54f568d0c757da8a85c83 Command failed on smithi178 with status 1: 'sudo yum install -y kernel' [7246821] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/failover} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246821/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246821/ sentry: https://sentry.ceph.com/organizations/ceph/?query=46126d58110241b989a82c1ec964e528 Command failed on smithi061 with status 1: 'sudo yum install -y kernel' [7246823] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} ----------------------------------------------------------------- time: 01:19:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246823/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246823/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d608ddd140ad4cce991d18a381f721dc Command failed on smithi184 with status 1: 'sudo yum -y install cephfs- java' [7246826] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 01:13:20 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246826/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246826/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3512c74fae154c78b26aebac496f6d6e Command failed on smithi023 with status 1: 'sudo yum -y install cephfs- java' [7246827] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:38:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246827/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246827/ sentry: https://sentry.ceph.com/organizations/ceph/?query=93de0d8909f547c6921fea51f25b3d74 No module named 'tasks.nvme_loop' [7246837] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246837/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246837/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e9fea7f196f84b8ea98adc82d6d9a899 Command failed on smithi187 with status 1: 'sudo yum install -y kernel' [7246840] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:41:48 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246840/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246840/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff3f76204ec04c9eb63e4bff36811844 Command failed (workunit test cephadm/test_repos.sh) on smithi081 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00b255430fedb8268eb6b32ef7e6e87304d08d4b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [7246843] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246843/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246843/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cd60e089390f4fcf80dcb4c669b67d4b Command failed on smithi173 with status 1: 'sudo yum install -y kernel' [7246853] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-localized} ----------------------------------------------------------------- time: 00:11:31 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246853/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246853/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1e6443b2ebe14307a3ee5945eccb0080 No module named 'tasks.rados' [7246854] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}} ----------------------------------------------------------------- time: 00:08:32 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246854/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246854/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7426fb8d20e746f68b4963d84c9274d6 No module named 'tasks.osd_recovery' [7246855] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects} ----------------------------------------------------------------- time: 00:07:42 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246855/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246855/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bd03c3bbd3494299af66431068537e3b Command failed on smithi167 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3526-g00b25543-1jammy ceph-mds=18.0.0-3526-g00b25543-1jammy ceph-common=18.0.0-3526-g00b25543-1jammy ceph- fuse=18.0.0-3526-g00b25543-1jammy ceph-test=18.0.0-3526-g00b25543-1jammy radosgw=18.0.0-3526-g00b25543-1jammy python- ceph=18.0.0-3526-g00b25543-1jammy libcephfs1=18.0.0-3526-g00b25543-1jammy libcephfs-java=18.0.0-3526-g00b25543-1jammy libcephfs- jni=18.0.0-3526-g00b25543-1jammy librados2=18.0.0-3526-g00b25543-1jammy librbd1=18.0.0-3526-g00b25543-1jammy rbd-fuse=18.0.0-3526-g00b25543-1jammy' Dead ================================================================= [7246490] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246490/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246490/ hit max job timeout [7246498] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246498/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246498/ hit max job timeout [7246509] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:23:37 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246509/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246509/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d1b1e9550aaf43f29f09ce600fa2dbd6 {'smithi184.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools': Yum repo downloading error: Downloading error(s): repodata/e830a7a4e881ef24 680d161802ae07874dd447031dd12d47f2d3d4a911245522-primary.xml.gz - Cannot download, all mirrors were already tried without success; repodata/38c2c78c3f89e4d347f07263805d33d8ae17df60ebab2e8a259218c57bcae2fb- comps-PowerTools.x86_64.xml - Cannot download, all mirrors were already tried without success", 'rc': 1, 'results': []}, 'smithi187.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools': Yum repo downloading error: Downloading error(s): repodata/655edd281b923f12 af44ba71f23c34741aa8dae0a29e712e75d96be8787f7115-modules.yaml.xz - Cannot download, all mirrors were already tried without success", 'rc': 1, 'results': []}} [7246510] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} ----------------------------------------------------------------- time: 00:36:10 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246510/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246510/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2617fcb8ff094d309b2182e5e96463cd {'smithi144.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools': Yum repo downloading error: Downloading error(s): repodata/e830a7a4e881ef24 680d161802ae07874dd447031dd12d47f2d3d4a911245522-primary.xml.gz - Cannot download, all mirrors were already tried without success; repodata/144bb6d0 3f4cceafda5d5248f92ece7a8539e8858d490dfec5ebeb61d487bb20-filelists.xml.gz - Cannot download, all mirrors were already tried without success; repodata/38c2c78c3f89e4d347f07263805d33d8ae17df60ebab2e8a259218c57bcae2fb- comps-PowerTools.x86_64.xml - Cannot download, all mirrors were already tried without success", 'rc': 1, 'results': []}} [7246581] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/scrub_test} ----------------------------------------------------------------- time: 00:36:18 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246581/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246581/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2b5206623bc142ada1c844fa1acd18bc {'smithi148.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools': Yum repo downloading error: Downloading error(s): repodata/144bb6d03f4cceaf da5d5248f92ece7a8539e8858d490dfec5ebeb61d487bb20-filelists.xml.gz - Cannot download, all mirrors were already tried without success; repodata/38c2c78c3f89e4d347f07263805d33d8ae17df60ebab2e8a259218c57bcae2fb- comps-PowerTools.x86_64.xml - Cannot download, all mirrors were already tried without success", 'rc': 1, 'results': []}} [7246611] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246611/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246611/ hit max job timeout [7246628] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} ----------------------------------------------------------------- time: 00:36:36 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246628/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246628/ sentry: https://sentry.ceph.com/organizations/ceph/?query=06a95ba9265945e9a787cad3baf20498 {'smithi100.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools': Yum repo downloading error: Downloading error(s): repodata/38c2c78c3f89e4d347f07263805d33d8ae17df60ebab2e8a259218c57bcae2fb- comps-PowerTools.x86_64.xml - Cannot download, all mirrors were already tried without success", 'rc': 1, 'results': []}} [7246685] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246685/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246685/ hit max job timeout [7246689] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:40:41 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246689/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246689/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a1a3e45ddc454747a19e2539e3ea0c20 {'smithi174.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools': Yum repo downloading error: Downloading error(s): repodata/e830a7a4e881ef24 680d161802ae07874dd447031dd12d47f2d3d4a911245522-primary.xml.gz - Cannot download, all mirrors were already tried without success; repodata/38c2c78c3f89e4d347f07263805d33d8ae17df60ebab2e8a259218c57bcae2fb- comps-PowerTools.x86_64.xml - Cannot download, all mirrors were already tried without success", 'rc': 1, 'results': []}, 'smithi130.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools': Yum repo downloading error: Downloading error(s): repodata/144bb6d03f4cceaf da5d5248f92ece7a8539e8858d490dfec5ebeb61d487bb20-filelists.xml.gz - Cannot download, all mirrors were already tried without success", 'rc': 1, 'results': []}} [7246725] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:23:42 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246725/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246725/ sentry: https://sentry.ceph.com/organizations/ceph/?query=92582c64193a4682a04e29c490079fa4 {'smithi005.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools': Yum repo downloading error: Downloading error(s): repodata/144bb6d03f4cceaf da5d5248f92ece7a8539e8858d490dfec5ebeb61d487bb20-filelists.xml.gz - Cannot download, all mirrors were already tried without success; repodata/38c2c78c3f89e4d347f07263805d33d8ae17df60ebab2e8a259218c57bcae2fb- comps-PowerTools.x86_64.xml - Cannot download, all mirrors were already tried without success", 'rc': 1, 'results': []}, 'smithi049.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools': Yum repo downloading error: Downloading error(s): repodata/655edd281b923f12 af44ba71f23c34741aa8dae0a29e712e75d96be8787f7115-modules.yaml.xz - Cannot download, all mirrors were already tried without success", 'rc': 1, 'results': []}} Pass ================================================================= [7246476] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm} time: 00:19:14 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246476/ [7246477] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:11:01 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246477/ [7246478] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 01:29:46 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246478/ [7246479] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:32:11 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246479/ [7246480] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:34:10 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246480/ [7246481] rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:11:06 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246481/ [7246482] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} time: 00:34:42 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246482/ [7246483] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:46:18 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246483/ [7246484] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:40:34 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246484/ [7246485] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} tasks/dashboard} time: 02:28:50 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246485/ [7246486] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{rhel_8} tasks/crash} time: 00:18:09 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246486/ [7246487] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:45:49 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246487/ [7246488] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:14:23 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246488/ [7246491] rados/standalone/{supported-random-distro$/{centos_8} workloads/c2c} time: 01:08:06 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246491/ [7246492] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 02:45:26 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246492/ [7246493] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 01:42:16 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246493/ [7246494] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:29:58 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246494/ [7246495] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench} time: 02:05:14 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246495/ [7246496] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:34:39 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246496/ [7246497] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:21:42 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246497/ [7246499] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:08 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246499/ [7246500] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:47:25 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246500/ [7246501] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:20:23 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246501/ [7246502] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:20:36 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246502/ [7246503] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246503/ [7246504] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:18 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246504/ [7246505] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:12:02 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246505/ [7246506] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:14:32 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246506/ [7246507] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:22:03 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246507/ [7246508] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:10:21 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246508/ [7246511] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:10:48 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246511/ [7246512] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:31:58 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246512/ [7246513] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:38 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246513/ [7246515] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:22:02 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246515/ [7246516] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:10:37 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246516/ [7246517] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:22:57 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246517/ [7246518] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} time: 00:32:36 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246518/ [7246519] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:30:42 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246519/ [7246520] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:45:47 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246520/ [7246521] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:23 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246521/ [7246522] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:31:30 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246522/ [7246523] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:15:31 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246523/ [7246524] rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04}} time: 00:14:21 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246524/ [7246525] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_20.04} tasks/failover} time: 00:13:14 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246525/ [7246526] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:31:13 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246526/ [7246527] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 01:40:05 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246527/ [7246528] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/crush} time: 00:20:40 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246528/ [7246529] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 01:34:41 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246529/ [7246530] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:27:46 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246530/ [7246531] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 01:49:14 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246531/ [7246532] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 01:28:49 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246532/ [7246533] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:19:13 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246533/ [7246534] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:25:32 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246534/ [7246535] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 01:51:29 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246535/ [7246536] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:52 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246536/ [7246537] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:47:28 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246537/ [7246538] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 01:06:29 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246538/ [7246539] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246539/ [7246540] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:11 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246540/ [7246541] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 01:41:04 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246541/ [7246542] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:26:16 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246542/ [7246543] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 01:40:11 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246543/ [7246544] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 01:31:56 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246544/ [7246545] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:20:08 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246545/ [7246546] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_nfs} time: 00:30:21 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246546/ [7246547] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:54 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246547/ [7246548] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:10:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246548/ [7246549] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:27:05 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246549/ [7246550] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:15:15 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246550/ [7246551] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 01:45:23 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246551/ [7246552] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:23:24 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246552/ [7246553] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:52 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246553/ [7246554] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 01:30:29 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246554/ [7246555] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/repair_test} time: 01:14:27 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246555/ [7246556] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:34:32 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246556/ [7246557] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:58 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246557/ [7246558] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/cache} time: 00:13:26 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246558/ [7246559] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:20:32 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246559/ [7246560] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/dedup-io-mixed} time: 00:11:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246560/ [7246561] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:10:48 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246561/ [7246562] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/sync workloads/pool-create-delete} time: 00:15:29 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246562/ [7246563] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:23 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246563/ [7246564] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{rhel_8} tasks/insights} time: 00:24:35 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246564/ [7246565] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/dedup-io-snaps} time: 01:31:32 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246565/ [7246566] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:22 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246566/ [7246567] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:37:26 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246567/ [7246568] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/erasure-code} time: 01:25:01 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246568/ [7246569] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli} time: 00:26:45 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246569/ [7246570] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 00:28:14 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246570/ [7246571] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 01:30:35 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246571/ [7246572] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:31:32 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246572/ [7246573] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:28:10 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246573/ [7246574] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:18:41 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246574/ [7246575] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 01:32:58 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246575/ [7246576] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench} time: 00:31:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246576/ [7246577] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 01:42:36 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246577/ [7246578] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:35 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246578/ [7246579] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:12:35 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246579/ [7246580] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:15:28 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246580/ [7246582] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:16:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246582/ [7246583] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:12:22 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246583/ [7246585] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:35:46 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246585/ [7246588] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:12 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246588/ [7246589] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:16:36 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246589/ [7246590] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:24:46 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246590/ [7246591] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:16:20 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246591/ [7246592] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 01:39:49 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246592/ [7246593] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 03:21:26 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246593/ [7246595] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli_mon} time: 00:36:23 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246595/ [7246597] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:21:23 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246597/ [7246598] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:33:54 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246598/ [7246600] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:38:21 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246600/ [7246601] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:16:45 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246601/ [7246602] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:26:55 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246602/ [7246603] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:59:05 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246603/ [7246604] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:21:46 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246604/ [7246605] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:27:18 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246605/ [7246606] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_5925} time: 00:15:38 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246606/ [7246607] rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/mgr} time: 00:16:02 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246607/ [7246608] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 01:48:02 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246608/ [7246609] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_rgw_multisite} time: 01:40:13 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246609/ [7246610] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:14:09 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246610/ [7246612] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:30:05 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246612/ [7246613] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/libcephsqlite} time: 01:11:45 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246613/ [7246614] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:21:55 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246614/ [7246615] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:12:28 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246615/ [7246616] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:22:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246616/ [7246617] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:19:56 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246617/ [7246618] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:29:15 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246618/ [7246619] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:22 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246619/ [7246620] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 01:36:52 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246620/ [7246621] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}} time: 00:20:24 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246621/ [7246622] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:23:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246622/ [7246623] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:35:39 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246623/ [7246624] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:08 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246624/ [7246625] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246625/ [7246626] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:16:45 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246626/ [7246627] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:34:04 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246627/ [7246629] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 01:38:21 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246629/ [7246630] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:40:20 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246630/ [7246631] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:26:04 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246631/ [7246632] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 01:48:03 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246632/ [7246635] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 01:35:18 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246635/ [7246636] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:23:07 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246636/ [7246637] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/per_module_finisher_stats} time: 00:11:30 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246637/ [7246638] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 01:39:08 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246638/ [7246639] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:25:24 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246639/ [7246640] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:11:10 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246640/ [7246641] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246641/ [7246642] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:20:36 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246642/ [7246643] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:17:17 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246643/ [7246644] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} tasks/rados_api_tests} time: 00:27:55 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246644/ [7246645] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:10:47 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246645/ [7246646] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/dedup-io-mixed} time: 00:12:35 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246646/ [7246647] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} time: 01:08:09 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246647/ [7246648] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_api_tests} time: 00:36:10 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246648/ [7246649] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:52:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246649/ [7246650] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/dedup-io-snaps} time: 00:13:32 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246650/ [7246651] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:26:33 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246651/ [7246653] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} time: 00:25:30 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246653/ [7246654] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:34 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246654/ [7246655] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/rados_api_tests} time: 00:27:23 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246655/ [7246656] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} time: 00:27:04 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246656/ [7246657] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:39:04 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246657/ [7246658] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} time: 00:25:05 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246658/ [7246659] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 01:28:58 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246659/ [7246660] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 02:29:23 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246660/ [7246661] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench} time: 00:48:16 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246661/ [7246662] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:28:17 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246662/ [7246664] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect} time: 00:20:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246664/ [7246665] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 01:47:43 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246665/ [7246666] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:39 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246666/ [7246667] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} time: 00:12:48 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246667/ [7246668] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 01:39:03 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246668/ [7246669] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:22 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246669/ [7246670] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:18 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246670/ [7246671] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 01:12:40 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246671/ [7246672] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_set_object} time: 01:38:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246672/ [7246673] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:52:13 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246673/ [7246674] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:26:47 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246674/ [7246675] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:27 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246675/ [7246676] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/set-chunks-read} time: 01:37:35 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246676/ [7246677] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 01:30:20 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246677/ [7246678] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 02:08:56 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246678/ [7246679] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:14:36 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246679/ [7246680] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} time: 00:22:49 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246680/ [7246681] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:47:18 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246681/ [7246682] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:23:09 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246682/ [7246683] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/dashboard} time: 02:25:11 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246683/ [7246686] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon-stretch} time: 00:22:25 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246686/ [7246688] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects} time: 00:26:43 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246688/ [7246690] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 01:32:46 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246690/ [7246691] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 01:27:43 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246691/ [7246692] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 01:46:32 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246692/ [7246693] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/one workloads/rados_mon_osdmap_prune} time: 00:54:56 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246693/ [7246694] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:29:38 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246694/ [7246695] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:01 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246695/ [7246696] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:33:48 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246696/ [7246697] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:17:35 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246697/ [7246698] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:32 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246698/ [7246699] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:18:42 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246699/ [7246700] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 01:34:40 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246700/ [7246701] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_python} time: 01:10:47 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246701/ [7246702] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 01:50:59 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246702/ [7246703] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:21:18 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246703/ [7246704] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:31:27 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246704/ [7246705] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:46:12 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246705/ [7246706] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big} time: 01:41:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246706/ [7246707] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 01:33:14 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246707/ [7246708] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}} time: 00:10:17 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246708/ [7246709] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:46 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246709/ [7246710] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:33 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246710/ [7246711] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/prometheus} time: 01:38:21 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246711/ [7246712] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:19:03 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246712/ [7246713] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:18:19 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246713/ [7246714] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:28:57 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246714/ [7246715] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{rhel_8}} time: 02:20:58 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246715/ [7246716] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:37 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246716/ [7246717] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:23:08 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246717/ [7246718] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 02:08:44 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246718/ [7246719] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:29 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246719/ [7246720] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:27:31 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246720/ [7246721] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_nfs} time: 01:57:35 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246721/ [7246722] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} tasks/mon_recovery} time: 00:12:41 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246722/ [7246723] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 01:42:25 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246723/ [7246724] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}} time: 00:32:50 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246724/ [7246726] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:12:19 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246726/ [7246727] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 01:14:54 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246727/ [7246728] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache} time: 01:37:45 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246728/ [7246729] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 01:04:49 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246729/ [7246730] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:12:52 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246730/ [7246731] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli} time: 01:33:11 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246731/ [7246732] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} time: 00:18:31 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246732/ [7246733] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:19:04 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246733/ [7246734] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_workunits} time: 00:31:16 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246734/ [7246735] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/dedup-io-snaps} time: 01:34:52 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246735/ [7246736] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:47:10 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246736/ [7246737] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:40:15 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246737/ [7246738] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 01:36:57 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246738/ [7246739] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:22:44 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246739/ [7246740] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 01:36:44 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246740/ [7246742] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:31:55 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246742/ [7246743] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:21:19 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246743/ [7246744] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:40:35 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246744/ [7246745] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_20.04} tasks/workunits} time: 00:09:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246745/ [7246746] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04}} time: 00:39:23 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246746/ [7246747] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/radosbench} time: 00:49:16 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246747/ [7246748] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 01:30:52 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246748/ [7246749] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:15:15 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246749/ [7246750] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 01:36:16 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246750/ [7246751] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:12:35 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246751/ [7246752] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:08 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246752/ [7246753] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:10 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246753/ [7246754] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli_mon} time: 00:40:20 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246754/ [7246755] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 01:38:37 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246755/ [7246756] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:51:32 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246756/ [7246757] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:16:52 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246757/ [7246758] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 01:50:21 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246758/ [7246759] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:22 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246759/ [7246760] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:25:01 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246760/ [7246761] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:22 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246761/ [7246762] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 01:02:36 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246762/ [7246763] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:24 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246763/ [7246764] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd-backfill} time: 03:58:12 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246764/ [7246765] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:29:41 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246765/ [7246766] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 01:30:13 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246766/ [7246767] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} time: 01:33:28 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246767/ [7246768] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:10:35 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246768/ [7246769] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:19:46 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246769/ [7246770] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:21:41 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246770/ [7246771] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_8}} time: 01:29:28 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246771/ [7246772] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects} time: 01:41:16 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246772/ [7246773] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 01:30:28 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246773/ [7246774] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:28:43 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246774/ [7246775] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}} time: 00:12:37 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246775/ [7246776] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/sync workloads/snaps-few-objects} time: 00:27:28 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246776/ [7246777] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_rgw_multisite} time: 00:24:51 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246777/ [7246778] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:39:14 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246778/ [7246779] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:12:38 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246779/ [7246780] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:32:35 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246780/ [7246782] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_20.04} tasks/crash} time: 00:11:18 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246782/ [7246784] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:10 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246784/ [7246785] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:20:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246785/ [7246786] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:47:21 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246786/ [7246787] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:14:01 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246787/ [7246788] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 01:43:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246788/ [7246789] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:29:44 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246789/ [7246790] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 01:27:39 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246790/ [7246791] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:24:07 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246791/ [7246792] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 01:41:11 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246792/ [7246793] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:45:59 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246793/ [7246796] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 01:36:38 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246796/ [7246797] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:19:20 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246797/ [7246798] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:16:08 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246798/ [7246799] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:25:11 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246799/ [7246800] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 01:50:01 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246800/ [7246801] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} time: 00:09:58 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246801/ [7246802] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:31:58 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246802/ [7246803] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:00:44 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246803/ [7246804] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:52 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246804/ [7246805] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:20:00 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246805/ [7246806] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:08 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246806/ [7246807] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:12:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246807/ [7246808] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:23:50 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246808/ [7246809] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} time: 02:13:56 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246809/ [7246810] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:21:30 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246810/ [7246811] rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:23:01 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246811/ [7246812] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache} time: 00:18:40 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246812/ [7246813] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:21:21 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246813/ [7246814] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed} time: 01:30:20 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246814/ [7246815] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_20.04}} time: 00:14:38 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246815/ [7246816] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04}} time: 00:35:02 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246816/ [7246817] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} time: 00:18:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246817/ [7246818] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm} time: 01:39:31 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246818/ [7246819] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/dedup-io-snaps} time: 00:17:19 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246819/ [7246822] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:23:18 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246822/ [7246824] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:15:17 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246824/ [7246825] rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{centos_8}} time: 01:25:48 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246825/ [7246828] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 01:45:31 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246828/ [7246829] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 02:14:33 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246829/ [7246830] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:21:21 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246830/ [7246831] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench} time: 00:54:16 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246831/ [7246832] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:59 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246832/ [7246833] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:08 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246833/ [7246834] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 01:37:54 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246834/ [7246835] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect} time: 01:41:41 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246835/ [7246836] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:17 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246836/ [7246838] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:25:34 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246838/ [7246839] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:14:55 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246839/ [7246841] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} time: 02:43:56 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246841/ [7246842] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:37:45 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246842/ [7246844] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 01:48:49 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246844/ [7246845] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:46:19 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246845/ [7246846] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:18:37 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246846/ [7246847] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 01:37:40 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246847/ [7246848] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 01:44:13 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246848/ [7246849] rados/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:22:20 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246849/ [7246850] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:33:59 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246850/ [7246851] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:26:43 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246851/ [7246852] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/lockdep} time: 01:39:42 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246852/ [7246856] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{rhel_8} tasks/insights} time: 00:19:34 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246856/ [7246857] rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 01:43:31 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246857/ [7246858] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:44:47 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246858/ [7246861] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:30:17 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246861/ [7246863] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:10:49 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246863/ [7246864] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_5925} time: 00:19:09 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246864/ [7246865] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:34:31 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246865/ [7246866] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04}} time: 00:09:22 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246866/ [7246867] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:46:46 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246867/ [7246868] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:28:49 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246868/ [7246869] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:55 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246869/ [7246870] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:13:53 info: http://pulpito.ceph.com/yuriw-2023-04-20_14:47:35-rados-wip-yuri-testing-2023-04-19-1343-distro-default-smithi/7246870/