2023-02-15T03:20:49.457 INFO:root:teuthology version: 0.0.1.dev41+gfbbadb5
2023-02-15T03:20:49.458 INFO:teuthology.results:subset: '111/120000'
2023-02-15T03:20:49.458 INFO:teuthology.results:seed: '3481'
2023-02-15T10:29:23.802 INFO:root:teuthology version: 0.0.1.dev41+gfbbadb5
2023-02-15T10:29:23.850 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-02-15T11:41:30.462 INFO:teuthology.results:Tests finished! gathering results...
2023-02-15T11:41:55.613 INFO:scrape:Found 317 jobs
2023-02-15T11:41:57.582 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172833/teuthology.log
2023-02-15T11:42:03.451 INFO:scrape:Found 7 distinct failure reasons
2023-02-15T11:42:03.452 INFO:scrape:Failure: Command failed on smithi173 with status 1: 'sudo yum install -y kernel'
2023-02-15T11:42:03.452 INFO:scrape:140 jobs
2023-02-15T11:42:03.454 INFO:scrape:suites intersection: []
2023-02-15T11:42:03.454 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '0-size-min-size-overrides/2-size-2-min-size', '0-size-min-size-overrides/3-size-2-min-size', '0-start', '1-install/nautilus-v1only', '1-install/octopus', '1-install/pacific', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '1-rook', '1-start', '1-tasks', '2-inject-leak/mon', '2-inject-leak/none', '2-inject-leak/osd', '2-ops/repave-all}', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-ops/rm-zap-wait}', '2-ops/rmdir-reactivate}', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', '2-recovery-overrides/{more-partial-recovery}', '2-services/basic', '2-services/rgw', '2-workload/none', '2-workload/radosbench', '3-final', '3-final}', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'agent/off', 'agent/on', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'centos_latest}', 'ceph', 'cluster/1-node', 'cluster/3-node', 'cluster/{12-osds', 'clusters/3-mons', 'clusters/9-mons', 'clusters/{fixed-2', 'clusters/{fixed-4', 'clusters/{openstack', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'd-thrash/default/{default', 'd-thrash/none', 'debug/mgr', 'fast/fast', 'fast/normal', 'fixed-2', 'k8s/1.21', 'mgr_ttl_cache/disable', 'mgr_ttl_cache/enable', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr-failures/none', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'net/calico', 'net/flannel', 'net/host', 'no_pools', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/cephadm/osds/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun', 'rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun}', 'rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools}', 'rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun', 'rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/dashboard/{0-single-container-host', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/multimon/{clusters/21', 'rados/multimon/{clusters/3', 'rados/multimon/{clusters/6', 'rados/objectstore/{backends/filejournal', 'rados/objectstore/{backends/filestore-idempotent', 'rados/objectstore/{backends/filestore-idempotent-aio-journal', 'rados/objectstore/{backends/objectstore-bluestore-b', 'rados/objectstore/{backends/objectstore-filestore-memstore', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/singleton-nomsgr/{all/balancer', 'rados/singleton-nomsgr/{all/ceph-kvstore-tool', 'rados/singleton-nomsgr/{all/ceph-post-file', 'rados/singleton-nomsgr/{all/full-tiering', 'rados/singleton-nomsgr/{all/health-warnings', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'rados/singleton-nomsgr/{all/librados_hello_world', 'rados/singleton-nomsgr/{all/msgr', 'rados/singleton-nomsgr/{all/osd_stale_reads', 'rados/singleton-nomsgr/{all/pool-access', 'rados/singleton-nomsgr/{all/recovery-unfound-found', 'rados/singleton/{all/backfill-toofull', 'rados/singleton/{all/mon-config', 'rados/singleton/{all/mon-config-keys', 'rados/singleton/{all/osd-recovery', 'rados/singleton/{all/osd-recovery-incomplete', 'rados/singleton/{all/peer', 'rados/singleton/{all/pg-autoscaler-progress-off', 'rados/singleton/{all/pg-removal-interruption', 'rados/singleton/{all/random-eio', 'rados/singleton/{all/rebuild-mondb', 'rados/singleton/{all/recovery-preemption', 'rados/singleton/{all/resolve_stuck_peering', 'rados/singleton/{all/test-noautoscale-flag', 'rados/singleton/{all/thrash-eio', 'rados/singleton/{all/thrash-rados/{thrash-rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'rados/singleton/{all/watch-notify-same-primary', 'rados/standalone/{supported-random-distro$/{centos_8}', 'rados/standalone/{supported-random-distro$/{rhel_8}', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_rhel8}', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'rados_api', 'rados_loadgenbig', 'random-objectstore$/{bluestore-bitmap}', 'random-objectstore$/{bluestore-comp-lz4}', 'random-objectstore$/{bluestore-comp-zlib}', 'random-objectstore$/{bluestore-comp-zstd}', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'rbd_import_export', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'recovery-overrides/{more-partial-recovery}', 'rook/1.7.2}', 'rook/master}', 'start}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'task/test_adoption}', 'task/test_cephadm_repos}', 'task/test_cephadm}', 'task/test_orch_cli_mon}', 'task/test_orch_cli}', 'tasks/crash}', 'tasks/dashboard}', 'tasks/e2e}', 'tasks/failover}', 'tasks/insights}', 'tasks/libcephsqlite}', 'tasks/mon_clock_no_skews}', 'tasks/mon_clock_with_skews}', 'tasks/mon_recovery', 'tasks/mon_recovery}', 'tasks/rados_api_tests', 'tasks/rados_api_tests}', 'tasks/rados_cls_all', 'tasks/rados_cls_all}', 'tasks/rados_workunit_loadgen_big}', 'tasks/rados_workunit_loadgen_mix}', 'tasks/workunits}', 'test_rbd_api', 'test_rbd_python}}', 'thrashers/careful', 'thrashers/default', 'thrashers/fastread', 'thrashers/mapgap', 'thrashers/minsize_recovery', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/one', 'thrashers/pggrow', 'thrashers/sync', 'thrashers/sync-many', 'thrashosds-health', 'thrashosds-health}', 'three-plus-one}', 'upgrade-sequence', 'validater/lockdep}', 'validater/valgrind}', 'workload/{ec-rados-default', 'workloads/c2c}', 'workloads/cache-agent-big}', 'workloads/cache-agent-small}', 'workloads/cache-pool-snaps-readproxy}', 'workloads/cache-pool-snaps}', 'workloads/cache-snaps-balanced}', 'workloads/crush}', 'workloads/dedup-io-mixed}', 'workloads/dedup-io-snaps}', 'workloads/ec-pool-snaps-few-objects-overwrites}', 'workloads/ec-rados-plugin=clay-k=4-m=2}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=3-m=1}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-radosbench}', 'workloads/ec-small-objects-balanced}', 'workloads/ec-small-objects}', 'workloads/erasure-code}', 'workloads/mgr}', 'workloads/osd}', 'workloads/pool-snaps-few-objects}', 'workloads/rados_api_tests}', 'workloads/rados_mon_osdmap_prune}', 'workloads/radosbench-high-concurrency}', 'workloads/radosbench}', 'workloads/redirect_promote_tests}', 'workloads/redirect_set_object}', 'workloads/redirect}', 'workloads/set-chunks-read}', 'workloads/small-objects-balanced}', 'workloads/small-objects-localized}', 'workloads/small-objects}', 'workloads/snaps-few-objects-balanced}', 'workloads/snaps-few-objects-localized}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}']
2023-02-15T11:42:03.455 INFO:scrape:
2023-02-15T11:42:03.455 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi112 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9839dd56836c942b9185baee816ddb2c7166f950 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'
2023-02-15T11:42:03.456 INFO:scrape:1 jobs: ['7173080']
2023-02-15T11:42:03.456 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8', 'task/test_cephadm}']
2023-02-15T11:42:03.456 INFO:scrape:
2023-02-15T11:42:03.456 INFO:scrape:Dead: None
2023-02-15T11:42:03.457 INFO:scrape:1 jobs: ['7172833']
2023-02-15T11:42:03.457 INFO:scrape:
2023-02-15T11:42:03.458 INFO:scrape:Failure: Command failed (workunit test mon/caps.sh) on smithi037 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9839dd56836c942b9185baee816ddb2c7166f950 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh'
2023-02-15T11:42:03.458 INFO:scrape:1 jobs: ['7172821']
2023-02-15T11:42:03.458 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/mon-delay', 'msgr/async', 'objectstore/bluestore-bitmap', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/many', 'workloads/rados_mon_workunits}']
2023-02-15T11:42:03.459 INFO:scrape:
2023-02-15T11:42:03.459 INFO:scrape:Crash: Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_msgr'
2023-02-15T11:42:03.459 INFO:scrape:ceph version 17.2.5-781-g9839dd56 (9839dd56836c942b9185baee816ddb2c7166f950) quincy (stable)
 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f5ac37df420]
 2: gsignal()
 3: abort()
 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b7) [0x7f5ac2c9d834]
 5: /usr/lib/ceph/libceph-common.so.2(+0x27d9de) [0x7f5ac2c9d9de]
 6: /usr/lib/ceph/libceph-common.so.2(+0x5e8999) [0x7f5ac3008999]
 7: (AsyncMessenger::~AsyncMessenger()+0xd) [0x7f5ac30089ad]
 8: (MessengerTest::TearDown()+0x111) [0x559f4d858b41]
 9: (void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*)+0x51) [0x559f4d8ab8f1]
 10: (testing::TestInfo::Run()+0x135) [0x559f4d89e155]
 11: (testing::TestSuite::Run()+0xc9) [0x559f4d89e6e9]
 12: (testing::internal::UnitTestImpl::RunAllTests()+0x487) [0x559f4d89ed17]
 13: (bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*)+0x51) [0x559f4d8abe61]
 14: (testing::UnitTest::Run()+0xa1) [0x559f4d89e221]
 15: main()
 16: __libc_start_main()
 17: _start()
2023-02-15T11:42:03.460 INFO:scrape:1 jobs: ['7173019']
2023-02-15T11:42:03.460 INFO:scrape:suites: ['mon_election/classic', 'rados', 'rados/singleton-nomsgr/{all/msgr', 'supported-random-distro$/{ubuntu_latest}}']
2023-02-15T11:42:03.460 INFO:scrape:
2023-02-15T11:42:03.460 INFO:scrape:Failure: Command failed (workunit test rados/test_librados_build.sh) on smithi188 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9839dd56836c942b9185baee816ddb2c7166f950 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_librados_build.sh'
2023-02-15T11:42:03.461 INFO:scrape:1 jobs: ['7173000']
2023-02-15T11:42:03.461 INFO:scrape:suites: ['mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/librados_hello_world', 'supported-random-distro$/{ubuntu_latest}}']
2023-02-15T11:42:03.461 INFO:scrape:
2023-02-15T11:42:03.462 INFO:scrape:Failure: {'smithi131.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['redhat-lsb-core', 'dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone', 'lvm2'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': 'Failed to download packages: qemu-kvm-block-rbd-15:6.2.0-28.module_el8.8.0+1257+0c3374ae.x86_64: Cannot download, all mirrors were already tried without success', 'results': []}}
2023-02-15T11:42:03.462 INFO:scrape:1 jobs: ['7172536']
2023-02-15T11:42:03.462 INFO:scrape:suites: ['cluster/{12-osds', 'mon_election/connectivity', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/thrash-erasure-code-big/{ceph', 'recovery-overrides/{more-active-recovery}', 'supported-random-distro$/{centos_8}', 'thrashers/fastread', 'thrashosds-health', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}']
2023-02-15T11:42:03.463 INFO:scrape:
2023-02-15T11:42:03.477 INFO:teuthology.results:Sending results to yweinstein@radhat.com: Test Run: yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/
failed:  144
dead:    2
running: 0
waiting: 0
queued:  0
passed:  171


Fail
=================================================================
[7172392]  rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172392/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172392/
sentry: https://sentry.ceph.com/organizations/ceph/?query=169f472b28154831b09bc290066d6171

    Command failed on smithi046 with status 1: 'sudo yum install -y kernel'

[7172394]  rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/off mon_election/classic task/test_cephadm_repos}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172394/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172394/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b9939c546fcd409ea86b648424adbe3c

    Command failed on smithi107 with status 1: 'sudo yum install -y kernel'

[7172396]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172396/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172396/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1ddb481d60e44572814314534a24b065

    Command failed on smithi124 with status 1: 'sudo yum install -y kernel'

[7172398]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172398/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172398/
sentry: https://sentry.ceph.com/organizations/ceph/?query=911b1fd84a784644834e51356d26fa25

    Command failed on smithi037 with status 1: 'sudo yum install -y kernel'

[7172546]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/host rook/master}
-----------------------------------------------------------------
time:   00:06:17
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172546/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172546/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3a896eafa2fc4bc2a05df8d4a65928e9

    Command failed on smithi045 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7172568]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172568/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172568/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8033e2612b3949a09e86316f793a4c9a

    Command failed on smithi090 with status 1: 'sudo yum install -y kernel'

[7172570]  rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172570/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172570/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2572e3e7acd84273880e621a77c07699

    Command failed on smithi173 with status 1: 'sudo yum install -y kernel'

[7172572]  rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172572/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172572/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9be11ade9fa64d9a9a5e73e99bffea06

    Command failed on smithi100 with status 1: 'sudo yum install -y kernel'

[7172576]  rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172576/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172576/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6ceb31caa4814b6d92656511ccc529ba

    Command failed on smithi141 with status 1: 'sudo yum install -y kernel'

[7172578]  rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172578/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172578/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2e00e10085bd41b8858949429c3dd3dc

    Command failed on smithi037 with status 1: 'sudo yum install -y kernel'

[7172580]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172580/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172580/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4d4601d41fef4fd8b025ff5edf064fd6

    Command failed on smithi173 with status 1: 'sudo yum install -y kernel'

[7172582]  rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172582/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172582/
sentry: https://sentry.ceph.com/organizations/ceph/?query=44e7abf740c7400f95ad2d52e185d11d

    Command failed on smithi067 with status 1: 'sudo yum install -y kernel'

[7172584]  rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172584/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172584/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ec0ca5fcaf1c4ed6a40e98d89db87094

    Command failed on smithi029 with status 1: 'sudo yum install -y kernel'

[7172586]  rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_api_tests}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172586/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172586/
sentry: https://sentry.ceph.com/organizations/ceph/?query=626c13eb26084153a74d42db5490420f

    Command failed on smithi102 with status 1: 'sudo yum install -y kernel'

[7172588]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172588/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172588/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fe056d4e5c504ef4b7bbc3149bd81a12

    Command failed on smithi141 with status 1: 'sudo yum install -y kernel'

[7172590]  rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172590/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172590/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a7d059fdcac341ecab95e94d51ba3d69

    Command failed on smithi169 with status 1: 'sudo yum install -y kernel'

[7172592]  rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172592/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172592/
sentry: https://sentry.ceph.com/organizations/ceph/?query=afabaec36d614081bb4cf1e0e8d5b340

    Command failed on smithi042 with status 1: 'sudo yum install -y kernel'

[7172596]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172596/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172596/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ddeffba812634144896014c255130389

    Command failed on smithi176 with status 1: 'sudo yum install -y kernel'

[7172598]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172598/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172598/
sentry: https://sentry.ceph.com/organizations/ceph/?query=44088094836c4cde87c6068e9f4f2115

    Command failed on smithi173 with status 1: 'sudo yum install -y kernel'

[7172602]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-snaps}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172602/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172602/
sentry: https://sentry.ceph.com/organizations/ceph/?query=61cdb80b3e9843a5a0af2ea8a11a28e4

    Command failed on smithi133 with status 1: 'sudo yum install -y kernel'

[7172604]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172604/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172604/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2a92359afd6a425a9781463f462c357d

    Command failed on smithi195 with status 1: 'sudo yum install -y kernel'

[7172606]  rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172606/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172606/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6e09cd5ea3a049d0afaa8f027058b114

    Command failed on smithi102 with status 1: 'sudo yum install -y kernel'

[7172608]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/libcephsqlite}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172608/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172608/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0c159a1d22fc48b0a178b3514bf9de91

    Command failed on smithi085 with status 1: 'sudo yum install -y kernel'

[7172612]  rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172612/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172612/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e4a4b17be86b4749bc5c7343c7e59689

    Command failed on smithi120 with status 1: 'sudo yum install -y kernel'

[7172614]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172614/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172614/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a0e188bb5f4f4803a1305cc79a764959

    Command failed on smithi186 with status 1: 'sudo yum install -y kernel'

[7172616]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172616/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172616/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4d61b736a8dc4e7ebce81d7f8c23f53b

    Command failed on smithi131 with status 1: 'sudo yum install -y kernel'

[7172620]  rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172620/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172620/
sentry: https://sentry.ceph.com/organizations/ceph/?query=82b39ff73725417fa1ecdba1a94647fc

    Command failed on smithi062 with status 1: 'sudo yum install -y kernel'

[7172624]  rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172624/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172624/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7e5624ddb47c4500b164744ca36c7e21

    Command failed on smithi026 with status 1: 'sudo yum install -y kernel'

[7172626]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172626/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172626/
sentry: https://sentry.ceph.com/organizations/ceph/?query=99dd12b275b843d88c786d07c7a9bed0

    Command failed on smithi067 with status 1: 'sudo yum install -y kernel'

[7172628]  rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172628/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172628/
sentry: https://sentry.ceph.com/organizations/ceph/?query=46920090de6e4f94912689e9fac887f6

    Command failed on smithi102 with status 1: 'sudo yum install -y kernel'

[7172634]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/workunits}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172634/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172634/
sentry: https://sentry.ceph.com/organizations/ceph/?query=954af44848a744dea7080cb14071d466

    Command failed on smithi061 with status 1: 'sudo yum install -y kernel'

[7172638]  rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172638/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172638/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e71657d6c187487a8cebfca6a12e1a63

    Command failed on smithi171 with status 1: 'sudo yum install -y kernel'

[7172641]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172641/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172641/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ab1dbf1af1664c298e6fa73a97656f01

    Command failed on smithi102 with status 1: 'sudo yum install -y kernel'

[7172643]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172643/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172643/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c967ffa3f5cb4de7a70ed603565d98e8

    Command failed on smithi120 with status 1: 'sudo yum install -y kernel'

[7172645]  rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172645/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172645/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dbf37717989a4189afadcb357b8d5552

    Command failed on smithi136 with status 1: 'sudo yum install -y kernel'

[7172647]  rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172647/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172647/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5884c562c85c4c529899c70771dadd64

    Command failed on smithi186 with status 1: 'sudo yum install -y kernel'

[7172649]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172649/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172649/
sentry: https://sentry.ceph.com/organizations/ceph/?query=76eefdf675a84ddc81a7acef7b97d7b2

    Command failed on smithi042 with status 1: 'sudo yum install -y kernel'

[7172651]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172651/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172651/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1fa3b936cac940cd8554a7143a16c622

    Command failed on smithi064 with status 1: 'sudo yum install -y kernel'

[7172653]  rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172653/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172653/
sentry: https://sentry.ceph.com/organizations/ceph/?query=aad779a748624a10ab9e24099fe35c09

    Command failed on smithi085 with status 1: 'sudo yum install -y kernel'

[7172655]  rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172655/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172655/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ea9e7db9065341b6b3336725b755a02e

    Command failed on smithi026 with status 1: 'sudo yum install -y kernel'

[7172659]  rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172659/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172659/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a93c12d7f11049d69b2365d85c1411e1

    Command failed on smithi136 with status 1: 'sudo yum install -y kernel'

[7172665]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172665/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172665/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9d403dc2bd4f49abb0bc7b6fec151205

    Command failed on smithi129 with status 1: 'sudo yum install -y kernel'

[7172667]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172667/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172667/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5656b29e673741af8800b2866c4ea874

    Command failed on smithi037 with status 1: 'sudo yum install -y kernel'

[7172669]  rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172669/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172669/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7ad32a25227b41e996349f13fbd2cd52

    Command failed on smithi190 with status 1: 'sudo yum install -y kernel'

[7172671]  rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172671/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172671/
sentry: https://sentry.ceph.com/organizations/ceph/?query=75fd01dc74c44ceeb59d8fe1c8217624

    Command failed on smithi153 with status 1: 'sudo yum install -y kernel'

[7172673]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172673/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172673/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cc63e8a9eb86442a92b4cdf25bfb8d72

    Command failed on smithi186 with status 1: 'sudo yum install -y kernel'

[7172675]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172675/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172675/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7dc92084f4314ad9a793894c386cac74

    Command failed on smithi181 with status 1: 'sudo yum install -y kernel'

[7172680]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172680/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172680/
sentry: https://sentry.ceph.com/organizations/ceph/?query=70474631537a4b1abc23adad04b97a81

    Command failed on smithi085 with status 1: 'sudo yum install -y kernel'

[7172689]  rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172689/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172689/
sentry: https://sentry.ceph.com/organizations/ceph/?query=12b6e8cca5244c28a18c6bfbe6f272fa

    Command failed on smithi104 with status 1: 'sudo yum install -y kernel'

[7172692]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172692/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172692/
sentry: https://sentry.ceph.com/organizations/ceph/?query=182c450cf7f84e419e9acfbd170a9e7d

    Command failed on smithi006 with status 1: 'sudo yum install -y kernel'

[7172695]  rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172695/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172695/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3e5a8159544f43f7bc99d2b3c49c4d13

    Command failed on smithi110 with status 1: 'sudo yum install -y kernel'

[7172699]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_cls_all}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172699/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172699/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f04fb250b8c74240a0b5c4afe94002f3

    Command failed on smithi133 with status 1: 'sudo yum install -y kernel'

[7172702]  rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172702/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172702/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a1ad3ade87424cfdbf79b64994656fff

    Command failed on smithi049 with status 1: 'sudo yum install -y kernel'

[7172705]  rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172705/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172705/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b5a5e788c5924fa8b037be2069e40951

    Command failed on smithi192 with status 1: 'sudo yum install -y kernel'

[7172708]  rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/dashboard}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172708/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172708/
sentry: https://sentry.ceph.com/organizations/ceph/?query=756432785a1146bda0b21e09a02c8bc6

    Command failed on smithi006 with status 1: 'sudo yum install -y kernel'

[7172711]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{rhel_8} tasks/crash}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172711/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172711/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1027a610c9f343c4b54bd1683bffa8a3

    Command failed on smithi002 with status 1: 'sudo yum install -y kernel'

[7172720]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.7.2}
-----------------------------------------------------------------
time:   00:06:11
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172720/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172720/
sentry: https://sentry.ceph.com/organizations/ceph/?query=33502558a8244ca6a586a58bedc52c62

    Command failed on smithi173 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7172723]  rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172723/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172723/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ea9dde7c8b744378afd5283d41ea12fb

    Command failed on smithi116 with status 1: 'sudo yum install -y kernel'

[7172726]  rados/standalone/{supported-random-distro$/{centos_8} workloads/c2c}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172726/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172726/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f926185c6a8a4aa88869f87708ec17f6

    Command failed on smithi090 with status 1: 'sudo yum install -y kernel'

[7172729]  rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172729/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172729/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5ebe66a372d74056bb6f4f83fc07240e

    Command failed on smithi089 with status 1: 'sudo yum install -y kernel'

[7172732]  rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172732/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172732/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d61cb87b77404381980fd5e050d10d87

    Command failed on smithi158 with status 1: 'sudo yum install -y kernel'

[7172735]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172735/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172735/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9f254f26082a41fdab20d28b7d6046c3

    Command failed on smithi133 with status 1: 'sudo yum install -y kernel'

[7172738]  rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172738/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172738/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6914660ebabc43b4a2e795ecbcb7356b

    Command failed on smithi019 with status 1: 'sudo yum install -y kernel'

[7172744]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172744/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172744/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3c50dc64315d45f1b9e422549d620d3c

    Command failed on smithi087 with status 1: 'sudo yum install -y kernel'

[7172753]  rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172753/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172753/
sentry: https://sentry.ceph.com/organizations/ceph/?query=976270ddea38472094eae03a40e3a36e

    Command failed on smithi120 with status 1: 'sudo yum install -y kernel'

[7172756]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172756/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172756/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fbdbf799b3b0467381dbc2141c649de6

    Command failed on smithi143 with status 1: 'sudo yum install -y kernel'

[7172759]  rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172759/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172759/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f143bb79f11043e2ac7297c02c29f4ac

    Command failed on smithi156 with status 1: 'sudo yum install -y kernel'

[7172765]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172765/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172765/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c77fad47b3924f12b9575322bb9a59c8

    Command failed on smithi102 with status 1: 'sudo yum install -y kernel'

[7172768]  rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172768/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172768/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7ddc6fbde2ab4ec68fd69565e5b68ebb

    Command failed on smithi179 with status 1: 'sudo yum install -y kernel'

[7172771]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172771/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172771/
sentry: https://sentry.ceph.com/organizations/ceph/?query=94d48e29fb1f4ceca8bfd2902daa212c

    Command failed on smithi049 with status 1: 'sudo yum install -y kernel'

[7172773]  rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172773/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172773/
sentry: https://sentry.ceph.com/organizations/ceph/?query=68d3e6051cf64acebda63bf9391d0af7

    Command failed on smithi115 with status 1: 'sudo yum install -y kernel'

[7172783]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-balanced}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172783/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172783/
sentry: https://sentry.ceph.com/organizations/ceph/?query=604da1cb47ce4c568addfce449675938

    Command failed on smithi143 with status 1: 'sudo yum install -y kernel'

[7172792]  rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172792/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172792/
sentry: https://sentry.ceph.com/organizations/ceph/?query=924bdc8057a94bb2b1deba6c4d783c52

    Command failed on smithi114 with status 1: 'sudo yum install -y kernel'

[7172794]  rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172794/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172794/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ada49e2da8bf4f9eb01a61718bdf6e88

    Command failed on smithi164 with status 1: 'sudo yum install -y kernel'

[7172797]  rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172797/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172797/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c106c1e96b2f49b6af07a523b7c04655

    Command failed on smithi093 with status 1: 'sudo yum install -y kernel'

[7172800]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172800/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172800/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d0167597259141f8ac9f105af5ebd22c

    Command failed on smithi110 with status 1: 'sudo yum install -y kernel'

[7172806]  rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172806/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172806/
sentry: https://sentry.ceph.com/organizations/ceph/?query=842d03431561496b89fb97367519d1f7

    Command failed on smithi100 with status 1: 'sudo yum install -y kernel'

[7172809]  rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172809/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172809/
sentry: https://sentry.ceph.com/organizations/ceph/?query=78b286ea05c34f0b917142cdfa75ba9c

    Command failed on smithi156 with status 1: 'sudo yum install -y kernel'

[7172812]  rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172812/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172812/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2a16925f40914e89928f17c78fff8b17

    Command failed on smithi181 with status 1: 'sudo yum install -y kernel'

[7172818]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{rhel_8} tasks/failover}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172818/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172818/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2f9ed08ec92343cfb29d1b9bdd171fc2

    Command failed on smithi187 with status 1: 'sudo yum install -y kernel'

[7172821]  rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits}
-----------------------------------------------------------------
time:   00:23:07
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172821/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172821/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d8de2ad6da39405cb25d2a5e25a33130

    Command failed (workunit test mon/caps.sh) on smithi037 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=9839dd56836c942b9185baee816ddb2c7166f950
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh'

[7172824]  rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172824/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172824/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6954f522dd92497fa49de91bcd90609f

    Command failed on smithi110 with status 1: 'sudo yum install -y kernel'

[7172827]  rados/standalone/{supported-random-distro$/{centos_8} workloads/crush}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172827/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172827/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f01f32549d394bf99a29511415f55e4e

    Command failed on smithi100 with status 1: 'sudo yum install -y kernel'

[7172830]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172830/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172830/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b2682e97c72b4d2e93a669b2e7426adc

    Command failed on smithi124 with status 1: 'sudo yum install -y kernel'

[7172836]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172836/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172836/
sentry: https://sentry.ceph.com/organizations/ceph/?query=56250c6eda214b4fa7080daf5451f2c2

    Command failed on smithi181 with status 1: 'sudo yum install -y kernel'

[7172839]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172839/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172839/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0dd5e587e5154605a3bc4a63db16f1bd

    Command failed on smithi097 with status 1: 'sudo yum install -y kernel'

[7172842]  rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172842/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172842/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c9bee1ab139c4376a7200fe75d6798b4

    Command failed on smithi093 with status 1: 'sudo yum install -y kernel'

[7172845]  rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172845/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172845/
sentry: https://sentry.ceph.com/organizations/ceph/?query=82f8d41c49274cea8ac20c200e6215ab

    Command failed on smithi182 with status 1: 'sudo yum install -y kernel'

[7172848]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172848/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172848/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7430b6b41c39484f9d4d6ae3cdbfce22

    Command failed on smithi078 with status 1: 'sudo yum install -y kernel'

[7172851]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172851/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172851/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6fd61dc11b494f30b02d2b211e9ed1c8

    Command failed on smithi173 with status 1: 'sudo yum install -y kernel'

[7172860]  rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172860/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172860/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2c4c9574ccb5404cab500b5c29fa2e59

    Command failed on smithi062 with status 1: 'sudo yum install -y kernel'

[7172865]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172865/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172865/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c0f3c2f1ff4d4b13b5b54023744c8387

    Command failed on smithi120 with status 1: 'sudo yum install -y kernel'

[7172868]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172868/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172868/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7c4ee6563f9347638b571fef257b1131

    Command failed on smithi141 with status 1: 'sudo yum install -y kernel'

[7172882]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172882/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172882/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e204fb9a408e41c491894cdd96f6c214

    Command failed on smithi123 with status 1: 'sudo yum install -y kernel'

[7172885]  rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172885/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172885/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4035fc5143ca4a0fa2da2740e7bb481d

    Command failed on smithi084 with status 1: 'sudo yum install -y kernel'

[7172888]  rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172888/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172888/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c5583b29d4d84314b5cd26be1053dc1e

    Command failed on smithi080 with status 1: 'sudo yum install -y kernel'

[7172891]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172891/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172891/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e021ce8a9fb34d6d8fb07bce415d7997

    Command failed on smithi064 with status 1: 'sudo yum install -y kernel'

[7172893]  rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172893/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172893/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e7c2c77cef2a49ffb98dc54e8088a262

    Command failed on smithi190 with status 1: 'sudo yum install -y kernel'

[7172896]  rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172896/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172896/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5ce4d58ad7cc440993d6592b0341c6e8

    Command failed on smithi141 with status 1: 'sudo yum install -y kernel'

[7172899]  rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172899/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172899/
sentry: https://sentry.ceph.com/organizations/ceph/?query=786f89a1c543473d83a70ee5c02867b8

    Command failed on smithi203 with status 1: 'sudo yum install -y kernel'

[7172907]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172907/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172907/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0697b72313734fd98980d23e843a039a

    Command failed on smithi132 with status 1: 'sudo yum install -y kernel'

[7172910]  rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172910/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172910/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4893c750cfd840008c32d58dbf5f1b2b

    Command failed on smithi080 with status 1: 'sudo yum install -y kernel'

[7172913]  rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172913/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172913/
sentry: https://sentry.ceph.com/organizations/ceph/?query=49f33f42215c4bf89c5a3b26e10d9e5f

    Command failed on smithi190 with status 1: 'sudo yum install -y kernel'

[7172919]  rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_8} tasks/insights}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172919/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172919/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b0863fc4e77a4d1d864f28eb9d88c95b

    Command failed on smithi203 with status 1: 'sudo yum install -y kernel'

[7172922]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172922/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172922/
sentry: https://sentry.ceph.com/organizations/ceph/?query=af0f2e2f24b3414a96f4ab88494710bc

    Command failed on smithi149 with status 1: 'sudo yum install -y kernel'

[7172928]  rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172928/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172928/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cb99929485fd47b9b2f1cf5e2f64081a

    Command failed on smithi037 with status 1: 'sudo yum install -y kernel'

[7172931]  rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172931/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172931/
sentry: https://sentry.ceph.com/organizations/ceph/?query=82e5913fba164b509f3eab9809ba51b3

    Command failed on smithi026 with status 1: 'sudo yum install -y kernel'

[7172934]  rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172934/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172934/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7db1f5682c0a4a94a99c7cadb8f9645c

    Command failed on smithi099 with status 1: 'sudo yum install -y kernel'

[7172940]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172940/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172940/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fe966e5e990c40ddb88a7624d70d1baf

    Command failed on smithi088 with status 1: 'sudo yum install -y kernel'

[7172943]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172943/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172943/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8334c82ab6984f1a89b6b25dff22c09e

    Command failed on smithi012 with status 1: 'sudo yum install -y kernel'

[7172952]  rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/e2e}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172952/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172952/
sentry: https://sentry.ceph.com/organizations/ceph/?query=addbd0b75a954d96b1dca8ae19c08e96

    Command failed on smithi129 with status 1: 'sudo yum install -y kernel'

[7172955]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/flannel rook/master}
-----------------------------------------------------------------
time:   00:06:47
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172955/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172955/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e0251c5450c745208aa7eced6e4e9556

    Command failed on smithi087 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7172961]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-radosbench}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172961/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172961/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cbd198522dfd43fa951243c51433b85d

    Command failed on smithi062 with status 1: 'sudo yum install -y kernel'

[7172964]  rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172964/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172964/
sentry: https://sentry.ceph.com/organizations/ceph/?query=87184f6cac514038b982ee9501d03134

    Command failed on smithi110 with status 1: 'sudo yum install -y kernel'

[7172967]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172967/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172967/
sentry: https://sentry.ceph.com/organizations/ceph/?query=556a06f072054164a83ecfacb9e35a88

    Command failed on smithi187 with status 1: 'sudo yum install -y kernel'

[7172970]  rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172970/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172970/
sentry: https://sentry.ceph.com/organizations/ceph/?query=11c9c26153bd47ad82b06886e688dd70

    Command failed on smithi052 with status 1: 'sudo yum install -y kernel'

[7172973]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-big}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172973/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172973/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f5cbdcc88b404be1a4924d77ab92e81b

    Command failed on smithi154 with status 1: 'sudo yum install -y kernel'

[7172976]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172976/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172976/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6c1c126eed1d405fae803ebcf4d8e763

    Command failed on smithi026 with status 1: 'sudo yum install -y kernel'

[7172979]  rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172979/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172979/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a4bd920446f14e5d9fc2d145d1b2b45c

    Command failed on smithi061 with status 1: 'sudo yum install -y kernel'

[7172982]  rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172982/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172982/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e5360f1cbbf141619bf3a2de3d4de0e9

    Command failed on smithi119 with status 1: 'sudo yum install -y kernel'

[7172985]  rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172985/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172985/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b70027f4cc7348539a398fbd042da5a0

    Command failed on smithi135 with status 1: 'sudo yum install -y kernel'

[7172991]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-small}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172991/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172991/
sentry: https://sentry.ceph.com/organizations/ceph/?query=434f3e8b867c4933a07899cc97fb51c2

    Command failed on smithi182 with status 1: 'sudo yum install -y kernel'

[7172994]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172994/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172994/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a7557846c7af4530b19a11d19e40af7f

    Command failed on smithi179 with status 1: 'sudo yum install -y kernel'

[7172995]  rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172995/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172995/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e0cc6b014a154b1a8e819d07202b3151

    Command failed on smithi087 with status 1: 'sudo yum install -y kernel'

[7172997]  rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172997/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172997/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7504c2e7f535421db09f1c1fff192f1b

    Command failed on smithi132 with status 1: 'sudo yum install -y kernel'

[7173000]  rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:17:12
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173000/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173000/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fb23e905af504bfcaf2b0191885f680a

    Command failed (workunit test rados/test_librados_build.sh) on smithi188
    with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=9839dd56836c942b9185baee816ddb2c7166f950
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/rados/test_librados_build.sh'

[7173002]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173002/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173002/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dd46c26865bd48848120500f45101918

    Command failed on smithi158 with status 1: 'sudo yum install -y kernel'

[7173007]  rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173007/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173007/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dc0230116c254dca9db4c9ad61b557d4

    Command failed on smithi116 with status 1: 'sudo yum install -y kernel'

[7173014]  rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173014/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173014/
sentry: https://sentry.ceph.com/organizations/ceph/?query=71881660fd1a4df49dd4614b2c5f38ef

    Command failed on smithi133 with status 1: 'sudo yum install -y kernel'

[7173016]  rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173016/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173016/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5dd3f1df77164090b50806ad05b716c9

    Command failed on smithi173 with status 1: 'sudo yum install -y kernel'

[7173017]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173017/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173017/
sentry: https://sentry.ceph.com/organizations/ceph/?query=176be4fd451746d0af8159b8142bdad8

    Command failed on smithi026 with status 1: 'sudo yum install -y kernel'

[7173019]  rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:09:23
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173019/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173019/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3052fde55cc54776a1cc620a9fdf1adb

    Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c
    ceph_test_msgr'

[7173021]  rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173021/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173021/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bc1db8520f574179b42526f69358de7f

    Command failed on smithi019 with status 1: 'sudo yum install -y kernel'

[7173023]  rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173023/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173023/
sentry: https://sentry.ceph.com/organizations/ceph/?query=68188b786561425c8c4c0d68e8085e9c

    Command failed on smithi129 with status 1: 'sudo yum install -y kernel'

[7173025]  rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173025/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173025/
sentry: https://sentry.ceph.com/organizations/ceph/?query=18e3bb81a62b49e59288563712c9e186

    Command failed on smithi089 with status 1: 'sudo yum install -y kernel'

[7173027]  rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173027/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173027/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2fab5c6f1224492b9cfca6fb3ec14baa

    Command failed on smithi164 with status 1: 'sudo yum install -y kernel'

[7173031]  rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173031/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173031/
sentry: https://sentry.ceph.com/organizations/ceph/?query=66aed1d387e34577bdf5a00f8cd3c4dc

    Command failed on smithi173 with status 1: 'sudo yum install -y kernel'

[7173037]  rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173037/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173037/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4f33656ee15c48b9a1adbc7c5cd74f04

    Command failed on smithi132 with status 1: 'sudo yum install -y kernel'

[7173038]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173038/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173038/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2e755b1361cd42ffa40aaf61f009ef45

    Command failed on smithi112 with status 1: 'sudo yum install -y kernel'

[7173043]  rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173043/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173043/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dcdaf868a3ac4a419828a5e240cb03b4

    Command failed on smithi097 with status 1: 'sudo yum install -y kernel'

[7173045]  rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/off mon_election/classic task/test_adoption}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173045/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173045/
sentry: https://sentry.ceph.com/organizations/ceph/?query=056c4cc01f2f4822b37385228a45e19c

    Command failed on smithi037 with status 1: 'sudo yum install -y kernel'

[7173048]  rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173048/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173048/
sentry: https://sentry.ceph.com/organizations/ceph/?query=88f95e7e4a4a47b491db9309d46a56a8

    Command failed on smithi176 with status 1: 'sudo yum install -y kernel'

[7173080]  rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:19:12
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173080/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173080/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6905b0fdbfaf40589058390d665ca765

    Command failed (workunit test cephadm/test_cephadm.sh) on smithi112 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=9839dd56836c942b9185baee816ddb2c7166f950
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

[7173121]  rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/host rook/1.7.2}
-----------------------------------------------------------------
time:   00:06:07
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173121/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173121/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e8c82add682a4bf6a196a877fa14efa6

    Command failed on smithi202 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'



Dead
=================================================================
[7172536]  rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
-----------------------------------------------------------------
time:   00:07:15
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172536/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172536/
sentry: https://sentry.ceph.com/organizations/ceph/?query=05f57305e9d946cea5b88dc844df825f

    {'smithi131.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed':
    False, 'invocation': {'module_args': {'allow_downgrade': False,
    'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file':
    None, 'disable_excludes': None, 'disable_gpg_check': False,
    'disable_plugin': [], 'disablerepo': [], 'download_dir': None,
    'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude':
    [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot':
    '/', 'list': None, 'lock_timeout': 30, 'name': ['redhat-lsb-core', 'dnf-
    utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk',
    'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman',
    'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump',
    'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-
    devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage',
    'qemu-img', 'qemu-kvm-core', 'qemu-kvm-block-rbd', 'libacl-devel',
    'dbench', 'autoconf', 'gdb', 'iozone', 'lvm2'], 'releasever': None,
    'security': False, 'skip_broken': False, 'state': 'present',
    'update_cache': False, 'update_only': False, 'validate_certs': True}},
    'msg': 'Failed to download packages: qemu-kvm-block-
    rbd-15:6.2.0-28.module_el8.8.0+1257+0c3374ae.x86_64: Cannot download, all
    mirrors were already tried without success', 'results': []}}

[7172833]  rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172833/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172833/

    Error reimaging machines: 'ssh_keyscan smithi047.front.sepia.ceph.com'
    reached maximum tries (5) after waiting for 5 seconds



Pass
=================================================================
[7172388] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:08:55
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172388/

[7172390] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill}
time:   03:29:35
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172390/

[7172411] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/progress}
time:   00:25:30
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172411/

[7172431] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/repair_test}
time:   00:18:56
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172431/

[7172444] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/rbd_cls}
time:   00:22:50
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172444/

[7172467] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
time:   00:15:10
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172467/

[7172508] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:15:38
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172508/

[7172512] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}}
time:   00:18:33
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172512/

[7172514] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews}
time:   00:13:43
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172514/

[7172516] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:13:37
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172516/

[7172518] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps}
time:   00:29:34
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172518/

[7172520] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_5925}
time:   00:13:21
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172520/

[7172522] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:17:21
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172522/

[7172524] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind}
time:   01:50:58
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172524/

[7172526] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
time:   00:17:44
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172526/

[7172528] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:19:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172528/

[7172530] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced}
time:   00:28:29
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172530/

[7172532] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}}
time:   02:15:44
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172532/

[7172534] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:58
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172534/

[7172538] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/on mon_election/connectivity task/test_nfs}
time:   00:31:26
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172538/

[7172540] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:47:21
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172540/

[7172542] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}}
time:   00:23:29
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172542/

[7172544] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} tasks/e2e}
time:   00:41:04
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172544/

[7172548] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:22:26
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172548/

[7172550] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps}
time:   00:25:13
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172550/

[7172552] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:30:12
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172552/

[7172554] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:14:01
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172554/

[7172556] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:16:39
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172556/

[7172558] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test}
time:   00:15:59
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172558/

[7172560] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
time:   00:23:24
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172560/

[7172562] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:29:24
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172562/

[7172564] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites}
time:   00:32:33
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172564/

[7172566] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache}
time:   00:15:34
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172566/

[7172574] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/prometheus}
time:   00:15:32
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172574/

[7172594] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
time:   00:15:14
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172594/

[7172600] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli}
time:   00:24:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172600/

[7172610] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:55:24
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172610/

[7172618] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:29:18
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172618/

[7172622] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:30:17
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172622/

[7172630] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub}
time:   02:41:13
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172630/

[7172632] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:19:55
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172632/

[7172636] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:16:08
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172636/

[7172657] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:20:18
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172657/

[7172661] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:30
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172661/

[7172663] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench}
time:   01:03:46
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172663/

[7172676] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:12:21
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172676/

[7172678] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:23:55
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172678/

[7172682] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}}
time:   00:19:19
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172682/

[7172684] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:23:16
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172684/

[7172687] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:15:52
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172687/

[7172714] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}}
time:   00:09:50
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172714/

[7172717] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}}
time:   00:19:01
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172717/

[7172741] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits}
time:   00:35:37
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172741/

[7172747] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:45
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172747/

[7172750] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:29:08
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172750/

[7172762] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:11:46
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172762/

[7172776] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:23:07
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172776/

[7172779] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:14:22
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172779/

[7172785] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python}
time:   00:16:10
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172785/

[7172788] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:23:30
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172788/

[7172803] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}}
time:   00:13:46
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172803/

[7172815] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
time:   00:08:54
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172815/

[7172854] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:54
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172854/

[7172857] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch}
time:   00:20:23
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172857/

[7172862] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:22
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172862/

[7172871] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:09:10
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172871/

[7172874] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_nfs}
time:   00:36:19
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172874/

[7172877] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
time:   00:09:36
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172877/

[7172901] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:22:29
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172901/

[7172904] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:36
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172904/

[7172916] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed}
time:   00:16:19
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172916/

[7172925] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper}
time:   00:13:11
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172925/

[7172937] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   01:13:08
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172937/

[7172946] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:52:19
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172946/

[7172949] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
time:   00:12:39
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172949/

[7172958] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:17:26
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172958/

[7172987] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final}
time:   00:14:40
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172987/

[7172989] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:14:42
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7172989/

[7173004] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write}
time:   00:09:48
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173004/

[7173006] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete}
time:   00:20:46
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173006/

[7173010] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:27:23
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173010/

[7173012] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/module_selftest}
time:   00:29:00
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173012/

[7173029] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:23:54
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173029/

[7173033] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:56
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173033/

[7173035] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:24:57
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173035/

[7173041] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:30:03
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173041/

[7173046] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write}
time:   00:25:33
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173046/

[7173050] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:19:38
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173050/

[7173052] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:10:16
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173052/

[7173054] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps}
time:   00:20:36
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173054/

[7173056] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:17:36
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173056/

[7173058] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls}
time:   00:23:21
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173058/

[7173060] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
time:   00:17:37
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173060/

[7173062] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}
time:   00:29:24
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173062/

[7173064] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:36
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173064/

[7173066] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_5925}
time:   00:15:12
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173066/

[7173068] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:14:22
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173068/

[7173070] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:16:43
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173070/

[7173072] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache}
time:   00:19:29
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173072/

[7173074] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{rhel_8} tasks/progress}
time:   00:28:33
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173074/

[7173076] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:16:37
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173076/

[7173078] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}}
time:   00:15:03
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173078/

[7173082] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:35:06
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173082/

[7173084] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc}
time:   01:14:18
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173084/

[7173086] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/dedup-io-mixed}
time:   00:14:43
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173086/

[7173088] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread}
time:   00:36:31
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173088/

[7173090] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio}
time:   00:12:05
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173090/

[7173092] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read}
time:   00:24:14
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173092/

[7173094] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}}
time:   00:13:56
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173094/

[7173096] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
time:   00:14:09
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173096/

[7173098] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:37:28
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173098/

[7173100] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:15:05
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173100/

[7173102] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:29:07
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173102/

[7173104] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps}
time:   00:12:54
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173104/

[7173106] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:14:23
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173106/

[7173108] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:24:30
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173108/

[7173110] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}}
time:   00:14:19
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173110/

[7173112] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:16:30
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173112/

[7173115] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews}
time:   00:11:23
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173115/

[7173117] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects}
time:   00:33:36
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173117/

[7173119] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{filestore-xfs} tasks/dashboard}
time:   01:07:23
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173119/

[7173123] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:21:46
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173123/

[7173125] rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
time:   01:23:41
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173125/

[7173127] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
time:   01:50:21
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173127/

[7173129] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}
time:   02:40:46
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173129/

[7173131] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:39
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173131/

[7173133] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_api_tests}
time:   00:32:40
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173133/

[7173135] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos}
time:   00:10:15
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173135/

[7173137] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench}
time:   00:10:16
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173137/

[7173139] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests}
time:   00:42:35
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173139/

[7173141] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite}
time:   00:16:11
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173141/

[7173143] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:16:40
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173143/

[7173145] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:33:01
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173145/

[7173147] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   01:05:21
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173147/

[7173149] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final}
time:   00:17:18
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173149/

[7173151] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_8} tasks/prometheus}
time:   00:16:49
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173151/

[7173153] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
time:   00:37:56
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173153/

[7173155] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}}
time:   00:17:17
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173155/

[7173157] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency}
time:   00:34:53
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173157/

[7173159] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:29:40
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173159/

[7173160] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:15:45
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173160/

[7173161] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:21
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173161/

[7173162] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon}
time:   01:10:29
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173162/

[7173163] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:13:37
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173163/

[7173164] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:30:47
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173164/

[7173165] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench}
time:   01:08:01
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173165/

[7173166] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:17:22
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173166/

[7173167] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}}
time:   01:06:38
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173167/

[7173168] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:33
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173168/

[7173169] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
time:   00:11:38
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173169/

[7173170] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:13:27
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173170/

[7173171] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/repair_test}
time:   00:18:51
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173171/

[7173172] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect}
time:   00:19:29
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173172/

[7173173] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_nfs}
time:   00:30:11
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173173/

[7173174] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:13:42
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173174/

[7173175] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep}
time:   00:14:52
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173175/

[7173176] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   01:16:17
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173176/

[7173177] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune}
time:   00:58:57
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173177/

[7173178] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:11:28
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173178/

[7173179] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:27:03
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173179/

[7173180] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:14:43
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173180/

[7173181] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests}
time:   00:18:22
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173181/

[7173182] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:11:59
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173182/

[7173183] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
time:   00:12:39
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173183/

[7173184] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}}
time:   00:31:24
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173184/

[7173185] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:15:47
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173185/

[7173186] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_8} tasks/workunits}
time:   00:15:08
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173186/

[7173187] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:16:55
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173187/

[7173188] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects}
time:   00:24:44
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173188/

[7173189] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object}
time:   00:17:28
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173189/

[7173190] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:11:06
info:   http://pulpito.ceph.com/yuriw-2023-02-13_21:59:43-rados-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7173190/