Found 307 jobs
Missing teuthology log /home/teuthworker/archive/yuriw-2023-06-13_14:52:42-rados-wip-yuri7-testing-2023-06-12-1220-distro-default-smithi/7302181/teuthology.log
Found 21 distinct failure reasons
Failure: Command failed on smithi061 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4381-ga5e32c35-1jammy cephadm=18.0.0-4381-ga5e32c35-1jammy ceph-mds=18.0.0-4381-ga5e32c35-1jammy ceph-mgr=18.0.0-4381-ga5e32c35-1jammy ceph-common=18.0.0-4381-ga5e32c35-1jammy ceph-fuse=18.0.0-4381-ga5e32c35-1jammy ceph-test=18.0.0-4381-ga5e32c35-1jammy ceph-volume=18.0.0-4381-ga5e32c35-1jammy radosgw=18.0.0-4381-ga5e32c35-1jammy python3-rados=18.0.0-4381-ga5e32c35-1jammy python3-rgw=18.0.0-4381-ga5e32c35-1jammy python3-cephfs=18.0.0-4381-ga5e32c35-1jammy python3-rbd=18.0.0-4381-ga5e32c35-1jammy libcephfs2=18.0.0-4381-ga5e32c35-1jammy libcephfs-dev=18.0.0-4381-ga5e32c35-1jammy librados2=18.0.0-4381-ga5e32c35-1jammy librbd1=18.0.0-4381-ga5e32c35-1jammy rbd-fuse=18.0.0-4381-ga5e32c35-1jammy'
69 jobs
suites intersection: []
suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', '2-recovery-overrides/{more-partial-recovery}', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'cluster/{12-osds', 'clusters/9-mons', 'clusters/{fixed-2', 'clusters/{fixed-4', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'debug/mgr', 'fast/normal', 'mgr_ttl_cache/disable', 'mgr_ttl_cache/enable', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/none', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'no_pools', 'objectstore/bluestore-basic-min-osd-mem-target', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/multimon/{clusters/9', 'rados/objectstore/{backends/keyvaluedb', 'rados/objectstore/{backends/objectstore-memstore', 'rados/perf/{ceph', 'rados/rest/{mgr-restful', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/singleton-nomsgr/{all/balancer', 'rados/singleton-nomsgr/{all/ceph-kvstore-tool', 'rados/singleton-nomsgr/{all/ceph-post-file', 'rados/singleton-nomsgr/{all/crushdiff', 'rados/singleton-nomsgr/{all/health-warnings', 'rados/singleton-nomsgr/{all/large-omap-object-warnings', 'rados/singleton-nomsgr/{all/librados_hello_world', 'rados/singleton-nomsgr/{all/multi-backfill-reject', 'rados/singleton/{all/divergent_priors2', 'rados/singleton/{all/ec-lost-unfound', 'rados/singleton/{all/max-pg-per-osd.from-mon', 'rados/singleton/{all/mon-config-keys', 'rados/singleton/{all/peer', 'rados/singleton/{all/pg-autoscaler', 'rados/singleton/{all/rebuild-mondb', 'rados/singleton/{all/resolve_stuck_peering', 'rados/singleton/{all/test-crash', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/rhel_latest', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'random-objectstore$/{bluestore-comp-lz4}', 'random-objectstore$/{bluestore-stupid}', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'recovery-overrides/{more-partial-recovery}', 'scheduler/dmclock_1Shard_16Threads', 'scheduler/dmclock_default_shards', 'scheduler/wpq_default_shards', 'settings/optimized', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/failover}', 'tasks/insights}', 'tasks/libcephsqlite}', 'tasks/module_selftest}', 'tasks/mon_clock_with_skews}', 'tasks/progress}', 'tasks/rados_api_tests}', 'tasks/rados_cls_all}', 'tasks/rados_striper}', 'tasks/rados_workunit_loadgen_big}', 'tasks/repair_test}', 'test_envlibrados_for_rocksdb}', 'thrashers/careful', 'thrashers/default', 'thrashers/fastread', 'thrashers/force-sync-many', 'thrashers/many', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/one', 'thrashers/pggrow', 'thrashosds-health', 'ubuntu_latest', 'workloads/cache-snaps}', 'workloads/dedup-io-mixed}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-small-objects}', 'workloads/fio_4K_rand_read}', 'workloads/fio_4K_rand_rw}', 'workloads/fio_4M_rand_read}', 'workloads/fio_4M_rand_rw}', 'workloads/fio_4M_rand_write}', 'workloads/rados_api_tests}', 'workloads/rados_mon_workunits}', 'workloads/radosbench_4K_rand_read}', 'workloads/radosbench_4K_seq_read}', 'workloads/radosbench_4M_rand_read}', 'workloads/radosbench_4M_seq_read}', 'workloads/radosbench_4M_write}', 'workloads/radosbench_omap_write}', 'workloads/radosbench}', 'workloads/redirect_promote_tests}', 'workloads/sample_fio}', 'workloads/sample_radosbench}', 'workloads/small-objects-balanced}', 'workloads/small-objects}', 'workloads/snaps-few-objects}']

Timeout 3h running clone.client.0/qa/workunits/rados/stress_watch.sh
1 jobs: ['7302092']
suites: ['clusters/{fixed-2', 'mon_election/classic', 'msgr-failures/many', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{ubuntu_20.04}', 'tasks/rados_stress_watch}']

Timeout 3h running clone.client.0/qa/workunits/cephtool/test.sh
4 jobs: ['7302027', '7302217', '7302102', '7302291']
suites intersection: ['rados', 'rados/singleton-bluestore/{all/cephtool']
suites union: ['mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/none', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'rados', 'rados/singleton-bluestore/{all/cephtool', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_20.04}}']

Timeout 3h running clone.client.0/qa/standalone/misc/ok-to-stop.sh
1 jobs: ['7302179']
suites: ['rados/standalone/{supported-random-distro$/{centos_8}', 'workloads/misc}']

Failure: Command failed on smithi186 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_cls_rbd --gtest_filter=-TestClsRbd.get_features:TestClsRbd.parents:TestClsRbd.mirror'"
1 jobs: ['7302177']
suites: ['0-size-min-size-overrides/2-size-2-min-size', '1-install/pacific', 'backoff/peering', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'rados', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'thrashers/mapgap', 'thrashosds-health', 'three-plus-one}', 'workloads/rbd_cls}']

Dead: b'2023-06-14T03:07:23.601 DEBUG:teuthology.exit:Finished running handlers'
3 jobs: ['7302037', '7302035', '7302290']
suites intersection: []
suites union: ['mon_election/classic', 'rados', 'rados/objectstore/{backends/ceph_objectstore_tool', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/standalone/{supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_20.04}}', 'workloads/osd-backfill}']

Timeout 3h running clone.client.0/qa/workunits/cls/test_cls_refcount.sh
4 jobs: ['7302232', '7302248', '7302039', '7302001']
suites intersection: []
suites union: ['0-start', '1-tasks', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_3.0}', 'rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8}', 'rados/verify/{centos_latest', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'tasks/rados_cls_all', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'validater/valgrind}', 'workload/{ec-rados-default']

Timeout 120 running ceph --cluster ceph osd pool create unique_pool_0 1 1 erasure backfill_toofull
1 jobs: ['7302297']
suites: ['mon_election/connectivity', 'msgr-failures/none', 'msgr/async-v1only', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/backfill-toofull', 'supported-random-distro$/{rhel_8}}']

Timeout 3h running clone.client.0/qa/standalone/osd/divergent-priors.sh
1 jobs: ['7302321']
suites: ['rados/standalone/{supported-random-distro$/{rhel_8}', 'workloads/osd}']

Timeout 3h running clone.client.0/qa/standalone/mon/misc.sh
1 jobs: ['7302260']
suites: ['rados/standalone/{supported-random-distro$/{ubuntu_20.04}', 'workloads/mon}']

Timeout 120 running ceph --cluster ceph osd pool create unique_pool_0 16 16 erasure isaprofile
1 jobs: ['7302132']
suites: ['ceph', 'clusters/{fixed-2', 'mon_election/connectivity', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'recovery-overrides/{default}', 'supported-random-distro$/{centos_8}', 'thrashers/none', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}']

Timeout 3h running clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh
1 jobs: ['7302005']
suites: ['rados/standalone/{supported-random-distro$/{rhel_8}', 'workloads/scrub}']

Timeout 1h running clone.client.0/qa/workunits/rados/test_python.sh
1 jobs: ['7302074']
suites: ['clusters/{fixed-2', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{rhel_8}', 'tasks/rados_python}']

Timeout 3h running clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh
1 jobs: ['7302098']
suites: ['rados/standalone/{supported-random-distro$/{centos_8}', 'workloads/erasure-code}']

Dead: None
1 jobs: ['7302181']

Timeout 6h running clone.client.0/qa/workunits/rados/test.sh
2 jobs: ['7302073', '7302317']
suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}']
suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}']

Timeout 120 running ceph --cluster ceph osd pool create unique_pool_0 1 1 erasure backfill_unfound
1 jobs: ['7301994']
suites: ['mon_election/connectivity', 'msgr-failures/many', 'msgr/async', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/singleton/{all/ec-inconsistent-hinfo', 'supported-random-distro$/{ubuntu_20.04}}']

Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi002 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a5e32c358ad7426cfe629936ac459a38717971c6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'
1 jobs: ['7302236']
suites: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb/{supported/centos_latest', 'supported-random-distro$/{centos_8}}', 'test_envlibrados_for_rocksdb}']

Failure: Test failure: test_create_rbd_in_data_pool (tasks.mgr.dashboard.test_rbd.RbdTest)
2 jobs: ['7302229', '7302033']
suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-stupid}', 'tasks/dashboard}']
suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-stupid}', 'tasks/dashboard}']

Timeout 3h running clone.client.0/qa/workunits/rados/test_rados_tool.sh
1 jobs: ['7302149']
suites: ['mon_election/classic', 'msgr-failures/none', 'msgr/async-v1only', 'objectstore/bluestore-stupid', 'rados', 'rados/singleton/{all/radostool', 'supported-random-distro$/{rhel_8}}']

Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a5e32c358ad7426cfe629936ac459a38717971c6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'
2 jobs: ['7302306', '7302112']
suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}']
suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-zstd}', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'tasks/e2e}']