Found 227 jobs Found 8 distinct failure reasons Failure: "2020-07-06T15:33:41.207133+0000 mon.b (mon.0) 150 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log 57 jobs suites intersection: ['conf/{client.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'osd.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] suites union: ['centos_latest.yaml', 'ceph-thrash/mds.yaml', 'ceph-thrash/mon.yaml', 'clusters/1-mds-1-client-coloc.yaml', 'clusters/1-mds-3-client.yaml', 'clusters/1-mds-4-client-coloc.yaml', 'clusters/1a3s-mds-2c-client.yaml', 'clusters/fixed-2-ucephfs.yaml', 'conf/{client.yaml', 'distros/ubuntu_latest.yaml', 'frag_enable.yaml', 'fs/32bits/{begin.yaml', 'fs/basic_functional/{begin.yaml', 'fs/basic_workload/{begin.yaml', 'fs/multiclient/{begin.yaml', 'fs/multifs/{begin.yaml', 'fs/permission/{begin.yaml', 'fs/thrash/{begin.yaml', 'fs/traceless/{begin.yaml', 'fs/verify/{begin.yaml', 'inline/no.yaml', 'inline/yes.yaml', 'mds.yaml', 'mon-debug.yaml', 'mon.yaml', 'mount/fuse.yaml', 'msgr-failures/none.yaml', 'msgr-failures/osd-mds-delay.yaml', 'no_client_pidfile.yaml', 'objectstore-ec/bluestore-bitmap.yaml', 'objectstore-ec/bluestore-comp-ec-root.yaml', 'objectstore-ec/bluestore-comp.yaml', 'objectstore-ec/bluestore-ec-root.yaml', 'objectstore-ec/filestore-xfs.yaml', 'objectstore/bluestore-bitmap.yaml', 'objectstore/bluestore-ec-root.yaml', 'omap_limit/10.yaml', 'omap_limit/10000.yaml', 'osd.yaml}', 'overrides/{faked-ino.yaml', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{centos_latest.yaml}', 'supported-random-distros$/{rhel_latest.yaml}', 'supported-random-distros$/{ubuntu_latest.yaml}', 'tasks/admin.yaml}', 'tasks/auto-repair.yaml}', 'tasks/cap-flush.yaml}', 'tasks/cephfs-shell.yaml}', 'tasks/cephfs_misc_tests.yaml}', 'tasks/cfuse_workunit_kernel_untar_build.yaml}', 'tasks/cfuse_workunit_misc.yaml}', 'tasks/cfuse_workunit_misc_test_o_trunc.yaml}', 'tasks/cfuse_workunit_norstats.yaml}', 'tasks/cfuse_workunit_quota.yaml}', 'tasks/cfuse_workunit_snaptests.yaml}', 'tasks/cfuse_workunit_suites_blogbench.yaml', 'tasks/cfuse_workunit_suites_blogbench.yaml}', 'tasks/cfuse_workunit_suites_dbench.yaml', 'tasks/cfuse_workunit_suites_dbench.yaml}', 'tasks/cfuse_workunit_suites_ffsb.yaml}', 'tasks/cfuse_workunit_suites_fsstress.yaml', 'tasks/cfuse_workunit_suites_fsstress.yaml}', 'tasks/cfuse_workunit_suites_fsx.yaml}', 'tasks/cfuse_workunit_suites_iogen.yaml}', 'tasks/cfuse_workunit_suites_pjd.yaml}', 'tasks/cfuse_workunit_trivial_sync.yaml}', 'tasks/client-readahad.yaml}', 'tasks/damage.yaml}', 'tasks/failover.yaml}', 'tasks/forward-scrub.yaml}', 'tasks/fragment.yaml}', 'tasks/ior-shared-file.yaml}', 'tasks/mdtest.yaml}', 'tasks/volumes.yaml}', 'traceless/50pc.yaml}', 'validater/lockdep.yaml}', 'validater/valgrind.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] Failure: Test failure: test_subvolume_pin_export (tasks.cephfs.test_volumes.TestVolumes) 1 jobs: ['5203215'] suites: ['clusters/1-mds-4-client-coloc.yaml', 'conf/{client.yaml', 'fs/basic_functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'no_client_pidfile.yaml', 'objectstore/bluestore-bitmap.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{centos_latest.yaml}', 'tasks/volumes.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] Dead: b'2020-07-07T01:09:23.360 DEBUG:teuthology.exit:Finished running handlers' 6 jobs: ['5203029', '5203060', '5203001', '5203192', '5203096', '5203125'] suites intersection: ['1-client.yaml', '2-upgrade.yaml', 'clusters/1-mds-2-client-micro.yaml', 'conf/{client.yaml', 'mds.yaml', 'mon.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'pg-warn.yaml', 'tasks/{0-mimic.yaml', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] suites union: ['1-client.yaml', '2-upgrade.yaml', '3-client-upgrade.yaml', '3-compat_client/mimic.yaml}}', '3-compat_client/no.yaml}}', '3-verify.yaml}', '4-compat_client.yaml', '5-client-sanity.yaml}}', 'clusters/1-mds-2-client-micro.yaml', 'conf/{client.yaml', 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap.yaml', 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap.yaml', 'fs/upgrade/volumes/import-legacy/{bluestore-bitmap.yaml', 'mds.yaml', 'mon.yaml', 'multimds/no.yaml', 'multimds/yes.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'pg-warn.yaml', 'tasks/{0-mimic.yaml', 'ubuntu_18.04.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] Failure: Test failure: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 1 jobs: ['5203127'] suites: ['clusters/1-mds-4-client-coloc.yaml', 'conf/{client.yaml', 'fs/basic_functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'no_client_pidfile.yaml', 'objectstore/bluestore-bitmap.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{rhel_latest.yaml}', 'tasks/backtrace.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] Failure: Command failed on smithi140 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic' 2 jobs: ['5203075', '5203161'] suites intersection: ['conf/{client.yaml', 'mds.yaml', 'mon.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] suites union: ['1-client.yaml', '2-upgrade.yaml', '3-client-upgrade.yaml', '4-compat_client.yaml', '5-client-sanity.yaml}}', 'clusters/1-mds-2-client-micro.yaml', 'clusters/fixed-2-ucephfs.yaml', 'conf/{client.yaml', 'fs/basic_workload/{begin.yaml', 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap.yaml', 'inline/no.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'multimds/yes.yaml', 'objectstore-ec/bluestore-ec-root.yaml', 'omap_limit/10.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'pg-warn.yaml', 'supported-random-distros$/{ubuntu_latest.yaml}', 'tasks/cfuse_workunit_suites_pjd.yaml}', 'tasks/{0-mimic.yaml', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] Failure: Test failure: test_reading_conf_after_resetting_opt (tasks.cephfs.test_cephfs_shell.TestConfReading) 1 jobs: ['5203024'] suites: ['clusters/1-mds-4-client-coloc.yaml', 'conf/{client.yaml', 'fs/basic_functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'no_client_pidfile.yaml', 'objectstore/bluestore-ec-root.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{centos_latest.yaml}', 'tasks/cephfs-shell.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] Failure: Command failed on smithi150 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' 1 jobs: ['5203158'] suites: ['centos_latest.yaml', 'clusters/fixed-2-ucephfs.yaml', 'conf/{client.yaml', 'fs/verify/{begin.yaml', 'mds.yaml', 'mon-debug.yaml', 'mon.yaml', 'mount/fuse.yaml', 'objectstore-ec/bluestore-comp.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'tasks/cfuse_workunit_suites_fsstress.yaml', 'validater/valgrind.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] Failure: Test failure: test_abort_conn (tasks.cephfs.test_client_recovery.TestClientRecovery) 1 jobs: ['5203038'] suites: ['clusters/1-mds-4-client-coloc.yaml', 'conf/{client.yaml', 'fs/basic_functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'no_client_pidfile.yaml', 'objectstore/bluestore-bitmap.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{ubuntu_latest.yaml}', 'tasks/client-recovery.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}']