Found 141 jobs Found 8 distinct failure reasons Failure: Command failed on smithi092 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' 56 jobs suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] suites union: ['1-client', '2-upgrade', '3-client-upgrade', '3-compat_client/no}}', '3-compat_client/pacific}}', '3-verify}', '4-compat_client', '5-client-sanity}}', 'centos_latest', 'ceph-thrash/mds', 'ceph-thrash/mon', 'clusters/1-mds-1-client-coloc', 'clusters/1-mds-2-client-micro', 'clusters/1-mds-4-client-coloc', 'clusters/fixed-2-ucephfs', 'conf/{client', 'frag_enable', 'fs/32bits/{begin', 'fs/basic_functional/{begin', 'fs/basic_workload/{begin', 'fs/permission/{begin', 'fs/snaps/{begin', 'fs/thrash/{begin', 'fs/traceless/{begin', 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap', 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap', 'fs/upgrade/volumes/import-legacy/{bluestore-bitmap', 'fs/verify/{begin', 'inline/no', 'inline/yes', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'msgr-failures/none', 'msgr-failures/osd-mds-delay', 'multimds/no', 'multimds/yes', 'no_client_pidfile', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'omap_limit/10', 'omap_limit/10000', 'osd}', 'overrides/{faked-ino', 'overrides/{frag_enable', 'pg-warn', 'supported-random-distros$/{centos_8}', 'supported-random-distros$/{rhel_8}', 'supported-random-distros$/{ubuntu_latest}', 'tasks/cfuse_workunit_kernel_untar_build}', 'tasks/cfuse_workunit_misc_test_o_trunc}', 'tasks/cfuse_workunit_misc}', 'tasks/cfuse_workunit_norstats}', 'tasks/cfuse_workunit_quota}', 'tasks/cfuse_workunit_snaptests}', 'tasks/cfuse_workunit_suites_blogbench', 'tasks/cfuse_workunit_suites_blogbench}', 'tasks/cfuse_workunit_suites_dbench', 'tasks/cfuse_workunit_suites_dbench}', 'tasks/cfuse_workunit_suites_ffsb', 'tasks/cfuse_workunit_suites_fsstress', 'tasks/cfuse_workunit_suites_fsstress}', 'tasks/cfuse_workunit_suites_fsync}', 'tasks/cfuse_workunit_suites_iogen}', 'tasks/cfuse_workunit_suites_iozone}', 'tasks/cfuse_workunit_suites_pjd}', 'tasks/cfuse_workunit_trivial_sync}', 'tasks/libcephfs_interface_tests}', 'tasks/libcephfs_python}', 'tasks/snaptests}', 'tasks/{0-nautilus', 'traceless/50pc}', 'ubuntu_18.04}', 'validater/lockdep}', 'validater/valgrind}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] Failure: "2020-07-05T05:51:24.995466+0000 mon.a (mon.0) 245 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log 26 jobs: ['5199090', '5199110', '5199132', '5199158', '5199101', '5199104', '5199146', '5199166', '5199098', '5199071', '5199092', '5199127', '5199111', '5199073', '5199049', '5199115', '5199122', '5199159', '5199075', '5199032', '5199121', '5199137', '5199171', '5199142', '5199058', '5199068'] suites intersection: ['conf/{client', 'mds', 'mon', 'mount/fuse', 'osd}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] suites union: ['centos_latest', 'clusters/1-mds-2-client', 'clusters/1-mds-3-client', 'clusters/1-mds-4-client-coloc', 'clusters/1a3s-mds-2c-client', 'clusters/fixed-2-ucephfs', 'conf/{client', 'distros/ubuntu_latest', 'frag_enable', 'fs/32bits/{begin', 'fs/basic_functional/{begin', 'fs/basic_workload/{begin', 'fs/multiclient/{begin', 'fs/multifs/{begin', 'fs/permission/{begin', 'fs/snaps/{begin', 'fs/traceless/{begin', 'fs/verify/{begin', 'inline/yes', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'no_client_pidfile', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'omap_limit/10', 'osd}', 'overrides/{faked-ino', 'overrides/{frag_enable', 'supported-random-distros$/{centos_8}', 'supported-random-distros$/{rhel_8}', 'supported-random-distros$/{ubuntu_latest}', 'tasks/asok_dump_tree}', 'tasks/auto-repair}', 'tasks/cap-flush}', 'tasks/cfuse_workunit_misc}', 'tasks/cfuse_workunit_suites_blogbench', 'tasks/cfuse_workunit_suites_dbench', 'tasks/cfuse_workunit_suites_ffsb}', 'tasks/cfuse_workunit_suites_fsstress', 'tasks/cfuse_workunit_suites_fsstress}', 'tasks/cfuse_workunit_suites_fsx}', 'tasks/cfuse_workunit_suites_pjd}', 'tasks/client-recovery}', 'tasks/damage}', 'tasks/failover}', 'tasks/ior-shared-file}', 'tasks/mdtest}', 'tasks/openfiletable}', 'tasks/sessionmap/{sessionmap}}', 'tasks/snaptests}', 'tasks/volume-client/{task/test/{test}}}', 'traceless/50pc}', 'validater/lockdep}', 'validater/valgrind}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] Failure: Test failure: test_journal_smoke (tasks.cephfs.test_journal_repair.TestJournalRepair) 2 jobs: ['5199083', '5199154'] suites intersection: ['clusters/1-mds-4-client-coloc', 'conf/{client', 'fs/basic_functional/{begin', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile', 'osd}', 'overrides/{frag_enable', 'tasks/journal-repair}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] suites union: ['clusters/1-mds-4-client-coloc', 'conf/{client', 'fs/basic_functional/{begin', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{frag_enable', 'supported-random-distros$/{rhel_8}', 'supported-random-distros$/{ubuntu_latest}', 'tasks/journal-repair}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] Failure: Test failure: test_journal_migration (tasks.cephfs.test_journal_migration.TestJournalMigration) 2 jobs: ['5199036', '5199108'] suites intersection: ['clusters/1-mds-4-client-coloc', 'conf/{client', 'fs/basic_functional/{begin', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile', 'osd}', 'overrides/{frag_enable', 'tasks/test_journal_migration}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] suites union: ['clusters/1-mds-4-client-coloc', 'conf/{client', 'fs/basic_functional/{begin', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{frag_enable', 'supported-random-distros$/{centos_8}', 'supported-random-distros$/{ubuntu_latest}', 'tasks/test_journal_migration}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] Failure: Test failure: test_reconnect_timeout (tasks.cephfs.test_client_recovery.TestClientRecovery) 1 jobs: ['5199072'] suites: ['clusters/1-mds-4-client-coloc', 'conf/{client', 'fs/basic_functional/{begin', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'supported-random-distros$/{centos_8}', 'tasks/client-recovery}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] Failure: Test failure: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) 2 jobs: ['5199100', '5199157'] suites intersection: ['clusters/1a3s-mds-2c-client', 'conf/{client', 'fs/multifs/{begin', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'osd}', 'overrides/{frag_enable', 'tasks/failover}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] suites union: ['clusters/1a3s-mds-2c-client', 'conf/{client', 'fs/multifs/{begin', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'objectstore-ec/bluestore-comp', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{frag_enable', 'supported-random-distros$/{centos_8}', 'supported-random-distros$/{rhel_8}', 'tasks/failover}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] Failure: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2 jobs: ['5199113', '5199039'] suites intersection: ['clusters/1-mds-4-client-coloc', 'conf/{client', 'fs/basic_functional/{begin', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile', 'osd}', 'overrides/{frag_enable', 'tasks/volumes}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] suites union: ['clusters/1-mds-4-client-coloc', 'conf/{client', 'fs/basic_functional/{begin', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{frag_enable', 'supported-random-distros$/{rhel_8}', 'supported-random-distros$/{ubuntu_latest}', 'tasks/volumes}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] Failure: Command failed on smithi180 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' 1 jobs: ['5199086'] suites: ['clusters/1-mds-4-client-coloc', 'conf/{client', 'fs/basic_functional/{begin', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'supported-random-distros$/{centos_8}', 'tasks/libcephfs_python}', 'whitelist_health', 'whitelist_wrongly_marked_down}']