2020-07-06T12:48:40.701 INFO:root:teuthology version: 1.0.0-82c08ed 2020-07-06T12:48:40.703 INFO:teuthology.results:subset: '0/4' 2020-07-06T12:48:40.703 INFO:teuthology.results:seed: '8338' 2020-07-06T15:31:36.548 INFO:root:teuthology version: 1.0.0-82c08ed 2020-07-06T15:31:37.274 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-07-07T03:15:59.752 INFO:teuthology.results:Tests finished! gathering results... 2020-07-07T03:16:21.273 INFO:scrape:Found 227 jobs 2020-07-07T03:17:22.103 INFO:scrape:Found 8 distinct failure reasons 2020-07-07T03:17:22.105 INFO:scrape:Failure: "2020-07-06T15:33:41.207133+0000 mon.b (mon.0) 150 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log 2020-07-07T03:17:22.106 INFO:scrape:57 jobs 2020-07-07T03:17:22.107 INFO:scrape:suites intersection: ['conf/{client.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'osd.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-07-07T03:17:22.108 INFO:scrape:suites union: ['centos_latest.yaml', 'ceph-thrash/mds.yaml', 'ceph-thrash/mon.yaml', 'clusters/1-mds-1-client-coloc.yaml', 'clusters/1-mds-3-client.yaml', 'clusters/1-mds-4-client-coloc.yaml', 'clusters/1a3s-mds-2c-client.yaml', 'clusters/fixed-2-ucephfs.yaml', 'conf/{client.yaml', 'distros/ubuntu_latest.yaml', 'frag_enable.yaml', 'fs/32bits/{begin.yaml', 'fs/basic_functional/{begin.yaml', 'fs/basic_workload/{begin.yaml', 'fs/multiclient/{begin.yaml', 'fs/multifs/{begin.yaml', 'fs/permission/{begin.yaml', 'fs/thrash/{begin.yaml', 'fs/traceless/{begin.yaml', 'fs/verify/{begin.yaml', 'inline/no.yaml', 'inline/yes.yaml', 'mds.yaml', 'mon-debug.yaml', 'mon.yaml', 'mount/fuse.yaml', 'msgr-failures/none.yaml', 'msgr-failures/osd-mds-delay.yaml', 'no_client_pidfile.yaml', 'objectstore-ec/bluestore-bitmap.yaml', 'objectstore-ec/bluestore-comp-ec-root.yaml', 'objectstore-ec/bluestore-comp.yaml', 'objectstore-ec/bluestore-ec-root.yaml', 'objectstore-ec/filestore-xfs.yaml', 'objectstore/bluestore-bitmap.yaml', 'objectstore/bluestore-ec-root.yaml', 'omap_limit/10.yaml', 'omap_limit/10000.yaml', 'osd.yaml}', 'overrides/{faked-ino.yaml', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{centos_latest.yaml}', 'supported-random-distros$/{rhel_latest.yaml}', 'supported-random-distros$/{ubuntu_latest.yaml}', 'tasks/admin.yaml}', 'tasks/auto-repair.yaml}', 'tasks/cap-flush.yaml}', 'tasks/cephfs-shell.yaml}', 'tasks/cephfs_misc_tests.yaml}', 'tasks/cfuse_workunit_kernel_untar_build.yaml}', 'tasks/cfuse_workunit_misc.yaml}', 'tasks/cfuse_workunit_misc_test_o_trunc.yaml}', 'tasks/cfuse_workunit_norstats.yaml}', 'tasks/cfuse_workunit_quota.yaml}', 'tasks/cfuse_workunit_snaptests.yaml}', 'tasks/cfuse_workunit_suites_blogbench.yaml', 'tasks/cfuse_workunit_suites_blogbench.yaml}', 'tasks/cfuse_workunit_suites_dbench.yaml', 'tasks/cfuse_workunit_suites_dbench.yaml}', 'tasks/cfuse_workunit_suites_ffsb.yaml}', 'tasks/cfuse_workunit_suites_fsstress.yaml', 'tasks/cfuse_workunit_suites_fsstress.yaml}', 'tasks/cfuse_workunit_suites_fsx.yaml}', 'tasks/cfuse_workunit_suites_iogen.yaml}', 'tasks/cfuse_workunit_suites_pjd.yaml}', 'tasks/cfuse_workunit_trivial_sync.yaml}', 'tasks/client-readahad.yaml}', 'tasks/damage.yaml}', 'tasks/failover.yaml}', 'tasks/forward-scrub.yaml}', 'tasks/fragment.yaml}', 'tasks/ior-shared-file.yaml}', 'tasks/mdtest.yaml}', 'tasks/volumes.yaml}', 'traceless/50pc.yaml}', 'validater/lockdep.yaml}', 'validater/valgrind.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-07-07T03:17:22.108 INFO:scrape: 2020-07-07T03:17:22.108 INFO:scrape:Failure: Test failure: test_subvolume_pin_export (tasks.cephfs.test_volumes.TestVolumes) 2020-07-07T03:17:22.109 INFO:scrape:1 jobs: ['5203215'] 2020-07-07T03:17:22.109 INFO:scrape:suites: ['clusters/1-mds-4-client-coloc.yaml', 'conf/{client.yaml', 'fs/basic_functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'no_client_pidfile.yaml', 'objectstore/bluestore-bitmap.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{centos_latest.yaml}', 'tasks/volumes.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-07-07T03:17:22.110 INFO:scrape: 2020-07-07T03:17:22.110 INFO:scrape:Dead: b'2020-07-07T01:09:23.360 DEBUG:teuthology.exit:Finished running handlers' 2020-07-07T03:17:22.111 INFO:scrape:6 jobs: ['5203029', '5203060', '5203001', '5203192', '5203096', '5203125'] 2020-07-07T03:17:22.111 INFO:scrape:suites intersection: ['1-client.yaml', '2-upgrade.yaml', 'clusters/1-mds-2-client-micro.yaml', 'conf/{client.yaml', 'mds.yaml', 'mon.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'pg-warn.yaml', 'tasks/{0-mimic.yaml', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-07-07T03:17:22.112 INFO:scrape:suites union: ['1-client.yaml', '2-upgrade.yaml', '3-client-upgrade.yaml', '3-compat_client/mimic.yaml}}', '3-compat_client/no.yaml}}', '3-verify.yaml}', '4-compat_client.yaml', '5-client-sanity.yaml}}', 'clusters/1-mds-2-client-micro.yaml', 'conf/{client.yaml', 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap.yaml', 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap.yaml', 'fs/upgrade/volumes/import-legacy/{bluestore-bitmap.yaml', 'mds.yaml', 'mon.yaml', 'multimds/no.yaml', 'multimds/yes.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'pg-warn.yaml', 'tasks/{0-mimic.yaml', 'ubuntu_18.04.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-07-07T03:17:22.112 INFO:scrape: 2020-07-07T03:17:22.113 INFO:scrape:Failure: Test failure: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 2020-07-07T03:17:22.113 INFO:scrape:1 jobs: ['5203127'] 2020-07-07T03:17:22.114 INFO:scrape:suites: ['clusters/1-mds-4-client-coloc.yaml', 'conf/{client.yaml', 'fs/basic_functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'no_client_pidfile.yaml', 'objectstore/bluestore-bitmap.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{rhel_latest.yaml}', 'tasks/backtrace.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-07-07T03:17:22.115 INFO:scrape: 2020-07-07T03:17:22.115 INFO:scrape:Failure: Command failed on smithi140 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic' 2020-07-07T03:17:22.115 INFO:scrape:2 jobs: ['5203075', '5203161'] 2020-07-07T03:17:22.116 INFO:scrape:suites intersection: ['conf/{client.yaml', 'mds.yaml', 'mon.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-07-07T03:17:22.116 INFO:scrape:suites union: ['1-client.yaml', '2-upgrade.yaml', '3-client-upgrade.yaml', '4-compat_client.yaml', '5-client-sanity.yaml}}', 'clusters/1-mds-2-client-micro.yaml', 'clusters/fixed-2-ucephfs.yaml', 'conf/{client.yaml', 'fs/basic_workload/{begin.yaml', 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap.yaml', 'inline/no.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'multimds/yes.yaml', 'objectstore-ec/bluestore-ec-root.yaml', 'omap_limit/10.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'pg-warn.yaml', 'supported-random-distros$/{ubuntu_latest.yaml}', 'tasks/cfuse_workunit_suites_pjd.yaml}', 'tasks/{0-mimic.yaml', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-07-07T03:17:22.117 INFO:scrape: 2020-07-07T03:17:22.117 INFO:scrape:Failure: Test failure: test_reading_conf_after_resetting_opt (tasks.cephfs.test_cephfs_shell.TestConfReading) 2020-07-07T03:17:22.117 INFO:scrape:1 jobs: ['5203024'] 2020-07-07T03:17:22.118 INFO:scrape:suites: ['clusters/1-mds-4-client-coloc.yaml', 'conf/{client.yaml', 'fs/basic_functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'no_client_pidfile.yaml', 'objectstore/bluestore-ec-root.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{centos_latest.yaml}', 'tasks/cephfs-shell.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-07-07T03:17:22.118 INFO:scrape: 2020-07-07T03:17:22.119 INFO:scrape:Failure: Command failed on smithi150 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' 2020-07-07T03:17:22.119 INFO:scrape:1 jobs: ['5203158'] 2020-07-07T03:17:22.120 INFO:scrape:suites: ['centos_latest.yaml', 'clusters/fixed-2-ucephfs.yaml', 'conf/{client.yaml', 'fs/verify/{begin.yaml', 'mds.yaml', 'mon-debug.yaml', 'mon.yaml', 'mount/fuse.yaml', 'objectstore-ec/bluestore-comp.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'tasks/cfuse_workunit_suites_fsstress.yaml', 'validater/valgrind.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-07-07T03:17:22.120 INFO:scrape: 2020-07-07T03:17:22.121 INFO:scrape:Failure: Test failure: test_abort_conn (tasks.cephfs.test_client_recovery.TestClientRecovery) 2020-07-07T03:17:22.122 INFO:scrape:1 jobs: ['5203038'] 2020-07-07T03:17:22.122 INFO:scrape:suites: ['clusters/1-mds-4-client-coloc.yaml', 'conf/{client.yaml', 'fs/basic_functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'no_client_pidfile.yaml', 'objectstore/bluestore-bitmap.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{ubuntu_latest.yaml}', 'tasks/client-recovery.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-07-07T03:17:22.123 INFO:scrape: