2020-06-27T13:11:13.156 INFO:root:teuthology version: 1.0.0-22bcea5 2020-06-27T13:11:13.158 INFO:teuthology.results:subset: '0/4' 2020-06-27T13:11:13.158 INFO:teuthology.results:seed: '7734' 2020-06-27T15:11:51.293 INFO:root:teuthology version: 1.0.0-22bcea5 2020-06-27T15:11:51.315 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-06-27T17:33:55.452 INFO:teuthology.results:Tests finished! gathering results... 2020-06-27T17:34:13.932 INFO:scrape:Found 225 jobs 2020-06-27T17:35:12.053 INFO:scrape:Found 5 distinct failure reasons 2020-06-27T17:35:12.055 INFO:scrape:Failure: "2020-06-27T14:52:03.177467+0000 mon.b (mon.0) 146 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log 2020-06-27T17:35:12.056 INFO:scrape:47 jobs 2020-06-27T17:35:12.057 INFO:scrape:suites intersection: ['conf/{client.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-06-27T17:35:12.057 INFO:scrape:suites union: ['centos_latest.yaml', 'ceph-thrash/mds.yaml', 'ceph-thrash/mon.yaml', 'clusters/1-mds-1-client-coloc.yaml', 'clusters/1-mds-2-client.yaml', 'clusters/1-mds-3-client.yaml', 'clusters/1-mds-4-client-coloc.yaml', 'clusters/fixed-2-ucephfs.yaml', 'conf/{client.yaml', 'distros/ubuntu_latest.yaml', 'fs/basic_functional/{begin.yaml', 'fs/basic_workload/{begin.yaml', 'fs/multiclient/{begin.yaml', 'fs/permission/{begin.yaml', 'fs/thrash/{begin.yaml', 'fs/traceless/{begin.yaml', 'fs/verify/{begin.yaml', 'inline/no.yaml', 'inline/yes.yaml', 'mds.yaml', 'mon-debug.yaml', 'mon.yaml', 'mount/fuse.yaml', 'msgr-failures/none.yaml', 'msgr-failures/osd-mds-delay.yaml', 'no_client_pidfile.yaml', 'objectstore-ec/bluestore-bitmap.yaml', 'objectstore-ec/bluestore-comp-ec-root.yaml', 'objectstore-ec/bluestore-comp.yaml', 'objectstore-ec/bluestore-ec-root.yaml', 'objectstore-ec/filestore-xfs.yaml', 'objectstore/bluestore-bitmap.yaml', 'objectstore/bluestore-ec-root.yaml', 'omap_limit/10.yaml', 'omap_limit/10000.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{centos_8.yaml}', 'supported-random-distros$/{rhel_8.yaml}', 'supported-random-distros$/{ubuntu_latest.yaml}', 'tasks/alternate-pool.yaml}', 'tasks/auto-repair.yaml}', 'tasks/backtrace.yaml}', 'tasks/cap-flush.yaml}', 'tasks/cephfs-shell.yaml}', 'tasks/cephfs_misc_tests.yaml}', 'tasks/cfuse_workunit_misc.yaml}', 'tasks/cfuse_workunit_norstats.yaml}', 'tasks/cfuse_workunit_quota.yaml}', 'tasks/cfuse_workunit_snaptests.yaml}', 'tasks/cfuse_workunit_suites_dbench.yaml', 'tasks/cfuse_workunit_suites_dbench.yaml}', 'tasks/cfuse_workunit_suites_ffsb.yaml}', 'tasks/cfuse_workunit_suites_fsstress.yaml', 'tasks/cfuse_workunit_suites_fsstress.yaml}', 'tasks/cfuse_workunit_suites_fsx.yaml}', 'tasks/cfuse_workunit_suites_fsync.yaml}', 'tasks/cfuse_workunit_suites_iogen.yaml}', 'tasks/cfuse_workunit_suites_iozone.yaml}', 'tasks/cfuse_workunit_suites_pjd.yaml}', 'tasks/cfuse_workunit_suites_truncate_delay.yaml}', 'tasks/cfuse_workunit_trivial_sync.yaml}', 'tasks/client-recovery.yaml}', 'tasks/data-scan.yaml}', 'tasks/mds-full.yaml}', 'tasks/mdtest.yaml}', 'tasks/sessionmap/{sessionmap.yaml}}', 'tasks/volume-client/{task/test/{test.yaml}}}', 'tasks/volumes.yaml}', 'traceless/50pc.yaml}', 'validater/lockdep.yaml}', 'validater/valgrind.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-06-27T17:35:12.058 INFO:scrape: 2020-06-27T17:35:12.058 INFO:scrape:Failure: Command failed on smithi174 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' 2020-06-27T17:35:12.059 INFO:scrape:2 jobs: ['5183866', '5183924'] 2020-06-27T17:35:12.059 INFO:scrape:suites intersection: ['conf/{client.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{centos_8.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-06-27T17:35:12.060 INFO:scrape:suites union: ['ceph-thrash/mon.yaml', 'clusters/1-mds-1-client-coloc.yaml', 'clusters/1a3s-mds-2c-client.yaml', 'conf/{client.yaml', 'fs/multifs/{begin.yaml', 'fs/thrash/{begin.yaml', 'mds.yaml', 'mon-debug.yaml', 'mon.yaml', 'mount/fuse.yaml', 'msgr-failures/osd-mds-delay.yaml', 'objectstore-ec/bluestore-comp.yaml', 'objectstore-ec/bluestore-ec-root.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{centos_8.yaml}', 'tasks/cfuse_workunit_suites_fsstress.yaml}', 'tasks/failover.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-06-27T17:35:12.060 INFO:scrape: 2020-06-27T17:35:12.061 INFO:scrape:Failure: Command failed (workunit test libcephfs/test.sh) on smithi049 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8b33a29f3a7f00f8e6f971159aa875abdbdf0dd9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2020-06-27T17:35:12.062 INFO:scrape:4 jobs: ['5183907', '5183861', '5183817', '5183951'] 2020-06-27T17:35:12.063 INFO:scrape:suites intersection: ['clusters/fixed-2-ucephfs.yaml', 'conf/{client.yaml', 'fs/basic_workload/{begin.yaml', 'inline/yes.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'omap_limit/10000.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'tasks/libcephfs_interface_tests.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-06-27T17:35:12.063 INFO:scrape:suites union: ['clusters/fixed-2-ucephfs.yaml', 'conf/{client.yaml', 'fs/basic_workload/{begin.yaml', 'inline/yes.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'objectstore-ec/bluestore-bitmap.yaml', 'objectstore-ec/bluestore-comp-ec-root.yaml', 'objectstore-ec/bluestore-comp.yaml', 'objectstore-ec/bluestore-ec-root.yaml', 'omap_limit/10000.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{centos_8.yaml}', 'supported-random-distros$/{rhel_8.yaml}', 'supported-random-distros$/{ubuntu_latest.yaml}', 'tasks/libcephfs_interface_tests.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-06-27T17:35:12.064 INFO:scrape: 2020-06-27T17:35:12.064 INFO:scrape:Failure: Command failed (workunit test suites/pjd.sh) on smithi047 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8b33a29f3a7f00f8e6f971159aa875abdbdf0dd9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/pjd.sh' 2020-06-27T17:35:12.065 INFO:scrape:4 jobs: ['5183845', '5183934', '5183799', '5183889'] 2020-06-27T17:35:12.065 INFO:scrape:suites intersection: ['clusters/fixed-2-ucephfs.yaml', 'conf/{client.yaml', 'fs/permission/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'tasks/cfuse_workunit_suites_pjd.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-06-27T17:35:12.066 INFO:scrape:suites union: ['clusters/fixed-2-ucephfs.yaml', 'conf/{client.yaml', 'fs/permission/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'objectstore-ec/bluestore-bitmap.yaml', 'objectstore-ec/bluestore-comp-ec-root.yaml', 'objectstore-ec/bluestore-comp.yaml', 'objectstore-ec/bluestore-ec-root.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{centos_8.yaml}', 'supported-random-distros$/{rhel_8.yaml}', 'supported-random-distros$/{ubuntu_latest.yaml}', 'tasks/cfuse_workunit_suites_pjd.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-06-27T17:35:12.066 INFO:scrape: 2020-06-27T17:35:12.066 INFO:scrape:Failure: Test failure: test_subvolume_pin_export (tasks.cephfs.test_volumes.TestVolumes) 2020-06-27T17:35:12.067 INFO:scrape:1 jobs: ['5183995'] 2020-06-27T17:35:12.067 INFO:scrape:suites: ['clusters/1-mds-4-client-coloc.yaml', 'conf/{client.yaml', 'fs/basic_functional/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'no_client_pidfile.yaml', 'objectstore/bluestore-bitmap.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'supported-random-distros$/{rhel_8.yaml}', 'tasks/volumes.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2020-06-27T17:35:12.068 INFO:scrape: