2020-07-02T04:39:40.948 INFO:root:teuthology version: 1.0.0-5208279 2020-07-02T04:39:40.950 INFO:teuthology.results:subset: '16/9999' 2020-07-02T04:39:40.950 INFO:teuthology.results:seed: '541' 2020-07-02T04:55:34.788 INFO:root:teuthology version: 1.0.0-5208279 2020-07-02T04:55:34.824 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-07-02T06:31:36.833 INFO:teuthology.results:Tests finished! gathering results... 2020-07-02T06:31:39.560 INFO:scrape:Found 24 jobs 2020-07-02T06:31:53.480 INFO:scrape:Found 3 distinct failure reasons 2020-07-02T06:31:53.484 INFO:scrape:Failure: "2020-07-02T05:16:11.349439+0000 mon.b (mon.0) 191 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log 2020-07-02T06:31:53.484 INFO:scrape:4 jobs: ['5192863', '5192859', '5192862', '5192865'] 2020-07-02T06:31:53.486 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'whitelist_health'] 2020-07-02T06:31:53.487 INFO:scrape:suites union: ['begin', 'centos_latest', 'clusters/3-mds', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/no', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mon-debug', 'mount', 'mount/fuse', 'mount/kclient/{k-testing', 'mount/kclient/{mount', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{centos_8}', 'multimds/basic/{0-supported-random-distro$/{rhel_8}', 'multimds/verify/{begin', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{fuse-default-perm-no', 'q_check_counter/check_counter', 'rhel_8}', 'tasks/cfuse_workunit_norstats}', 'tasks/cfuse_workunit_suites_blogbench}', 'tasks/cfuse_workunit_suites_dbench', 'tasks/cfuse_workunit_suites_dbench}', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'whitelist_wrongly_marked_down}}'] 2020-07-02T06:31:53.487 INFO:scrape: 2020-07-02T06:31:53.488 INFO:scrape:Failure: Command failed on smithi131 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' 2020-07-02T06:31:53.489 INFO:scrape:17 jobs: ['5192864', '5192881', '5192878', '5192860', '5192880', '5192867', '5192879', '5192876', '5192869', '5192872', '5192868', '5192858', '5192871', '5192877', '5192861', '5192873', '5192870'] 2020-07-02T06:31:53.490 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'whitelist_health'] 2020-07-02T06:31:53.490 INFO:scrape:suites union: ['begin', 'centos_latest', 'ceph-thrash/mds', 'ceph-thrash/mon', 'clusters/3-mds', 'clusters/3-mds-2-standby', 'clusters/9-mds', 'clusters/9-mds-3-standby', 'conf/{client', 'fuse-default-perm-no}', 'inline/no', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mon-debug', 'mount', 'mount/fuse', 'mount/kclient/{k-testing', 'mount/kclient/{mount', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'msgr-failures/osd-mds-delay', 'multimds/basic/{0-supported-random-distro$/{centos_8}', 'multimds/basic/{0-supported-random-distro$/{rhel_8}', 'multimds/thrash/{0-supported-random-distro$/{centos_8}', 'multimds/thrash/{0-supported-random-distro$/{rhel_8}', 'multimds/verify/{begin', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{fuse-default-perm-no', 'q_check_counter/check_counter', 'rhel_8}', 'tasks/cfuse_workunit_kernel_untar_build}', 'tasks/cfuse_workunit_misc}', 'tasks/cfuse_workunit_suites_dbench', 'tasks/cfuse_workunit_suites_fsstress', 'tasks/cfuse_workunit_suites_fsstress}', 'tasks/cfuse_workunit_suites_fsx}', 'tasks/cfuse_workunit_suites_pjd}', 'thrash/{frag_enable', 'thrash_debug}', 'validater/lockdep}', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'whitelist_wrongly_marked_down}}'] 2020-07-02T06:31:53.491 INFO:scrape: 2020-07-02T06:31:53.491 INFO:scrape:Failure: Command failed on smithi055 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' 2020-07-02T06:31:53.492 INFO:scrape:1 jobs: ['5192866'] 2020-07-02T06:31:53.492 INFO:scrape:suites: ['begin', 'clusters/3-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/no', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{ubuntu_latest}', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/testing/{flavor/centos_latest', 'q_check_counter/check_counter', 'tasks/cfuse_workunit_suites_ffsb}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-07-02T06:31:53.492 INFO:scrape: 2020-07-02T06:31:53.495 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/ failed: 22 dead: 0 running: 0 waiting: 0 queued: 0 passed: 2 Fail ================================================================= [5192858] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc} ----------------------------------------------------------------- time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192858/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192858/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3491af9fab424dacb356fc757eca777c Command failed on smithi157 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192859] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats} ----------------------------------------------------------------- time: 00:44:01 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192859/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192859/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ed04f672fe084e3db9e401ae1f337353 "2020-07-02T04:57:49.477229+0000 mon.b (mon.0) 196 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5192860] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:21:23 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192860/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192860/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=60cfdc658ae549de8f96590b9ad4d23a Command failed on smithi203 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192861] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep} ----------------------------------------------------------------- time: 00:17:09 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192861/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192861/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e0e2481415094cb3a2407b54f6c08f5a Command failed on smithi007 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192862] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench} ----------------------------------------------------------------- time: 00:50:21 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192862/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192862/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=45b965f2cb924842a6fe6c763528d97e "2020-07-02T05:07:23.630110+0000 mon.a (mon.0) 154 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY)" in cluster log [5192863] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench} ----------------------------------------------------------------- time: 00:48:38 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192863/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192863/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fb921d5e20dc4adb8fd4b3281f1a5813 "2020-07-02T05:16:11.349439+0000 mon.b (mon.0) 191 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5192864] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} ----------------------------------------------------------------- time: 00:19:21 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192864/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192864/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=76d5060bd80f49e79413e0e361b40ab0 Command failed on smithi131 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192865] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind} ----------------------------------------------------------------- time: 01:26:56 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192865/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192865/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a68cf72445e44384aa7b527e8a404782 "2020-07-02T05:51:05.483631+0000 mon.a (mon.0) 295 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5192866] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb} ----------------------------------------------------------------- time: 00:05:49 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192866/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192866/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b60cb978a4934b369394ed4e33df664f Command failed on smithi055 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr- devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel' [5192867] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:15:14 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192867/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192867/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=80d601dd9a1a488fa64dad14bd5bbe5a Command failed on smithi166 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192868] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:15:39 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192868/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192868/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fa3db53d0e504b8585a3ee90396a4d8c Command failed on smithi120 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192869] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep} ----------------------------------------------------------------- time: 00:15:34 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192869/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192869/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d307bc4ee10a4c7aa79cb9058e75baba Command failed on smithi154 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192870] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx} ----------------------------------------------------------------- time: 00:23:48 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192870/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192870/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c2029c43fe944d0ba8eb76db22d7255f Command failed on smithi195 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192871] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd} ----------------------------------------------------------------- time: 00:19:43 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192871/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192871/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b96f47005c6e4deba1a25cc69e86b6b2 Command failed on smithi162 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192872] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} ----------------------------------------------------------------- time: 00:15:20 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192872/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192872/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=323c26dd64cc4b6f9337677bbcf3039d Command failed on smithi067 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192873] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind} ----------------------------------------------------------------- time: 00:56:38 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192873/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192873/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6faa89ac5f4f4e3ba67c04cc102c30f8 Command failed on smithi122 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192876] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} ----------------------------------------------------------------- time: 00:17:17 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192876/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192876/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b0901f089c6844808f7bb44243c2e552 Command failed on smithi124 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192877] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep} ----------------------------------------------------------------- time: 00:16:12 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192877/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192877/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=531eb01447c44ec8af5456bba42546bc Command failed on smithi018 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192878] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build} ----------------------------------------------------------------- time: 00:24:44 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192878/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192878/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3ebb27ef777045d1a9575133ea40fa02 Command failed on smithi042 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192879] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc} ----------------------------------------------------------------- time: 00:20:46 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192879/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192879/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6ad7d079880d4bc9a73ff4b04ad33a7b Command failed on smithi196 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192880] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:21:25 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192880/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192880/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8b16b2f151d443a695e9cb30981b0ece Command failed on smithi061 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5192881] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind} ----------------------------------------------------------------- time: 00:52:28 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192881/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192881/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d5ec2708bcd24ce4a4f6ff2442ec987d Command failed on smithi133 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' Pass ================================================================= [5192874] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports} time: 00:44:27 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192874/ [5192875] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:20:38 info: http://pulpito.ceph.com/teuthology-2020-07-01_04:15:02-multimds-master-testing-basic-smithi/5192875/