2021-02-06T16:36:04.922 INFO:root:teuthology version: 1.1.0-17c09965 2021-02-06T16:36:04.924 INFO:teuthology.results:subset: '111/120000' 2021-02-06T16:36:04.924 INFO:teuthology.results:seed: '8347' 2021-02-06T16:51:35.866 INFO:root:teuthology version: 1.1.0-17c09965 2021-02-06T16:51:35.892 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-02-06T17:37:36.738 INFO:teuthology.results:Tests finished! gathering results... 2021-02-06T17:37:38.376 INFO:scrape:Found 24 jobs 2021-02-06T17:37:40.256 INFO:scrape:Found 1 distinct failure reasons 2021-02-06T17:37:40.256 INFO:scrape:Failure: Command failed on smithi172 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' 2021-02-06T17:37:40.257 INFO:scrape:21 jobs: ['5847400', '5847402', '5847420', '5847406', '5847432', '5847424', '5847433', '5847408', '5847422', '5847410', '5847412', '5847431', '5847429', '5847418', '5847398', '5847428', '5847426', '5847414', '5847416', '5847404', '5847434'] 2021-02-06T17:37:40.257 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'session_timeout', 'whitelist_health'] 2021-02-06T17:37:40.258 INFO:scrape:suites union: ['begin', 'centos_latest', 'ceph-thrash/mds', 'ceph-thrash/mon', 'clusters/3-mds', 'clusters/3-mds-2-standby', 'clusters/9-mds', 'clusters/9-mds-3-standby', 'conf/{client', 'fuse-default-perm-no}', 'inline/no', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mon-debug', 'mount', 'mount/fuse', 'mount/kclient/{k-testing', 'mount/kclient/{mount', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'msgr-failures/osd-mds-delay', 'multimds/basic/{0-supported-random-distro$/{centos_latest}', 'multimds/basic/{0-supported-random-distro$/{rhel_latest}', 'multimds/basic/{0-supported-random-distro$/{ubuntu_latest}', 'multimds/thrash/{0-supported-random-distro$/{rhel_latest}', 'multimds/thrash/{0-supported-random-distro$/{ubuntu_latest}', 'multimds/verify/{begin', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{fuse-default-perm-no', 'q_check_counter/check_counter', 'rhel_8}', 'session_timeout', 'tasks/cfuse_workunit_kernel_untar_build}', 'tasks/cfuse_workunit_misc}', 'tasks/cfuse_workunit_norstats}', 'tasks/cfuse_workunit_suites_blogbench}', 'tasks/cfuse_workunit_suites_dbench', 'tasks/cfuse_workunit_suites_dbench}', 'tasks/cfuse_workunit_suites_ffsb}', 'tasks/cfuse_workunit_suites_fsstress', 'tasks/cfuse_workunit_suites_fsstress}', 'tasks/cfuse_workunit_suites_fsx}', 'tasks/cfuse_workunit_suites_pjd}', 'thrash/{frag_enable', 'thrash_debug}', 'validater/lockdep}', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'whitelist_wrongly_marked_down}}'] 2021-02-06T17:37:40.259 INFO:scrape: 2021-02-06T17:37:40.260 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/ failed: 21 dead: 0 running: 0 waiting: 0 queued: 0 passed: 3 Fail ================================================================= [5847398] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats} ----------------------------------------------------------------- time: 00:09:10 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847398/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847398/ sentry: https://sentry.ceph.com/organizations/ceph/?query=db4edbf2090946e2b4107ba69b135d43 Command failed on smithi121 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847400] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep} ----------------------------------------------------------------- time: 00:12:16 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847400/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847400/ sentry: https://sentry.ceph.com/organizations/ceph/?query=beb5530193ad4e11afae8555bf7a87fd Command failed on smithi172 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847402] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench} ----------------------------------------------------------------- time: 00:12:55 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847402/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847402/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bda68d0ee0ad4289b3adab849e848a49 Command failed on smithi169 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847404] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} ----------------------------------------------------------------- time: 00:10:02 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847404/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847404/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3590ffd5700249e28a5669faf326b512 Command failed on smithi129 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847406] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench} ----------------------------------------------------------------- time: 00:12:24 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847406/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847406/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0d1b937214ef4ee5845c3ed3dc33bb49 Command failed on smithi199 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847408] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind} ----------------------------------------------------------------- time: 00:32:11 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847408/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847408/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1623ba0b46a546acb08f3d0b7a3c9b6b Command failed on smithi118 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847410] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb} ----------------------------------------------------------------- time: 00:10:48 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847410/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847410/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e0074df38b134842bbae0bda70edd94b Command failed on smithi198 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847412] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:12:46 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847412/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847412/ sentry: https://sentry.ceph.com/organizations/ceph/?query=124151e0cbb64141bf2a649cec4cd224 Command failed on smithi181 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847414] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:10:11 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847414/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847414/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ee657134b0ef4a72b57299a9dfe6859c Command failed on smithi111 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847416] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep} ----------------------------------------------------------------- time: 00:12:24 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847416/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847416/ sentry: https://sentry.ceph.com/organizations/ceph/?query=19b49d8b9fc745b7b217ff033e078d35 Command failed on smithi204 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847418] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx} ----------------------------------------------------------------- time: 00:12:10 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847418/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847418/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4f1cbb5038d7468c9b1fe57d9122433c Command failed on smithi159 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847420] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} ----------------------------------------------------------------- time: 00:12:08 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847420/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847420/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1ce2612a0a0a4c31b041e22d71631546 Command failed on smithi156 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847422] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd} ----------------------------------------------------------------- time: 00:12:21 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847422/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847422/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8cb15bd14e944ae8bf5b25d1e257beb6 Command failed on smithi189 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847424] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind} ----------------------------------------------------------------- time: 00:28:35 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847424/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847424/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1d10ab50bd354de086f505ebf4866df6 Command failed on smithi120 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847426] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:10:34 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847426/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847426/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8d4f86d7d91a43838b26832d3885c85c Command failed on smithi092 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847428] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep} ----------------------------------------------------------------- time: 00:10:15 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847428/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847428/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4d69e48ed3f44854af03714c48f526fe Command failed on smithi085 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847429] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build} ----------------------------------------------------------------- time: 00:12:27 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847429/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847429/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0aafe247daf5429b84314e2780c27548 Command failed on smithi062 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847431] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc} ----------------------------------------------------------------- time: 00:11:56 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847431/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847431/ sentry: https://sentry.ceph.com/organizations/ceph/?query=24068607d4404065b3069cce79c07a65 Command failed on smithi196 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847432] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind} ----------------------------------------------------------------- time: 00:26:38 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847432/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847432/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8bb2341a02dc47998b8eac3809f0a91b Command failed on smithi176 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847433] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats} ----------------------------------------------------------------- time: 00:10:41 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847433/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847433/ sentry: https://sentry.ceph.com/organizations/ceph/?query=405caae2e3224c9194ad6916bd85a6df Command failed on smithi174 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' [5847434] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:12:51 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847434/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847434/ sentry: https://sentry.ceph.com/organizations/ceph/?query=69a1614d1ee642ad87132cde7b7a6e6a Command failed on smithi109 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c4d0321cb90016cacbdece9c32422c1fc10eb090' Pass ================================================================= [5847425] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports} time: 00:43:47 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847425/ [5847427] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:26:27 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847427/ [5847430] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} time: 00:09:55 info: http://pulpito.ceph.com/yuriw-2021-02-01_21:58:39-multimds-wip-yuri2-testing-2021-02-01-1010-octopus-distro-basic-smithi/5847430/