2021-01-31T19:34:02.049 INFO:root:teuthology version: 1.0.0-f185165d 2021-01-31T19:34:02.055 INFO:teuthology.results:subset: '3/9999' 2021-01-31T19:34:02.055 INFO:teuthology.results:seed: '9719' 2021-01-31T19:44:59.676 INFO:root:teuthology version: 1.0.0-f185165d 2021-01-31T19:44:59.708 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-01-31T21:11:01.357 INFO:teuthology.results:Tests finished! gathering results... 2021-01-31T21:11:04.837 INFO:scrape:Found 24 jobs 2021-01-31T21:11:10.714 INFO:scrape:Found 2 distinct failure reasons 2021-01-31T21:11:10.716 INFO:scrape:Failure: Command failed on smithi115 with status 1: 'sudo yum upgrade -y linux-firmware' 2021-01-31T21:11:10.716 INFO:scrape:19 jobs: ['5833542', '5833525', '5833530', '5833529', '5833541', '5833536', '5833519', '5833527', '5833523', '5833521', '5833538', '5833531', '5833532', '5833522', '5833528', '5833520', '5833533', '5833539', '5833535'] 2021-01-31T21:11:10.717 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'session_timeout', 'whitelist_health'] 2021-01-31T21:11:10.717 INFO:scrape:suites union: ['begin', 'centos_latest', 'ceph-thrash/mds', 'ceph-thrash/mon', 'clusters/3-mds', 'clusters/3-mds-2-standby', 'clusters/9-mds', 'clusters/9-mds-3-standby', 'conf/{client', 'fuse-default-perm-no}', 'inline/no', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mon-debug', 'mount', 'mount/fuse', 'mount/kclient/{k-testing', 'mount/kclient/{mount', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'msgr-failures/osd-mds-delay', 'multimds/basic/{0-supported-random-distro$/{centos_latest}', 'multimds/basic/{0-supported-random-distro$/{rhel_latest}', 'multimds/basic/{0-supported-random-distro$/{ubuntu_latest}', 'multimds/thrash/{0-supported-random-distro$/{rhel_latest}', 'multimds/verify/{begin', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{fuse-default-perm-no', 'q_check_counter/check_counter', 'rhel_8}', 'session_timeout', 'tasks/cephfs_test_snapshots}', 'tasks/cfuse_workunit_kernel_untar_build}', 'tasks/cfuse_workunit_misc}', 'tasks/cfuse_workunit_norstats}', 'tasks/cfuse_workunit_suites_blogbench}', 'tasks/cfuse_workunit_suites_dbench', 'tasks/cfuse_workunit_suites_ffsb}', 'tasks/cfuse_workunit_suites_fsstress', 'tasks/cfuse_workunit_suites_fsstress}', 'tasks/cfuse_workunit_suites_fsx}', 'tasks/cfuse_workunit_suites_pjd}', 'thrash/{frag_enable', 'thrash_debug}', 'validater/lockdep}', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'whitelist_wrongly_marked_down}}'] 2021-01-31T21:11:10.718 INFO:scrape: 2021-01-31T21:11:10.718 INFO:scrape:Failure: Command failed (workunit test suites/pjd.sh) on smithi013 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c676cbb9be59cfb21bd2ba9250035305ff2c9719 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/pjd.sh' 2021-01-31T21:11:10.719 INFO:scrape:1 jobs: ['5833534'] 2021-01-31T21:11:10.719 INFO:scrape:suites: ['begin', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{centos_latest}', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'q_check_counter/check_counter', 'session_timeout', 'tasks/cfuse_workunit_suites_pjd}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-01-31T21:11:10.720 INFO:scrape: 2021-01-31T21:11:10.721 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/ failed: 20 dead: 0 running: 0 waiting: 0 queued: 0 passed: 4 Fail ================================================================= [5833519] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833519/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833519/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d7ad129f41b4486fa01946276d459491 Command failed on smithi139 with status 1: 'sudo yum install -y kernel' [5833520] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833520/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833520/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8d6104f91a9948108b08c8118829a176 Command failed on smithi119 with status 1: 'sudo yum upgrade -y linux- firmware' [5833521] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833521/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833521/ sentry: https://sentry.ceph.com/organizations/ceph/?query=acf393ab1ff24eba8fefef846d1de1d0 Command failed on smithi174 with status 1: 'sudo yum install -y kernel' [5833522] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833522/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833522/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4b2286c10d5f49239b717627e0e680a4 Command failed on smithi019 with status 1: 'sudo yum install -y kernel' [5833523] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833523/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833523/ sentry: https://sentry.ceph.com/organizations/ceph/?query=77e83b3ff11f40e8a62f47d99665454d Command failed on smithi067 with status 1: 'sudo yum upgrade -y linux- firmware' [5833525] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833525/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833525/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f041f80541b545538e774ebafd819493 Command failed on smithi193 with status 1: 'sudo yum upgrade -y linux- firmware' [5833527] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833527/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833527/ sentry: https://sentry.ceph.com/organizations/ceph/?query=441d4329b9e1438d96c728613333261a Command failed on smithi053 with status 1: 'sudo yum upgrade -y linux- firmware' [5833528] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833528/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833528/ sentry: https://sentry.ceph.com/organizations/ceph/?query=27ffcbd29d1045b094afc6c0807f7e69 Command failed on smithi093 with status 1: 'sudo yum install -y kernel' [5833529] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833529/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833529/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4865e8877b98411da49e45ed717c86c6 Command failed on smithi025 with status 1: 'sudo yum install -y kernel' [5833530] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833530/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833530/ sentry: https://sentry.ceph.com/organizations/ceph/?query=625b03dd7d234eddb855d9e1b18eb11c Command failed on smithi198 with status 1: 'sudo yum install -y kernel' [5833531] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833531/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833531/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ecbc23dfe31a4f5b8ff9de3bdcee8bf0 Command failed on smithi115 with status 1: 'sudo yum install -y kernel' [5833532] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833532/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833532/ sentry: https://sentry.ceph.com/organizations/ceph/?query=edfc94ccd7d849b9a503e49dc79a0ba6 Command failed on smithi204 with status 1: 'sudo yum install -y kernel' [5833533] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833533/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833533/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c400ac7d18f49238c6d9ee7a5a0fb81 Command failed on smithi045 with status 1: 'sudo yum upgrade -y linux- firmware' [5833534] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd} ----------------------------------------------------------------- time: 00:25:21 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833534/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833534/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5f698f2d36304b50a7c46cf185e84281 Command failed (workunit test suites/pjd.sh) on smithi013 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c676cbb9be59cfb21bd2ba9250035305ff2c9719 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/pjd.sh' [5833535] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833535/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833535/ sentry: https://sentry.ceph.com/organizations/ceph/?query=62700ad9581f4005a7e26239240d4202 Command failed on smithi002 with status 1: 'sudo yum upgrade -y linux- firmware' [5833536] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833536/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833536/ sentry: https://sentry.ceph.com/organizations/ceph/?query=40d7b590cc094283b6b4396cfa533b57 Command failed on smithi139 with status 1: 'sudo yum upgrade -y linux- firmware' [5833538] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833538/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833538/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a03b0d2187b84d5495069b8b19b477f8 Command failed on smithi093 with status 1: 'sudo yum install -y kernel' [5833539] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833539/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833539/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad4a6965f62149f5882b06dfcf9ce7c1 Command failed on smithi184 with status 1: 'sudo yum install -y kernel' [5833541] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833541/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833541/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a07f946c39f8414d8cf0bdeb50761419 Command failed on smithi109 with status 1: 'sudo yum upgrade -y linux- firmware' [5833542] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833542/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833542/ sentry: https://sentry.ceph.com/organizations/ceph/?query=24c390fc031f4cb595041e140570f989 Command failed on smithi115 with status 1: 'sudo yum upgrade -y linux- firmware' Pass ================================================================= [5833524] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} time: 00:26:19 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833524/ [5833526] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench} time: 00:59:46 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833526/ [5833537] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports} time: 00:40:29 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833537/ [5833540] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} time: 00:30:18 info: http://pulpito.ceph.com/teuthology-2021-01-27_13:15:03-multimds-octopus-distro-basic-smithi/5833540/