2020-10-31T03:16:09.796 INFO:root:teuthology version: 1.0.0-f7de558 2020-10-31T03:16:09.797 INFO:teuthology.results:subset: '918/9999' 2020-10-31T03:16:09.797 INFO:teuthology.results:seed: '2477' 2020-10-31T03:16:23.840 INFO:root:teuthology version: 1.0.0-f7de558 2020-10-31T03:16:23.841 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-10-31T06:53:27.596 INFO:teuthology.results:Tests finished! gathering results... 2020-10-31T06:53:27.818 INFO:scrape:Found 2 jobs 2020-10-31T06:53:28.313 INFO:scrape:Found 2 distinct failure reasons 2020-10-31T06:53:28.314 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/mon/caps.sh 2020-10-31T06:53:28.314 INFO:scrape:1 jobs: ['5577165'] 2020-10-31T06:53:28.314 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/connectivity', 'msgr-failures/mon-delay', 'msgr/async', 'objectstore/bluestore-stupid', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{rhel_8}', 'thrashers/force-sync-many', 'workloads/rados_mon_workunits}'] 2020-10-31T06:53:28.315 INFO:scrape: 2020-10-31T06:53:28.315 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi197 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f8b93a9303721d3bdf5c33180c39b4d38dd1787 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2020-10-31T06:53:28.315 INFO:scrape:1 jobs: ['5577166'] 2020-10-31T06:53:28.316 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-partial-recovery}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_8}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/rados_api_tests}'] 2020-10-31T06:53:28.316 INFO:scrape: 2020-10-31T06:53:28.317 INFO:teuthology.results:Sending results to tchaikov@gmail.com: Test Run: kchai-2020-10-31_03:12:39-rados-wip-kefu-testing-2020-10-30-1822-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/kchai-2020-10-31_03:12:39-rados-wip-kefu-testing-2020-10-30-1822-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-31_03:12:39-rados-wip-kefu-testing-2020-10-30-1822-distro-basic-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [5577165] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 03:19:21 info: http://pulpito.ceph.com/kchai-2020-10-31_03:12:39-rados-wip-kefu-testing-2020-10-30-1822-distro-basic-smithi/5577165/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-31_03:12:39-rados-wip-kefu-testing-2020-10-30-1822-distro-basic-smithi/5577165/ sentry: https://sentry.ceph.com/ceph/sepia/?query=e92123e6b50740459c44574a4ecb3b51 Command failed (workunit test mon/caps.sh) on smithi184 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f8b93a9303721d3bdf5c33180c39b4d38dd1787 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh' [5577166] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:22:59 info: http://pulpito.ceph.com/kchai-2020-10-31_03:12:39-rados-wip-kefu-testing-2020-10-30-1822-distro-basic-smithi/5577166/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-10-31_03:12:39-rados-wip-kefu-testing-2020-10-30-1822-distro-basic-smithi/5577166/ sentry: https://sentry.ceph.com/ceph/sepia/?query=fb58bfc528474aa49a2fa5f27c1032bd Command failed (workunit test rados/test.sh) on smithi197 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f8b93a9303721d3bdf5c33180c39b4d38dd1787 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'