2023-10-19T05:38:43.527 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-19T05:38:43.549 INFO:teuthology.results:seed: '6523' 2023-10-19T05:47:09.411 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-19T05:47:09.414 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-10-19T09:09:24.591 INFO:teuthology.results:Tests finished! gathering results... 2023-10-19T09:09:25.035 INFO:scrape:Found 10 jobs 2023-10-19T09:09:25.214 INFO:scrape:Found 1 distinct failure reasons 2023-10-19T09:09:25.215 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2023-10-19T09:09:25.215 INFO:scrape:7 jobs: ['7432235', '7432243', '7432244', '7432236', '7432240', '7432238', '7432241'] 2023-10-19T09:09:25.216 INFO:scrape:suites intersection: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_api_tests}'] 2023-10-19T09:09:25.216 INFO:scrape:suites union: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_api_tests}'] 2023-10-19T09:09:25.217 INFO:scrape: 2023-10-19T09:09:25.218 INFO:teuthology.results:Sending results to yingxin.cheng@intel.com: Test Run: yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/ failed: 7 dead: 0 running: 0 waiting: 0 queued: 0 passed: 3 Fail ================================================================= [7432235] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} ----------------------------------------------------------------- time: 03:12:49 info: http://pulpito.ceph.com/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432235/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432235/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d21a7f15393c443b9fc568a531bfdb23 Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi050 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=123d5b77a46451cbc24b877e551c5efbcd32c1c2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims on_librbd.sh' [7432236] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} ----------------------------------------------------------------- time: 03:11:58 info: http://pulpito.ceph.com/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432236/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432236/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2472104946eb4a259572488c37188fd5 Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi071 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=123d5b77a46451cbc24b877e551c5efbcd32c1c2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims on_librbd.sh' [7432238] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} ----------------------------------------------------------------- time: 03:13:06 info: http://pulpito.ceph.com/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432238/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432238/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c4cf52826459433590fa719e66f22d9f Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi006 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=123d5b77a46451cbc24b877e551c5efbcd32c1c2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims on_librbd.sh' [7432240] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} ----------------------------------------------------------------- time: 03:12:29 info: http://pulpito.ceph.com/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432240/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432240/ sentry: https://sentry.ceph.com/organizations/ceph/?query=26256189b2ae45e1b01495e57b4f0dfc Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi070 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=123d5b77a46451cbc24b877e551c5efbcd32c1c2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims on_librbd.sh' [7432241] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} ----------------------------------------------------------------- time: 03:12:14 info: http://pulpito.ceph.com/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432241/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432241/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2571e4803ee1445381ccc5d090c67e05 Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi060 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=123d5b77a46451cbc24b877e551c5efbcd32c1c2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims on_librbd.sh' [7432243] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} ----------------------------------------------------------------- time: 03:12:19 info: http://pulpito.ceph.com/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432243/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432243/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e08e077bca7b4652a48155e83aa40ccb Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi118 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=123d5b77a46451cbc24b877e551c5efbcd32c1c2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims on_librbd.sh' [7432244] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} ----------------------------------------------------------------- time: 03:12:05 info: http://pulpito.ceph.com/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432244/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432244/ sentry: https://sentry.ceph.com/organizations/ceph/?query=026b203cdc8d449b902e2e5d4537a996 Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi152 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=123d5b77a46451cbc24b877e551c5efbcd32c1c2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims on_librbd.sh' Pass ================================================================= [7432237] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} time: 00:50:24 info: http://pulpito.ceph.com/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432237/ [7432239] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} time: 00:49:46 info: http://pulpito.ceph.com/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432239/ [7432242] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} time: 00:47:23 info: http://pulpito.ceph.com/yingxin-2023-10-19_05:36:32-crimson-rados-wip-yingxin-crimson-improve-mempool2-distro-default-smithi/7432242/