2023-10-18T02:36:00.463 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-18T02:36:00.465 INFO:teuthology.results:seed: '7497' 2023-10-18T02:40:48.780 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-18T02:40:48.783 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-10-18T06:03:04.513 INFO:teuthology.results:Tests finished! gathering results... 2023-10-18T06:03:04.946 INFO:scrape:Found 10 jobs 2023-10-18T06:03:05.074 INFO:scrape:Found 1 distinct failure reasons 2023-10-18T06:03:05.075 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2023-10-18T06:03:05.075 INFO:scrape:6 jobs: ['7431228', '7431226', '7431229', '7431233', '7431227', '7431232'] 2023-10-18T06:03:05.076 INFO:scrape:suites intersection: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_api_tests}'] 2023-10-18T06:03:05.076 INFO:scrape:suites union: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_api_tests}'] 2023-10-18T06:03:05.077 INFO:scrape: 2023-10-18T06:03:05.078 INFO:teuthology.results:Sending results to yingxin.cheng@intel.com: Test Run: yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 4 Fail ================================================================= [7431226] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} ----------------------------------------------------------------- time: 03:12:09 info: http://pulpito.ceph.com/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431226/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431226/ sentry: https://sentry.ceph.com/organizations/ceph/?query=81aba1cc963b4049af8840f5794dfe99 Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi190 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=21780a4fb1b788d3aac31a2a2bfba73265c986e7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims on_librbd.sh' [7431227] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} ----------------------------------------------------------------- time: 03:12:30 info: http://pulpito.ceph.com/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431227/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431227/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ee816181812f423b82b7abb2253586c5 Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi045 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=21780a4fb1b788d3aac31a2a2bfba73265c986e7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims on_librbd.sh' [7431228] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} ----------------------------------------------------------------- time: 03:11:53 info: http://pulpito.ceph.com/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431228/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431228/ sentry: https://sentry.ceph.com/organizations/ceph/?query=00cbe44245e946adaef7330a4cd04eb6 Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi070 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=21780a4fb1b788d3aac31a2a2bfba73265c986e7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims on_librbd.sh' [7431229] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} ----------------------------------------------------------------- time: 03:12:04 info: http://pulpito.ceph.com/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431229/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431229/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6452a3c9b9c7425aa6c0169f36c40bf0 Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi079 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=21780a4fb1b788d3aac31a2a2bfba73265c986e7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims on_librbd.sh' [7431232] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} ----------------------------------------------------------------- time: 03:12:17 info: http://pulpito.ceph.com/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431232/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431232/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e3a6fb001f2c4d7e91b45470de81c991 Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi154 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=21780a4fb1b788d3aac31a2a2bfba73265c986e7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims on_librbd.sh' [7431233] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} ----------------------------------------------------------------- time: 03:11:57 info: http://pulpito.ceph.com/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431233/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431233/ sentry: https://sentry.ceph.com/organizations/ceph/?query=09bb1b3a62b14074b5a8fd20219f2bba Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi152 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=21780a4fb1b788d3aac31a2a2bfba73265c986e7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims on_librbd.sh' Pass ================================================================= [7431224] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} time: 00:47:38 info: http://pulpito.ceph.com/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431224/ [7431225] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} time: 00:50:31 info: http://pulpito.ceph.com/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431225/ [7431230] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} time: 00:47:12 info: http://pulpito.ceph.com/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431230/ [7431231] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} time: 00:50:03 info: http://pulpito.ceph.com/yingxin-2023-10-18_02:33:56-crimson-rados-wip-yingxin-crimson-improve-mempool-distro-default-smithi/7431231/