2024-03-28T20:59:46.028 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-03-28T20:59:46.028 INFO:teuthology.results:seed: '7208' 2024-03-28T21:24:43.445 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-03-28T21:24:43.492 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-03-28T21:55:45.831 INFO:teuthology.results:Tests finished! gathering results... 2024-03-28T21:55:48.720 INFO:scrape:Found 48 jobs 2024-03-28T21:55:53.794 INFO:scrape:Found 2 distinct failure reasons 2024-03-28T21:55:53.794 INFO:scrape:Failure: Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi066 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' 2024-03-28T21:55:53.794 INFO:scrape:24 jobs: ['7626227', '7626216', '7626231', '7626259', '7626222', '7626248', '7626218', '7626233', '7626255', '7626261', '7626237', '7626238', '7626214', '7626251', '7626224', '7626253', '7626235', '7626220', '7626229', '7626242', '7626246', '7626257', '7626240', '7626244'] 2024-03-28T21:55:53.795 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{0-install', 's3tests-branch', 's3tests-java', 's3tests}', 'tasks/{cls'] 2024-03-28T21:55:53.795 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off}', 'inline-data$/{on}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-branch', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}'] 2024-03-28T21:55:53.795 INFO:scrape: 2024-03-28T21:55:53.795 INFO:scrape:Failure: Command failed on smithi005 with status 1: 'sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' 2024-03-28T21:55:53.795 INFO:scrape:24 jobs: ['7626243', '7626230', '7626252', '7626249', '7626260', '7626228', '7626225', '7626247', '7626250', '7626254', '7626234', '7626232', '7626256', '7626239', '7626221', '7626241', '7626217', '7626245', '7626226', '7626236', '7626219', '7626223', '7626258', '7626215'] 2024-03-28T21:55:53.796 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{0-install', 's3tests-branch', 's3tests-java', 's3tests}', 'tasks/{cls'] 2024-03-28T21:55:53.796 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off}', 'inline-data$/{on}', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-branch', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}'] 2024-03-28T21:55:53.796 INFO:scrape: 2024-03-28T21:55:53.798 INFO:teuthology.results:Sending results to liangmingyuan@baidu.com: Test Run: liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/ failed: 48 dead: 0 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [7626214] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:21:18 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626214/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626214/ sentry: https://sentry.ceph.com/organizations/ceph/?query=373c77cd9b84444c9a57040ba151a687 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi063 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626215] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:10:33 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626215/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626215/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cc95ca2c2d58457bbb689c2991f264cb Command failed on smithi019 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626216] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:23:42 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626216/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626216/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a669c09221ed4d4c912d75af0f1c1791 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi037 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626217] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:14:52 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626217/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626217/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e37f3646e7e04596b7991b8774ce7c55 Command failed on smithi155 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626218] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:23:20 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626218/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626218/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e773e709e62147718f81829556f53aee Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi088 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626219] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:12:55 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626219/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626219/ sentry: https://sentry.ceph.com/organizations/ceph/?query=19a0aab777c14cadb2842626db83c78b Command failed on smithi129 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626220] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:20:54 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626220/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626220/ sentry: https://sentry.ceph.com/organizations/ceph/?query=307b5fb77294491bb32bdb0890f95d31 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi090 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626221] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:10:01 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626221/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626221/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8bad2e05c4b4a6f9e96a10a46496112 Command failed on smithi118 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626222] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:20:47 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626222/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626222/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0ac063543e71417886bec810b4810ec5 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi176 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626223] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:12:56 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626223/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626223/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2716376aeb754a33b1a196213542f26b Command failed on smithi178 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626224] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:19:36 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626224/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626224/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b60fcf283ff4aa5a8d37d031ae34264 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi078 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626225] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:11:30 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626225/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626225/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0ad8f8777cce4d73bdf3cdba14db9ea7 Command failed on smithi131 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626226] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:12:34 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626226/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626226/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a554892a1ab649f9a476b59ff900488a Command failed on smithi017 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626227] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:23:50 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626227/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626227/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2da3944991aa4a6ea5d0b9994f11f30f Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi066 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626228] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:11:24 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626228/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626228/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad7d30c0ae864bdbadeb374490796c91 Command failed on smithi038 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626229] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:20:41 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626229/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626229/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d15f7e6a731d479f8a1d4bbd5caaaab7 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi121 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626230] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:13:05 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626230/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626230/ sentry: https://sentry.ceph.com/organizations/ceph/?query=48469e7449414aeea67d32858d52a2cd Command failed on smithi043 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626231] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:21:19 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626231/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626231/ sentry: https://sentry.ceph.com/organizations/ceph/?query=47333192936640578d2377f33a9d3a76 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi003 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626232] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:12:02 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626232/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626232/ sentry: https://sentry.ceph.com/organizations/ceph/?query=628db874f6d8495cad1a0223d6b6c03f Command failed on smithi044 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626233] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:21:55 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626233/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626233/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4afe1e98199148f6af313efe27aff28a Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi031 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626234] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:10:19 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626234/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626234/ sentry: https://sentry.ceph.com/organizations/ceph/?query=717d8bd1159742d4a8ef398d82f40ffd Command failed on smithi102 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626235] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:23:35 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626235/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626235/ sentry: https://sentry.ceph.com/organizations/ceph/?query=85b24d68067442dfab2a6d5bd7e8dc56 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi047 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626236] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:10:02 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626236/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626236/ sentry: https://sentry.ceph.com/organizations/ceph/?query=75b01a59df634699b69e146d63cbbd70 Command failed on smithi032 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626237] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:22:00 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626237/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626237/ sentry: https://sentry.ceph.com/organizations/ceph/?query=779e05cf1ec84e8cbf3fd6c78e794997 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi194 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626238] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:21:32 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626238/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626238/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2fa3bfabcfc845e19ba71b7d8508ba87 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi073 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626239] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:11:45 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626239/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626239/ sentry: https://sentry.ceph.com/organizations/ceph/?query=07eead79ae7946b38794a0dd4533bf1c Command failed on smithi099 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626240] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:21:10 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626240/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626240/ sentry: https://sentry.ceph.com/organizations/ceph/?query=91f12e0278ff494c833d85883249c6df Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi006 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626241] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:11:29 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626241/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626241/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1ac7d71376254c8a99d6439094d28e8c Command failed on smithi082 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626242] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:17:55 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626242/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626242/ sentry: https://sentry.ceph.com/organizations/ceph/?query=18179cf63af345c9afe44b654b1cc430 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi049 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626243] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:08:56 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626243/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626243/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0371fbf3cfff4fdfa10439f56429401e Command failed on smithi005 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626244] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:19:11 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626244/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626244/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fdb530a2860641ad9fec2fe71a2f06f9 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi116 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626245] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:08:51 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626245/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626245/ sentry: https://sentry.ceph.com/organizations/ceph/?query=07fcee7da12b4f9dbc45a661b3e2134e Command failed on smithi133 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626246] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:20:42 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626246/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626246/ sentry: https://sentry.ceph.com/organizations/ceph/?query=220d37c9d2044b78a0d74ac92be1aae4 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi026 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626247] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:10:25 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626247/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626247/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f4ba601244354fbc97f3c7fd82097a63 Command failed on smithi094 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626248] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:20:05 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626248/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626248/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9344d8c900f24ab8b6035e4274899c97 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi028 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626249] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:09:09 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626249/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626249/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d8171f4fe28c4832bf2f827c356db7cd Command failed on smithi016 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626250] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:09:34 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626250/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626250/ sentry: https://sentry.ceph.com/organizations/ceph/?query=76a7776016274825add66ccfb59501b4 Command failed on smithi012 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626251] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:18:43 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626251/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626251/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5f8b3b1df32643108376e36118bbdd21 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi186 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626252] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:09:22 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626252/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626252/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a972cea9407d4aa1b0f9f3357c9f17ca Command failed on smithi040 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626253] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:19:47 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626253/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626253/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eabb5af5b6b745bab26f30336e8290d5 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi045 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626254] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:09:21 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626254/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626254/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a928c7983fa84d07b4ab53b9ad32d733 Command failed on smithi084 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626255] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:18:43 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626255/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626255/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c87c99c99631427690c660ab229dbb1a Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi161 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626256] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:11:22 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626256/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626256/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6dcaebe190664261adf8225e11b7602f Command failed on smithi027 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626257] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:16:56 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626257/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626257/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f0b76e4f810e4ed6abd9460e7a77d492 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi137 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626258] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:08:42 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626258/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626258/ sentry: https://sentry.ceph.com/organizations/ceph/?query=466b1e60d6904a4d8298af5b87a06ec1 Command failed on smithi018 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626259] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:17:13 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626259/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626259/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eacb8c81ee764417b9f866caa9474a35 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi070 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh' [7626260] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:08:27 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626260/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626260/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ae09073cec2c4537b8947f6cf2ef06eb Command failed on smithi053 with status 1: 'sudo MALLOC_CHECK_=3 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap' [7626261] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:18:00 info: https://pulpito.ceph.com/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626261/ log: http://qa-proxy.ceph.com/teuthology/liangmingyuan-2024-03-27_11:41:33-rgw-main-distro-default-smithi/7626261/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0b045b20347e406aa5b7c9a092238e58 Command failed (workunit test rgw/test_rgw_throttle.sh) on smithi071 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=878082f4bc1388a8521bdd4377f998511b585027 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh'