2022-03-09T15:04:15.839 INFO:root:teuthology version: 1.1.0-eeaeee38
2022-03-09T15:04:15.842 INFO:teuthology.results:seed: '2912'
2022-03-09T16:30:00.988 INFO:root:teuthology version: 1.1.0-eeaeee38
2022-03-09T16:30:01.025 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-03-10T04:30:54.579 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2022-03-10T04:30:58.877 INFO:scrape:Found 48 jobs
2022-03-10T04:31:15.259 INFO:scrape:Found 2 distinct failure reasons
2022-03-10T04:31:15.260 INFO:scrape:Failure: Command failed (workunit test rgw/run-reshard.sh) on smithi087 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'
2022-03-10T04:31:15.260 INFO:scrape:47 jobs
2022-03-10T04:31:15.261 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{0-install', 's3tests-java', 's3tests}', 'tasks/{cls']
2022-03-10T04:31:15.262 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}']
2022-03-10T04:31:15.262 INFO:scrape:
2022-03-10T04:31:15.263 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds
2022-03-10T04:31:15.263 INFO:scrape:1 jobs: ['6728210']
2022-03-10T04:31:15.264 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}']
2022-03-10T04:31:15.264 INFO:scrape:
2022-03-10T04:31:15.267 INFO:teuthology.results:Sending results to gsalomon@redhat.com: Test Run: yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/
failed:  48
dead:    0
running: 0
waiting: 0
queued:  2
passed:  0


Fail
=================================================================
[6728208]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:19:49
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728208/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728208/
sentry: https://sentry.ceph.com/organizations/ceph/?query=36c06a86ab574b4b9230018317f9f18e

    Command failed (workunit test rgw/run-reshard.sh) on smithi139 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728209]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:23:45
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728209/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728209/
sentry: https://sentry.ceph.com/organizations/ceph/?query=926d8516f07b42b28b3feaa08bac05af

    Command failed (workunit test rgw/run-reshard.sh) on smithi025 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728210]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:18:06
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728210/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728210/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cc86aaf8b69746dbb1045b580a22688d

    reached maximum tries (90) after waiting for 540 seconds

[6728211]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:22:45
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728211/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728211/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5973617b969c4fe2becf30bd550273dc

    Command failed (workunit test rgw/run-reshard.sh) on smithi046 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728212]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:19:37
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728212/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728212/
sentry: https://sentry.ceph.com/organizations/ceph/?query=18984326d6324155967b02c7fa80e8f2

    Command failed (workunit test rgw/run-reshard.sh) on smithi099 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728213]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:23:03
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728213/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728213/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a191576caf4e4a6f910e370809f81ace

    Command failed (workunit test rgw/run-reshard.sh) on smithi087 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728214]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:20:12
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728214/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728214/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7d0fb928ce7a4d2cac5ac3e7399696c5

    Command failed (workunit test rgw/run-reshard.sh) on smithi077 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728215]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:20:32
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728215/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728215/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5bd64343777043538d2b023ccfee2dd4

    Command failed (workunit test rgw/run-reshard.sh) on smithi185 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728216]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:20:21
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728216/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728216/
sentry: https://sentry.ceph.com/organizations/ceph/?query=929408a6ef744b8ba694cb85a286026f

    Command failed (workunit test rgw/run-reshard.sh) on smithi157 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728217]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:21:43
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728217/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728217/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8f2276e23ab349fa825c6e8af60fc352

    Command failed (workunit test rgw/run-reshard.sh) on smithi117 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728218]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:20:13
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728218/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728218/
sentry: https://sentry.ceph.com/organizations/ceph/?query=893430ad167e48879b96b8043bc37f10

    Command failed (workunit test rgw/run-reshard.sh) on smithi122 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728219]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:21:43
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728219/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728219/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d5e07960ccf241ebaa34d7158d7d83a1

    Command failed (workunit test rgw/run-reshard.sh) on smithi036 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728220]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:20:11
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728220/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728220/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2344f75846ce4353943c1cbaa8329d8d

    Command failed (workunit test rgw/run-reshard.sh) on smithi052 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728221]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:22:57
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728221/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728221/
sentry: https://sentry.ceph.com/organizations/ceph/?query=506ccd00b2554c0fbade3eb1e431224a

    Command failed (workunit test rgw/run-reshard.sh) on smithi107 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728222]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:18:53
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728222/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728222/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3dea6c6edddc443e8ecbe4b78e8b75a2

    Command failed (workunit test rgw/run-reshard.sh) on smithi017 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728223]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:24:06
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728223/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728223/
sentry: https://sentry.ceph.com/organizations/ceph/?query=895f4b82010e4f378ea1b65126833c9e

    Command failed (workunit test rgw/run-reshard.sh) on smithi134 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728224]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:18:39
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728224/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728224/
sentry: https://sentry.ceph.com/organizations/ceph/?query=be912961ca4a40719b9d58763b11b7c8

    Command failed (workunit test rgw/run-reshard.sh) on smithi008 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728225]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:23:08
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728225/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728225/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b42950eba6934254b006bfb71d294d59

    Command failed (workunit test rgw/run-reshard.sh) on smithi161 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728226]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:19:17
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728226/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728226/
sentry: https://sentry.ceph.com/organizations/ceph/?query=af8cd086f4114cae969dfe8659f80b09

    Command failed (workunit test rgw/run-reshard.sh) on smithi186 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728227]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:22:05
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728227/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728227/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c99b3ddec5274a62bed46c74e8ab7376

    Command failed (workunit test rgw/run-reshard.sh) on smithi100 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728228]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:19:42
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728228/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728228/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b4c3c89042304bd6ad857ef07595b236

    Command failed (workunit test rgw/run-reshard.sh) on smithi142 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728229]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:21:43
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728229/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728229/
sentry: https://sentry.ceph.com/organizations/ceph/?query=04a7f243e6a14a6a93ad6ed0048a2467

    Command failed (workunit test rgw/run-reshard.sh) on smithi131 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728230]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:19:41
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728230/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728230/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4544bfeacd194641bcf19a180a3d9fa7

    Command failed (workunit test rgw/run-reshard.sh) on smithi018 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728231]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:21:56
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728231/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728231/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e7c0394880074b72bacf8a283bc3db2c

    Command failed (workunit test rgw/run-reshard.sh) on smithi005 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728232]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:20:30
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728232/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728232/
sentry: https://sentry.ceph.com/organizations/ceph/?query=19961d1eb6b94d758d3ebb557846f5ee

    Command failed (workunit test rgw/run-reshard.sh) on smithi124 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728233]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:22:21
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728233/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728233/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2923329d9c764480a9c767b8489bf610

    Command failed (workunit test rgw/run-reshard.sh) on smithi159 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728234]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:20:36
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728234/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728234/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e54093ba656f4afe95e9f96d4576692d

    Command failed (workunit test rgw/run-reshard.sh) on smithi081 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728235]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:22:07
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728235/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728235/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2a2d4fa8e6f64fc8a89794b14f6b91d1

    Command failed (workunit test rgw/run-reshard.sh) on smithi116 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728236]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:20:51
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728236/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728236/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8c3df8fd10724883b628bd67957fe094

    Command failed (workunit test rgw/run-reshard.sh) on smithi111 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728237]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:22:21
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728237/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728237/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a8a5270c31f9487ba9e8483dca3edaff

    Command failed (workunit test rgw/run-reshard.sh) on smithi036 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728238]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:21:31
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728238/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728238/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c19534fbf7e247348ec50926008e0d44

    Command failed (workunit test rgw/run-reshard.sh) on smithi050 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728239]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:21:02
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728239/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728239/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c1fe0ec6b634423e854e5b08b921c20a

    Command failed (workunit test rgw/run-reshard.sh) on smithi045 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728240]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:21:03
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728240/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728240/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fca67472e29a44f1b25a9c52ca076ee4

    Command failed (workunit test rgw/run-reshard.sh) on smithi099 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728241]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:21:08
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728241/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728241/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5d311b5009404ae78e7d3342a73edb79

    Command failed (workunit test rgw/run-reshard.sh) on smithi025 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728242]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:21:00
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728242/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728242/
sentry: https://sentry.ceph.com/organizations/ceph/?query=92ca132c83dc4b2c86b07b32bed2af2d

    Command failed (workunit test rgw/run-reshard.sh) on smithi166 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728243]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:21:16
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728243/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728243/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3400d64b213241f1b7fbe70f913ca98b

    Command failed (workunit test rgw/run-reshard.sh) on smithi053 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728244]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:21:27
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728244/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728244/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7685f59a894940bbb318d242bcad4b2d

    Command failed (workunit test rgw/run-reshard.sh) on smithi067 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728245]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:22:53
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728245/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728245/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c1acc209b2114b67b87739443c11166a

    Command failed (workunit test rgw/run-reshard.sh) on smithi073 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728246]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:19:52
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728246/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728246/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ff822b8a634d4b7ba91fa4c1f834a556

    Command failed (workunit test rgw/run-reshard.sh) on smithi115 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728247]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:23:07
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728247/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728247/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ab4c1f62051d471481443cb9471aafcc

    Command failed (workunit test rgw/run-reshard.sh) on smithi027 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728248]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:19:56
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728248/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728248/
sentry: https://sentry.ceph.com/organizations/ceph/?query=50653719d515466c84ddaa6d9410c11b

    Command failed (workunit test rgw/run-reshard.sh) on smithi062 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728249]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:23:06
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728249/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728249/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7edfd045a63f4fffa41c47951b76dffe

    Command failed (workunit test rgw/run-reshard.sh) on smithi079 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728250]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:20:21
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728250/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728250/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b728ec4fbbd1425d9cb8c972e565c7ef

    Command failed (workunit test rgw/run-reshard.sh) on smithi087 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728251]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:21:17
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728251/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728251/
sentry: https://sentry.ceph.com/organizations/ceph/?query=571bda573f4746e4afaebb29b7de9406

    Command failed (workunit test rgw/run-reshard.sh) on smithi117 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728252]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:21:00
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728252/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728252/
sentry: https://sentry.ceph.com/organizations/ceph/?query=80d78433408248d7ad12eb528e558c88

    Command failed (workunit test rgw/run-reshard.sh) on smithi042 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728253]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:21:08
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728253/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728253/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c438f929cd7148ab9da99ef40a8fb4ed

    Command failed (workunit test rgw/run-reshard.sh) on smithi122 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728254]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:20:49
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728254/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728254/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ea3a2eedbe0e45b4ba188598a96af38e

    Command failed (workunit test rgw/run-reshard.sh) on smithi002 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'

[6728255]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:21:39
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728255/
log:    http://qa-proxy.ceph.com/teuthology/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728255/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cd5a343bb8084044a9036b7aafad071c

    Command failed (workunit test rgw/run-reshard.sh) on smithi046 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=ccffbb339571237c0a75ec058c40a6b2244cbbf2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'



Queued
=================================================================
[6728207] None
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728207/

[6728256] None
info:   http://pulpito.ceph.com/yuvalif-2022-03-09_15:03:47-rgw:verify-wip-arrow-submodule-ext-distro-basic-smithi/6728256/