2022-03-18T11:36:53.444 INFO:root:teuthology version: 1.1.0-aa078dbe
2022-03-18T11:36:53.446 INFO:teuthology.results:seed: '3682'
2022-03-18T11:51:42.636 INFO:root:teuthology version: 1.1.0-aa078dbe
2022-03-18T11:51:42.639 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-03-18T12:10:44.027 INFO:teuthology.results:Tests finished! gathering results...
2022-03-18T12:10:44.508 INFO:scrape:Found 12 jobs
2022-03-18T12:10:45.228 INFO:scrape:Found 3 distinct failure reasons
2022-03-18T12:10:45.229 INFO:scrape:Failure: No module named 'tasks.ceph'
2022-03-18T12:10:45.229 INFO:scrape:6 jobs: ['6745066', '6745062', '6745061', '6745064', '6745065', '6745063']
2022-03-18T12:10:45.230 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{0-install', 's3tests-java', 's3tests}', 'tasks/{cls']
2022-03-18T12:10:45.231 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}']
2022-03-18T12:10:45.232 INFO:scrape:
2022-03-18T12:10:45.232 INFO:scrape:Failure: Command failed on smithi109 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse s3cmd s3cmd s3cmd s3cmd'
2022-03-18T12:10:45.233 INFO:scrape:5 jobs: ['6745070', '6745067', '6745068', '6745069', '6745071']
2022-03-18T12:10:45.234 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{0-install', 's3tests-java', 's3tests}', 'tasks/{cls']
2022-03-18T12:10:45.235 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}']
2022-03-18T12:10:45.235 INFO:scrape:
2022-03-18T12:10:45.236 INFO:scrape:Failure: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_ceph-c_7641ac92191d4d0d36293aa7df5f4851f5356b4c/qa/tasks/boto.cfg.template'
2022-03-18T12:10:45.237 INFO:scrape:1 jobs: ['6745060']
2022-03-18T12:10:45.238 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec-profile', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}']
2022-03-18T12:10:45.239 INFO:scrape:
2022-03-18T12:10:45.240 INFO:teuthology.results:Sending results to gsalomon@redhat.com: Test Run: gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/
failed:  12
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[6745060]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:18:23
info:   http://pulpito.ceph.com/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745060/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745060/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9e53e76ce20a42e385f956861eceea48

    [Errno 2] No such file or directory:
    '/home/teuthworker/src/git.ceph.com_ceph-
    c_7641ac92191d4d0d36293aa7df5f4851f5356b4c/qa/tasks/boto.cfg.template'

[6745061]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:17:53
info:   http://pulpito.ceph.com/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745061/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745061/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c8e2dcccee754fc99174e01be033b149

    No module named 'tasks.ragweed'

[6745062]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:17:50
info:   http://pulpito.ceph.com/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745062/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745062/
sentry: https://sentry.ceph.com/organizations/ceph/?query=29bbdb8153ca451a8b5d51cf167b1d6a

    No module named 'tasks.ragweed'

[6745063]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:18:51
info:   http://pulpito.ceph.com/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745063/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745063/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eabda50847bd469dbbaaa89325856479

    No module named 'tasks.ragweed'

[6745064]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:08:18
info:   http://pulpito.ceph.com/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745064/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745064/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ca9494e3a30743fdb4b26e64afe637a1

    No module named 'tasks.openssl_keys'

[6745065]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:06:43
info:   http://pulpito.ceph.com/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745065/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745065/
sentry: https://sentry.ceph.com/organizations/ceph/?query=26fd6ceab12242c38fc4750c9bc83b11

    No module named 'tasks.ceph'

[6745066]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:07:00
info:   http://pulpito.ceph.com/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745066/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745066/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a952538165494bbf9ad1a32bf63893c3

    No module named 'tasks.ceph'

[6745067]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:05:24
info:   http://pulpito.ceph.com/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745067/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745067/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0fa363dc828c44b5a90fbd5ee5a4f20f

    Command failed on smithi145 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1
    librados2 librbd1 python-ceph rbd-fuse s3cmd s3cmd s3cmd s3cmd'

[6745068]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:05:26
info:   http://pulpito.ceph.com/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745068/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745068/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f12da466ce474cdb8fb493f2dc6a20ea

    Command failed on smithi099 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1
    librados2 librbd1 python-ceph rbd-fuse s3cmd s3cmd s3cmd s3cmd'

[6745069]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:05:24
info:   http://pulpito.ceph.com/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745069/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745069/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5e2739c4a67b4cdab533c5b43c82af42

    Command failed on smithi174 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1
    librados2 librbd1 python-ceph rbd-fuse s3cmd s3cmd s3cmd s3cmd'

[6745070]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:05:18
info:   http://pulpito.ceph.com/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745070/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745070/
sentry: https://sentry.ceph.com/organizations/ceph/?query=745f01b4061a4dc1a37503169553ff2e

    Command failed on smithi109 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1
    librados2 librbd1 python-ceph rbd-fuse s3cmd s3cmd s3cmd s3cmd'

[6745071]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:05:30
info:   http://pulpito.ceph.com/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745071/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2022-03-18_11:36:37-rgw:verify-wip-test-arrow-submodule-distro-basic-smithi/6745071/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d502a7a74b1445ac91362ba09f793aa2

    Command failed on smithi025 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1
    librados2 librbd1 python-ceph rbd-fuse s3cmd s3cmd s3cmd s3cmd'