2023-06-28T12:29:32.623 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a
2023-06-28T12:29:32.624 INFO:teuthology.results:seed: '8561'
2023-06-28T13:29:18.513 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a
2023-06-28T13:29:18.547 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-06-28T14:30:27.093 INFO:teuthology.results:Tests finished! gathering results...
2023-06-28T14:30:27.665 INFO:scrape:Found 24 jobs
2023-06-28T14:30:27.671 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320009/teuthology.log
2023-06-28T14:30:27.958 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320007/teuthology.log matches
2023-06-28T14:30:27.959 WARNING:scrape:Misunderstood line: 
2023-06-28T14:30:28.182 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320005/teuthology.log matches
2023-06-28T14:30:28.183 WARNING:scrape:Misunderstood line: 
2023-06-28T14:30:28.857 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320013/teuthology.log matches
2023-06-28T14:30:28.858 WARNING:scrape:Misunderstood line: 
2023-06-28T14:30:28.860 INFO:scrape:Found 2 distinct failure reasons
2023-06-28T14:30:28.861 INFO:scrape:Dead: None
2023-06-28T14:30:28.861 INFO:scrape:12 jobs: ['7320009', '7320020', '7320022', '7320018', '7320016', '7320017', '7320015', '7320019', '7320024', '7320021', '7320025', '7320010']
2023-06-28T14:30:28.861 INFO:scrape:
2023-06-28T14:30:28.862 INFO:scrape:Valgrind: 
2023-06-28T14:30:28.862 INFO:scrape:4 jobs: ['7320007', '7320005', '7320014', '7320013']
2023-06-28T14:30:28.862 INFO:scrape:suites intersection: ['clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{0-install', 's3tests-branch', 's3tests-java', 's3tests}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{cls']
2023-06-28T14:30:28.863 INFO:scrape:suites union: ['clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off}', 'inline-data$/{on}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-branch', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}']
2023-06-28T14:30:28.863 INFO:scrape:
2023-06-28T14:30:28.864 INFO:teuthology.results:Sending results to gsalomon@redhat.com: Test Run: gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/
failed:  4
dead:    12
running: 0
waiting: 0
queued:  0
passed:  8


Fail
=================================================================
[7320005]  rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:42:57
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320005/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320005/

    saw valgrind issues

[7320007]  rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:44:22
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320007/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320007/

    saw valgrind issues

[7320013]  rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:13:12
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320013/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320013/

    saw valgrind issues

[7320014]  rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:42:40
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320014/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320014/

    "1687957800.0001805 mon.a (mon.0) 400 : cluster [WRN] overall HEALTH_WARN 1
    pool(s) do not have an application enabled" in cluster log



Dead
=================================================================
[7320009]  rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320009/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320009/

    Error reimaging machines: [Errno 104] Connection reset by peer

[7320010]  rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_20.04} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320010/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320010/

    Error reimaging machines: [Errno 104] Connection reset by peer

[7320015]  rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rhel_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320015/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320015/

    Error reimaging machines: [Errno 104] Connection reset by peer

[7320016]  rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_20.04} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320016/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320016/

    Error reimaging machines: [Errno 104] Connection reset by peer

[7320017]  rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320017/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320017/

    Error reimaging machines: [Errno 104] Connection reset by peer

[7320018]  rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_20.04} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320018/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320018/

    Error reimaging machines: [Errno 104] Connection reset by peer

[7320019]  rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rhel_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320019/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320019/

    Error reimaging machines: [Errno 104] Connection reset by peer

[7320020]  rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320020/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320020/

    Error reimaging machines: [Errno 104] Connection reset by peer

[7320021]  rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320021/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320021/

    Error reimaging machines: [Errno 104] Connection reset by peer

[7320022]  rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320022/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320022/

    Error reimaging machines: [Errno 104] Connection reset by peer

[7320024]  rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{rhel_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320024/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320024/

    Error reimaging machines:

[7320025]  rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320025/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320025/

    Error reimaging machines:



Pass
=================================================================
[7320002] rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rhel_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:32:56
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320002/

[7320003] rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:23:49
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320003/

[7320004] rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:53:22
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320004/

[7320006] rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:54:51
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320006/

[7320008] rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:58:34
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320008/

[7320011] rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_20.04} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:02:51
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320011/

[7320012] rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   01:03:22
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320012/

[7320023] rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_20.04} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   00:58:41
info:   http://pulpito.ceph.com/gsalomon-2023-06-28_11:42:16-rgw:verify-trino_tpcds_issues-distro-default-smithi/7320023/