2023-11-14T13:03:39.284 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-14T13:03:39.285 INFO:teuthology.results:seed: '1148' 2023-11-14T13:04:13.005 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-14T13:04:13.009 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-11-14T17:15:33.189 INFO:teuthology.results:Tests finished! gathering results... 2023-11-14T17:15:39.049 INFO:scrape:Found 70 jobs 2023-11-14T17:15:39.175 INFO:scrape:Found 2 distinct failure reasons 2023-11-14T17:15:39.176 INFO:scrape:Failure: rgw multisite test failures 2023-11-14T17:15:39.176 INFO:scrape:2 jobs: ['7457054', '7457090'] 2023-11-14T17:15:39.176 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}'] 2023-11-14T17:15:39.177 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zones', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}'] 2023-11-14T17:15:39.177 INFO:scrape: 2023-11-14T17:15:39.178 INFO:scrape:Failure: Command failed on smithi019 with status 100: 'DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install python-dev' 2023-11-14T17:15:39.178 INFO:scrape:1 jobs: ['7457070'] 2023-11-14T17:15:39.178 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/kmip', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 's3tests-branch', 'ubuntu_latest}'] 2023-11-14T17:15:39.179 INFO:scrape: 2023-11-14T17:15:39.182 INFO:teuthology.results:Sending results to mkogan@redhat.com: Test Run: mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/ failed: 3 dead: 0 running: 0 waiting: 0 queued: 0 passed: 67 Fail ================================================================= [7457054] rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} ----------------------------------------------------------------- time: 03:07:42 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457054/ log: http://qa-proxy.ceph.com/teuthology/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457054/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bf9ebfb4c4324b72a42ce5fe9a64c39d rgw multisite test failures [7457070] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} ----------------------------------------------------------------- time: 00:11:53 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457070/ log: http://qa-proxy.ceph.com/teuthology/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457070/ sentry: https://sentry.ceph.com/organizations/ceph/?query=155ff86713154a4cad512f5ec67bab7f Command failed on smithi019 with status 100: 'DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install python-dev' [7457090] rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{ubuntu_latest} tasks/test_multi} ----------------------------------------------------------------- time: 03:59:35 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457090/ log: http://qa-proxy.ceph.com/teuthology/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457090/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e4048c5d304544eda5354b363ca660fa rgw multisite test failures Pass ================================================================= [7457047] rgw/cloud-transition/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/cloud_transition_s3tests} time: 00:33:37 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457047/ [7457048] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} time: 00:46:26 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457048/ [7457049] rgw/d4n/{cluster ignore-pg-availability overrides supported-random-distro$/{ubuntu_latest} tasks/rgw_d4ntests} time: 00:23:17 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457049/ [7457050] rgw/dbstore/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/rgw_s3tests} time: 00:19:18 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457050/ [7457051] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default ignore-pg-availability overrides s3a-hadoop} time: 00:21:39 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457051/ [7457052] rgw/lifecycle/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/rgw_s3tests} time: 00:43:09 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457052/ [7457053] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_bucket_quota ubuntu_latest} time: 00:28:07 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457053/ [7457055] rgw/notifications/{beast bluestore-bitmap centos_latest fixed-2 ignore-pg-availability overrides tasks/{0-install test_amqp test_kafka test_others}} time: 00:44:40 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457055/ [7457056] rgw/service-token/{clusters/fixed-1 frontend/beast ignore-pg-availability overrides tasks/service-token ubuntu_latest} time: 00:17:34 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457056/ [7457057] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} time: 00:24:00 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457057/ [7457058] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast s3tests-branch supported-random-distro$/{ubuntu_latest} tasks/{0-install 1-keycloak 2-s3tests}} time: 00:43:14 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457058/ [7457059] rgw/tempest/{clusters/fixed-1 frontend/beast ignore-pg-availability overrides tasks/rgw_tempest ubuntu_latest} time: 00:31:38 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457059/ [7457060] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} time: 00:24:36 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457060/ [7457061] rgw/tools/{centos_latest cluster ignore-pg-availability tasks} time: 02:40:35 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457061/ [7457062] rgw/upgrade/{1-install/pacific/{distro$/{ubuntu_20.04} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} time: 00:19:12 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457062/ [7457063] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} time: 00:49:16 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457063/ [7457064] rgw/website/{clusters/fixed-2 frontend/beast http ignore-pg-availability overrides s3tests-branch tasks/s3tests-website ubuntu_latest} time: 00:35:00 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457064/ [7457065] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} time: 01:49:31 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457065/ [7457066] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/rgw_multipart_upload ubuntu_latest} time: 00:26:09 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457066/ [7457067] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} time: 00:58:47 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457067/ [7457068] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} time: 01:57:05 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457068/ [7457069] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_ragweed ubuntu_latest} time: 00:22:54 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457069/ [7457071] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} time: 00:47:46 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457071/ [7457072] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_s3tests ubuntu_latest} time: 00:32:00 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457072/ [7457073] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} time: 01:46:35 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457073/ [7457074] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} time: 00:28:17 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457074/ [7457075] rgw/upgrade/{1-install/quincy/{distro$/{ubuntu_20.04} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} time: 00:18:39 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457075/ [7457076] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} time: 00:50:40 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457076/ [7457077] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/rgw_user_quota ubuntu_latest} time: 00:20:29 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457077/ [7457078] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} time: 01:24:28 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457078/ [7457079] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} time: 00:32:04 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457079/ [7457080] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_bucket_quota ubuntu_latest} time: 00:21:05 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457080/ [7457081] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} time: 00:28:39 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457081/ [7457082] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} time: 01:00:48 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457082/ [7457083] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} time: 01:23:16 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457083/ [7457084] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_multipart_upload ubuntu_latest} time: 00:27:59 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457084/ [7457085] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} time: 00:57:46 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457085/ [7457086] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} time: 01:24:39 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457086/ [7457087] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/rgw_ragweed ubuntu_latest} time: 00:20:47 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457087/ [7457088] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} time: 00:31:26 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457088/ [7457089] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 ignore-pg-availability overrides s3a-hadoop} time: 00:35:31 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457089/ [7457091] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests} time: 00:33:17 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457091/ [7457092] rgw/upgrade/{1-install/quincy/{distro$/{ubuntu_20.04} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} time: 00:24:10 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457092/ [7457093] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} time: 00:52:35 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457093/ [7457094] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_s3tests ubuntu_latest} time: 00:34:04 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457094/ [7457095] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} time: 02:00:50 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457095/ [7457096] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} time: 00:58:30 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457096/ [7457097] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_user_quota ubuntu_latest} time: 00:28:17 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457097/ [7457098] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} time: 01:54:46 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457098/ [7457099] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} time: 00:36:19 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457099/ [7457100] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/rgw_bucket_quota ubuntu_latest} time: 00:24:22 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457100/ [7457101] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} time: 00:24:19 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457101/ [7457102] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} time: 00:57:36 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457102/ [7457103] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} time: 02:04:46 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457103/ [7457104] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_multipart_upload ubuntu_latest} time: 00:26:37 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457104/ [7457105] rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} time: 00:27:14 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457105/ [7457106] rgw/upgrade/{1-install/pacific/{distro$/{ubuntu_20.04} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} time: 00:22:24 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457106/ [7457107] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} time: 01:00:31 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457107/ [7457108] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} time: 01:31:07 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457108/ [7457109] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_ragweed ubuntu_latest} time: 00:25:03 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457109/ [7457110] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} time: 00:28:10 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457110/ [7457111] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} time: 01:01:00 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457111/ [7457112] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec s3tests-branch tasks/rgw_s3tests ubuntu_latest} time: 00:33:44 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457112/ [7457113] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} time: 01:25:08 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457113/ [7457114] rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} time: 00:55:18 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457114/ [7457115] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_user_quota ubuntu_latest} time: 00:26:41 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457115/ [7457116] rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} time: 01:30:28 info: https://pulpito.ceph.com/mkogan-2023-11-14_13:03:07-rgw-rgw-wip-t63445-valg-supp_i001-distro-default-smithi/7457116/