2023-11-16T04:43:46.913 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-16T04:43:46.913 INFO:teuthology.results:seed: '7868' 2023-11-16T05:37:00.604 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-16T05:37:00.630 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-11-16T09:08:21.713 INFO:teuthology.results:Tests finished! gathering results... 2023-11-16T09:08:26.542 INFO:scrape:Found 70 jobs 2023-11-16T09:08:28.484 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/prsrivas-2023-11-16_04:24:48-rgw-wip-rgw-d3n-filter-distro-default-smithi/7460344/teuthology.log 2023-11-16T09:08:31.478 INFO:scrape:Found 6 distinct failure reasons 2023-11-16T09:08:31.478 INFO:scrape:Failure: [Errno 13] Permission denied: '/vstart_runner.log' 2023-11-16T09:08:31.479 INFO:scrape:3 jobs: ['7460343', '7460299', '7460323'] 2023-11-16T09:08:31.479 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/singleton/{all/radosgw-admin'] 2023-11-16T09:08:31.479 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/singleton/{all/radosgw-admin', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 'supported-random-distro$/{centos_latest}}', 'supported-random-distro$/{ubuntu_latest}}'] 2023-11-16T09:08:31.479 INFO:scrape: 2023-11-16T09:08:31.479 INFO:scrape:Failure: Command failed (ragweed tests against rgw) on smithi006 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw'" 2023-11-16T09:08:31.479 INFO:scrape:7 jobs: ['7460320', '7460356', '7460335', '7460307', '7460338', '7460353', '7460349'] 2023-11-16T09:08:31.479 INFO:scrape:suites intersection: ['cls', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{0-install', 's3tests', 's3tests-branch', 's3tests-java', 'striping$/{stripe-equals-chunk}', 'tasks/{bucket-check', 'versioning}'] 2023-11-16T09:08:31.479 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off}', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests', 's3tests-branch', 's3tests-java', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'supported-random-distro$/{centos_latest}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{bucket-check', 'validater/lockdep}', 'validater/valgrind}', 'versioning}'] 2023-11-16T09:08:31.480 INFO:scrape: 2023-11-16T09:08:31.480 INFO:scrape:Failure: rgw multisite test failures 2023-11-16T09:08:31.480 INFO:scrape:2 jobs: ['7460332', '7460296'] 2023-11-16T09:08:31.480 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_latest}', 'tasks/test_multi}'] 2023-11-16T09:08:31.480 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zones', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_latest}', 'tasks/test_multi}'] 2023-11-16T09:08:31.480 INFO:scrape: 2023-11-16T09:08:31.480 INFO:scrape:Dead: None 2023-11-16T09:08:31.480 INFO:scrape:1 jobs: ['7460344'] 2023-11-16T09:08:31.480 INFO:scrape: 2023-11-16T09:08:31.481 INFO:scrape:Failure: Command failed (bucket notification tests against different endpoints) on smithi124 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a kafka_test' 2023-11-16T09:08:31.481 INFO:scrape:1 jobs: ['7460297'] 2023-11-16T09:08:31.481 INFO:scrape:suites: ['bluestore-bitmap', 'centos_latest', 'fixed-2', 'ignore-pg-availability', 'overrides', 'rgw/notifications/{beast', 'tasks/{0-install', 'test_amqp', 'test_kafka', 'test_others}}'] 2023-11-16T09:08:31.481 INFO:scrape: 2023-11-16T09:08:31.481 INFO:scrape:Failure: Command failed on smithi005 with status 100: 'DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install python-dev' 2023-11-16T09:08:31.481 INFO:scrape:1 jobs: ['7460312'] 2023-11-16T09:08:31.481 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/kmip', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 's3tests-branch', 'ubuntu_latest}'] 2023-11-16T09:08:31.481 INFO:scrape: