2023-01-22T20:40:58.115 INFO:root:teuthology version: 0.0.1.dev20+g5abecab
2023-01-22T20:40:58.116 INFO:teuthology.results:subset: '1/3'
2023-01-22T20:40:58.116 INFO:teuthology.results:seed: '7210'
2023-01-22T20:42:05.547 INFO:root:teuthology version: 0.0.1.dev20+g5abecab
2023-01-22T20:42:05.551 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-01-22T23:47:18.848 INFO:teuthology.results:Tests finished! gathering results...
2023-01-22T23:47:20.364 INFO:scrape:Found 59 jobs
2023-01-22T23:47:20.448 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuvalif-2023-01-22_20:40:43-rgw-wip-yuval-fix-58167-distro-default-smithi/7133362/teuthology.log
2023-01-22T23:47:21.954 INFO:scrape:Found 6 distinct failure reasons
2023-01-22T23:47:21.955 INFO:scrape:Failure: {'smithi100.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': True, 'force_apt_get': False, 'install_recommends': None, 'name': ['ceph', 'ceph-common', 'libcephfs1', 'radosgw', 'python-ceph', 'python-rados', 'python-cephfs', 'python-rbd', 'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-common'], 'only_upgrade': False, 'package': ['ceph', 'ceph-common', 'libcephfs1', 'radosgw', 'python-ceph', 'python-rados', 'python-cephfs', 'python-rbd', 'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-common'], 'policy_rc_d': None, 'purge': False, 'state': 'absent', 'update_cache': None, 'update_cache_retries': 5, 'update_cache_retry_max_delay': 12, 'upgrade': None}}, 'msg': "'apt-get remove 'librbd1' 'librados2'' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 14180 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n", 'rc': 100, 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 14180 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 14180 (apt-get)', 'E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?'], 'stdout': '', 'stdout_lines': []}}
2023-01-22T23:47:21.955 INFO:scrape:1 jobs: ['7133374']
2023-01-22T23:47:21.955 INFO:scrape:suites: ['frontend/beast', 'install', 'objectstore/filestore-xfs', 'rgw/thrash/{clusters/fixed-2', 's3tests-branch', 'thrasher/default', 'thrashosds-health', 'ubuntu_latest', 'workload/rgw_multipart_upload}']
2023-01-22T23:47:21.956 INFO:scrape:
2023-01-22T23:47:21.956 INFO:scrape:Dead: None
2023-01-22T23:47:21.957 INFO:scrape:16 jobs: ['7133362', '7133363', '7133388', '7133413', '7133394', '7133405', '7133361', '7133408', '7133377', '7133403', '7133404', '7133384', '7133395', '7133368', '7133356', '7133389']
2023-01-22T23:47:21.957 INFO:scrape:
2023-01-22T23:47:21.957 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi136 with status 1: 'S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests-client.0/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests-client.0 -v -a webidentity_test'
2023-01-22T23:47:21.958 INFO:scrape:1 jobs: ['7133366']
2023-01-22T23:47:21.958 INFO:scrape:suites: ['first', 'ignore-pg-availability', 'objectstore', 'overrides', 'pool-type', 'rgw/sts/{cluster', 'rgw_frontend/beast', 's3tests-branch', 'ststests}}', 'supported-random-distro$/{centos_8}', 'tasks/{0-install']
2023-01-22T23:47:21.959 INFO:scrape:
2023-01-22T23:47:21.959 INFO:scrape:Failure: Command failed on smithi085 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap'
2023-01-22T23:47:21.960 INFO:scrape:2 jobs: ['7133379', '7133367']
2023-01-22T23:47:21.960 INFO:scrape:suites intersection: ['frontend/beast', 'overrides', 'ubuntu_latest}']
2023-01-22T23:47:21.961 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw/tempest/{clusters/fixed-1', 'rgw_pool_type/ec-profile', 's3tests-branch', 'tasks/rgw_ragweed', 'tasks/rgw_tempest', 'ubuntu_latest}']
2023-01-22T23:47:21.961 INFO:scrape:
2023-01-22T23:47:21.961 INFO:scrape:Failure: rgw multisite test failures
2023-01-22T23:47:21.962 INFO:scrape:1 jobs: ['7133393']
2023-01-22T23:47:21.962 INFO:scrape:suites: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_8}', 'tasks/test_multi}']
2023-01-22T23:47:21.963 INFO:scrape:
2023-01-22T23:47:21.963 INFO:scrape:Failure: Command failed (workunit test rgw/run-datacache.sh) on smithi132 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=96148a7bf48a56063ecee701f23d7b28676327dc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh'
2023-01-22T23:47:21.963 INFO:scrape:1 jobs: ['7133400']
2023-01-22T23:47:21.964 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/replicated', 's3tests-branch', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'tasks/{cls', 'validater/lockdep}']
2023-01-22T23:47:21.964 INFO:scrape: