2022-07-08T15:40:18.983 INFO:root:teuthology version: 1.1.1.dev381+g10062088 2022-07-08T15:40:18.985 INFO:teuthology.results:seed: '9027' 2022-07-08T20:17:54.366 INFO:root:teuthology version: 1.1.1.dev381+g10062088 2022-07-08T20:17:54.402 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-07-08T23:00:10.774 INFO:teuthology.results:Tests finished! gathering results... 2022-07-08T23:00:38.330 INFO:scrape:Found 90 jobs 2022-07-08T23:01:21.514 INFO:scrape:Found 5 distinct failure reasons 2022-07-08T23:01:21.515 INFO:scrape:Failure: Command failed (workunit test mgr/test_prometheus_metrics.sh) on smithi001 with status 4: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=338eb9b825d2b0ddd00dc15e79ec12b545ae5797 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mgr/test_prometheus_metrics.sh' 2022-07-08T23:01:21.549 INFO:scrape:70 jobs 2022-07-08T23:01:21.551 INFO:scrape:suites intersection: ['0-roles', '1-start', '3-stress-tasks/{radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}'] 2022-07-08T23:01:21.552 INFO:scrape:suites union: ['0-roles', '1-start', '2-first-half-tasks/prometheus-metrics', '2-first-half-tasks/radosbench', '2-first-half-tasks/rbd-cls', '2-first-half-tasks/rbd-import-export', '2-first-half-tasks/rbd_api', '2-first-half-tasks/readwrite', '2-first-half-tasks/snaps-few-objects', '3-stress-tasks/{radosbench', '4-second-half-tasks/prometheus-metrics', '4-second-half-tasks/radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic}', 'mon_election/connectivity}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:pacific-x:stress-split/{0-distro/centos_8.stream_container_tools', 'upgrade:pacific-x:stress-split/{0-distro/centos_8.stream_container_tools_crun', 'upgrade:pacific-x:stress-split/{0-distro/rhel_8.6_container_tools_3.0', 'upgrade:pacific-x:stress-split/{0-distro/rhel_8.6_container_tools_rhel8', 'upgrade:pacific-x:stress-split/{0-distro/ubuntu_20.04'] 2022-07-08T23:01:21.553 INFO:scrape: 2022-07-08T23:01:21.573 INFO:scrape:Failure: {'smithi039.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': False, 'force_apt_get': False, 'install_recommends': None, 'only_upgrade': False, 'package': None, 'policy_rc_d': None, 'purge': False, 'state': 'present', 'update_cache': True, 'update_cache_retries': 5, 'update_cache_retry_max_delay': 12, 'upgrade': None}}, 'msg': 'Failed to update apt cache: unknown reason'}} 2022-07-08T23:01:21.578 INFO:scrape:1 jobs: ['6920163'] 2022-07-08T23:01:21.579 INFO:scrape:suites: ['0-roles', '1-start', '2-first-half-tasks/readwrite', '3-stress-tasks/{radosbench', '4-second-half-tasks/prometheus-metrics', 'mon_election/connectivity}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:pacific-x:stress-split/{0-distro/ubuntu_20.04'] 2022-07-08T23:01:21.580 INFO:scrape: 2022-07-08T23:01:21.581 INFO:scrape:Failure: {'smithi090.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-07-08T23:01:21.612 INFO:scrape:1 jobs: ['6920103'] 2022-07-08T23:01:21.613 INFO:scrape:suites: ['0-roles', '1-start', '2-first-half-tasks/rbd_api', '3-stress-tasks/{radosbench', '4-second-half-tasks/prometheus-metrics', 'mon_election/classic}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:pacific-x:stress-split/{0-distro/rhel_8.6_container_tools_rhel8'] 2022-07-08T23:01:21.614 INFO:scrape: 2022-07-08T23:01:21.615 INFO:scrape:Failure: Command failed (workunit test rbd/test_librbd.sh) on smithi047 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=octopus TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' 2022-07-08T23:01:21.617 INFO:scrape:1 jobs: ['6920152'] 2022-07-08T23:01:21.621 INFO:scrape:suites: ['0-roles', '1-start', '2-first-half-tasks/prometheus-metrics', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', 'mon_election/connectivity}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:pacific-x:stress-split/{0-distro/rhel_8.6_container_tools_rhel8'] 2022-07-08T23:01:21.622 INFO:scrape: 2022-07-08T23:01:21.623 INFO:scrape:Failure: ceph version 16.2.9-455.ga36e892c was not installed, found 16.2.9-433.g9180a342.el8. 2022-07-08T23:01:21.624 INFO:scrape:2 jobs: ['6920115', '6920099'] 2022-07-08T23:01:21.625 INFO:scrape:suites intersection: ['0-roles', '1-start', '3-stress-tasks/{radosbench', '4-second-half-tasks/prometheus-metrics', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}'] 2022-07-08T23:01:21.625 INFO:scrape:suites union: ['0-roles', '1-start', '2-first-half-tasks/rbd-cls', '2-first-half-tasks/snaps-few-objects', '3-stress-tasks/{radosbench', '4-second-half-tasks/prometheus-metrics', 'mon_election/classic}', 'mon_election/connectivity}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:pacific-x:stress-split/{0-distro/rhel_8.6_container_tools_rhel8', 'upgrade:pacific-x:stress-split/{0-distro/ubuntu_20.04'] 2022-07-08T23:01:21.651 INFO:scrape: