2022-07-06T07:57:32.547 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-07-06T07:57:32.548 INFO:teuthology.results:seed: '2509' 2022-07-06T08:05:51.371 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3 2022-07-06T08:05:51.390 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-07-06T08:38:55.684 INFO:teuthology.results:Tests finished! gathering results... 2022-07-06T08:38:58.500 INFO:scrape:Found 32 jobs 2022-07-06T08:39:08.454 INFO:scrape:Found 5 distinct failure reasons 2022-07-06T08:39:08.455 INFO:scrape:Failure: Command failed on smithi074 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c04dfd36-fd04-11ec-842d-001a4aab830c -e sha1=29557985916cb7e3e260d4492738f4f82d15e64b -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | length == 2\'"\'"\'\'' 2022-07-06T08:39:08.456 INFO:scrape:26 jobs: ['6917081', '6917084', '6917074', '6917085', '6917070', '6917083', '6917058', '6917087', '6917064', '6917086', '6917061', '6917067', '6917077', '6917068', '6917056', '6917063', '6917072', '6917078', '6917082', '6917065', '6917066', '6917080', '6917057', '6917059', '6917076', '6917079'] 2022-07-06T08:39:08.457 INFO:scrape:suites intersection: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}'] 2022-07-06T08:39:08.458 INFO:scrape:suites union: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4'] 2022-07-06T08:39:08.459 INFO:scrape: 2022-07-06T08:39:08.460 INFO:scrape:Failure: SSH connection to smithi081 was lost: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2022-07-06T08:39:08.461 INFO:scrape:2 jobs: ['6917069', '6917073'] 2022-07-06T08:39:08.462 INFO:scrape:suites intersection: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/v16.2.4'] 2022-07-06T08:39:08.463 INFO:scrape:suites union: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/v16.2.4'] 2022-07-06T08:39:08.464 INFO:scrape: 2022-07-06T08:39:08.465 INFO:scrape:Failure: {'smithi081.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['semodule', '-i', '/tmp/nrpe.pp'], 'delta': '0:00:05.007029', 'end': '2022-07-06 08:12:08.607799', 'invocation': {'module_args': {'_raw_params': 'semodule -i /tmp/nrpe.pp', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 1, 'start': '2022-07-06 08:12:03.600770', 'stderr': 'libsemanage.semanage_get_lock: Could not get direct transaction lock at /var/lib/selinux/targeted/semanage.trans.LOCK. (Resource temporarily unavailable).\nsemodule: Failed on /tmp/nrpe.pp!', 'stderr_lines': ['libsemanage.semanage_get_lock: Could not get direct transaction lock at /var/lib/selinux/targeted/semanage.trans.LOCK. (Resource temporarily unavailable).', 'semodule: Failed on /tmp/nrpe.pp!'], 'stdout': '', 'stdout_lines': []}} 2022-07-06T08:39:08.466 INFO:scrape:2 jobs: ['6917071', '6917060'] 2022-07-06T08:39:08.467 INFO:scrape:suites intersection: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}'] 2022-07-06T08:39:08.468 INFO:scrape:suites union: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4'] 2022-07-06T08:39:08.469 INFO:scrape: 2022-07-06T08:39:08.469 INFO:scrape:Failure: {'smithi084.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'ignore_selinux_state': False, 'name': 'nagios_run_sudo', 'persistent': True, 'state': True}}, 'msg': 'Failed to manage policy for boolean nagios_run_sudo: [Errno 11] Resource temporarily unavailable'}, 'smithi171.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'ignore_selinux_state': False, 'name': 'nagios_run_sudo', 'persistent': True, 'state': True}}, 'msg': 'Failed to manage policy for boolean nagios_run_sudo: [Errno 11] Resource temporarily unavailable'}} 2022-07-06T08:39:08.470 INFO:scrape:1 jobs: ['6917075'] 2022-07-06T08:39:08.471 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/no', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/v16.2.4'] 2022-07-06T08:39:08.472 INFO:scrape: 2022-07-06T08:39:08.473 INFO:scrape:Failure: Command failed on smithi100 with status 1: 'set -ex\nsudo dd of=/home/ubuntu/cephtest/valgrind.supp' 2022-07-06T08:39:08.474 INFO:scrape:1 jobs: ['6917062'] 2022-07-06T08:39:08.475 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/no', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific'] 2022-07-06T08:39:08.476 INFO:scrape: