2022-07-11T09:32:34.541 INFO:root:teuthology version: 1.1.1.dev381+g10062088
2022-07-11T09:32:34.543 INFO:teuthology.results:seed: '3672'
2022-07-11T09:32:48.233 INFO:root:teuthology version: 1.1.1.dev381+g10062088
2022-07-11T09:32:48.234 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-07-11T10:31:53.204 INFO:teuthology.results:Tests finished! gathering results...
2022-07-11T10:31:55.134 INFO:scrape:Found 32 jobs
2022-07-11T10:32:00.122 INFO:scrape:Found 4 distinct failure reasons
2022-07-11T10:32:00.123 INFO:scrape:Failure: Command failed on smithi006 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 44b13fae-00ff-11ed-842e-001a4aab830c -e sha1=67c3088bbad2bb45fab809eb6d89e0b3248197b6 -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | length == 2\'"\'"\'\''
2022-07-11T10:32:00.124 INFO:scrape:21 jobs: ['6923220', '6923229', '6923247', '6923223', '6923221', '6923232', '6923244', '6923245', '6923235', '6923222', '6923240', '6923230', '6923241', '6923231', '6923224', '6923239', '6923216', '6923218', '6923236', '6923217', '6923242']
2022-07-11T10:32:00.124 INFO:scrape:suites intersection: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}']
2022-07-11T10:32:00.125 INFO:scrape:suites union: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4']
2022-07-11T10:32:00.125 INFO:scrape:
2022-07-11T10:32:00.126 INFO:scrape:Failure: Command failed on smithi002 with status 1: 'set -ex\nsudo dd of=/home/ubuntu/cephtest/valgrind.supp'
2022-07-11T10:32:00.126 INFO:scrape:5 jobs: ['6923246', '6923227', '6923243', '6923238', '6923228']
2022-07-11T10:32:00.127 INFO:scrape:suites intersection: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}']
2022-07-11T10:32:00.127 INFO:scrape:suites union: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4']
2022-07-11T10:32:00.128 INFO:scrape:
2022-07-11T10:32:00.128 INFO:scrape:Failure: Command failed on smithi102 with status 1: "sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump"
2022-07-11T10:32:00.129 INFO:scrape:1 jobs: ['6923225']
2022-07-11T10:32:00.129 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/v16.2.4']
2022-07-11T10:32:00.129 INFO:scrape:
2022-07-11T10:32:00.130 INFO:scrape:Failure: Command failed on smithi112 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log'
2022-07-11T10:32:00.130 INFO:scrape:1 jobs: ['6923226']
2022-07-11T10:32:00.131 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/upgrade_without_reducing_max_mds/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/v16.2.4']
2022-07-11T10:32:00.131 INFO:scrape: