2022-06-20T09:06:00.348 INFO:root:teuthology version: 1.1.1.dev374+g31a356e0
2022-06-20T09:06:00.350 INFO:teuthology.results:seed: '2427'
2022-06-20T09:26:29.361 INFO:root:teuthology version: 1.1.1.dev374+g31a356e0
2022-06-20T09:26:29.365 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-06-20T09:46:30.927 INFO:teuthology.results:Tests finished! gathering results...
2022-06-20T09:46:32.035 INFO:scrape:Found 23 jobs
2022-06-20T09:46:34.563 INFO:scrape:Found 5 distinct failure reasons
2022-06-20T09:46:34.564 INFO:scrape:Failure: 
2022-06-20T09:46:34.564 INFO:scrape:8 jobs: ['6887634', '6887644', '6887641', '6887642', '6887639', '6887632', '6887638', '6887635']
2022-06-20T09:46:34.565 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-client', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}']
2022-06-20T09:46:34.565 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4']
2022-06-20T09:46:34.566 INFO:scrape:
2022-06-20T09:46:34.566 INFO:scrape:Failure: Cannot connect to remote host smithi167
2022-06-20T09:46:34.567 INFO:scrape:3 jobs: ['6887650', '6887652', '6887651']
2022-06-20T09:46:34.567 INFO:scrape:suites intersection: ['conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health']
2022-06-20T09:46:34.568 INFO:scrape:suites union: ['1-client', '1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '2-upgrade', '3-compat_client/quincy}}', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'centos_latest', 'clusters/1-mds-2-client-micro', 'conf/{client', 'fs:upgrade/featureful_client/old_client/{bluestore-bitmap', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'multimds/no', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg-warn}', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4', 'tasks/{0-octopus']
2022-06-20T09:46:34.568 INFO:scrape:
2022-06-20T09:46:34.569 INFO:scrape:Failure: SSH connection to smithi060 was lost: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5c4bafca-f07c-11ec-8427-001a4aab830c -e sha1=1249cc621e966ba32448cfd8e8c0ec69e76e8f5b -- bash -c \'while ceph orch upgrade status | jq \'"\'"\'.in_progress\'"\'"\' | grep true && ! ceph orch upgrade status | jq \'"\'"\'.message\'"\'"\' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; sleep 30 ; done\''
2022-06-20T09:46:34.569 INFO:scrape:5 jobs: ['6887648', '6887646', '6887653', '6887649', '6887645']
2022-06-20T09:46:34.570 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-client', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}']
2022-06-20T09:46:34.570 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4']
2022-06-20T09:46:34.571 INFO:scrape:
2022-06-20T09:46:34.571 INFO:scrape:Failure: Command failed on smithi132 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69fc642c-f07a-11ec-8427-001a4aab830c -- ceph orch daemon add osd smithi132:vg_nvme/lv_4'
2022-06-20T09:46:34.571 INFO:scrape:1 jobs: ['6887637']
2022-06-20T09:46:34.572 INFO:scrape:suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/v16.2.4']
2022-06-20T09:46:34.572 INFO:scrape:
2022-06-20T09:46:34.573 INFO:scrape:Failure: unexpected end of data
2022-06-20T09:46:34.573 INFO:scrape:1 jobs: ['6887643']
2022-06-20T09:46:34.574 INFO:scrape:suites: ['1-client', '2-upgrade', '3-compat_client/no}}', 'centos_latest', 'clusters/1-mds-2-client-micro', 'conf/{client', 'fs:upgrade/featureful_client/old_client/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'multimds/yes', 'osd}', 'overrides/{ignorelist_health', 'pg-warn}', 'tasks/{0-octopus']
2022-06-20T09:46:34.574 INFO:scrape: