2022-06-23T09:31:51.681 INFO:root:teuthology version: 1.1.1.dev374+g31a356e0
2022-06-23T09:31:51.684 INFO:teuthology.results:seed: '2696'
2022-06-23T09:46:54.195 INFO:root:teuthology version: 1.1.1.dev374+g31a356e0
2022-06-23T09:46:54.221 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-06-23T21:46:54.408 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2022-06-23T21:46:59.393 INFO:scrape:Found 23 jobs
2022-06-23T21:47:06.457 INFO:scrape:Found 7 distinct failure reasons
2022-06-23T21:47:06.459 INFO:scrape:Failure: Cannot connect to remote host smithi093
2022-06-23T21:47:06.460 INFO:scrape:8 jobs: ['6894324', '6894323', '6894319', '6894321', '6894322', '6894318', '6894313', '6894308']
2022-06-23T21:47:06.461 INFO:scrape:suites intersection: ['conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health']
2022-06-23T21:47:06.462 INFO:scrape:suites union: ['1-client', '1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-upgrade', '3-client-upgrade', '3-compat_client/no}}', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-compat_client', '4-verify}', '4-verify}}', '5-client-sanity}}', 'centos_8.stream_container_tools', 'centos_latest', 'clusters/1-mds-2-client-micro', 'conf/{client', 'fs:upgrade/featureful_client/old_client/{bluestore-bitmap', 'fs:upgrade/featureful_client/upgraded_client/{bluestore-bitmap', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'multimds/no', 'multimds/yes', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg-warn}', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4', 'tasks/{0-octopus']
2022-06-23T21:47:06.463 INFO:scrape:
2022-06-23T21:47:06.464 INFO:scrape:Failure: SSH connection to smithi039 was lost: 'sudo yum -y install python3-rados'
2022-06-23T21:47:06.465 INFO:scrape:4 jobs: ['6894325', '6894327', '6894329', '6894328']
2022-06-23T21:47:06.465 INFO:scrape:suites intersection: ['conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health']
2022-06-23T21:47:06.466 INFO:scrape:suites union: ['1-client', '1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-upgrade', '3-compat_client/quincy}}', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'centos_latest', 'clusters/1-mds-2-client-micro', 'conf/{client', 'fs:upgrade/featureful_client/old_client/{bluestore-bitmap', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'multimds/no', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg-warn}', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4', 'tasks/{0-octopus']
2022-06-23T21:47:06.467 INFO:scrape:
2022-06-23T21:47:06.468 INFO:scrape:Failure: Command failed on smithi083 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97ec959e-f2d9-11ec-842b-001a4aab830c -e sha1=1249cc621e966ba32448cfd8e8c0ec69e76e8f5b -- bash -c \'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .active_name | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1\''
2022-06-23T21:47:06.469 INFO:scrape:6 jobs: ['6894314', '6894316', '6894315', '6894312', '6894311', '6894309']
2022-06-23T21:47:06.470 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-client', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}']
2022-06-23T21:47:06.471 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4']
2022-06-23T21:47:06.479 INFO:scrape:
2022-06-23T21:47:06.480 INFO:scrape:Failure: SSH connection to smithi103 was lost: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/dparmar18/ceph /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 273ccb9068c784cc302d7274fbc3c94e0c76c80f'
2022-06-23T21:47:06.481 INFO:scrape:1 jobs: ['6894320']
2022-06-23T21:47:06.481 INFO:scrape:suites: ['1-client', '2-upgrade', '3-compat_client/no}}', 'centos_latest', 'clusters/1-mds-2-client-micro', 'conf/{client', 'fs:upgrade/featureful_client/old_client/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'multimds/yes', 'osd}', 'overrides/{ignorelist_health', 'pg-warn}', 'tasks/{0-octopus']
2022-06-23T21:47:06.481 INFO:scrape:
2022-06-23T21:47:06.482 INFO:scrape:Failure: {'smithi120.front.sepia.ceph.com': {'_ansible_no_log': False, 'msg': "Failed to connect to the host via ssh: Warning: Permanently added 'smithi120.front.sepia.ceph.com,172.21.15.120' (ECDSA) to the list of known hosts.\r\nubuntu@smithi120.front.sepia.ceph.com: Permission denied (publickey,password,keyboard-interactive)."}, 'smithi089.front.sepia.ceph.com': {'_ansible_no_log': False, 'msg': "Failed to connect to the host via ssh: Warning: Permanently added 'smithi089.front.sepia.ceph.com,172.21.15.89' (ECDSA) to the list of known hosts.\r\nubuntu@smithi089.front.sepia.ceph.com: Permission denied (publickey,password,keyboard-interactive)."}}
2022-06-23T21:47:06.488 INFO:scrape:1 jobs: ['6894330']
2022-06-23T21:47:06.489 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific']
2022-06-23T21:47:06.490 INFO:scrape:
2022-06-23T21:47:06.490 INFO:scrape:Failure: SSH connection to smithi088 was lost: 'sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd'
2022-06-23T21:47:06.491 INFO:scrape:1 jobs: ['6894317']
2022-06-23T21:47:06.492 INFO:scrape:suites: ['1-client', '2-upgrade', '3-compat_client/quincy}}', 'centos_latest', 'clusters/1-mds-2-client-micro', 'conf/{client', 'fs:upgrade/featureful_client/old_client/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'multimds/yes', 'osd}', 'overrides/{ignorelist_health', 'pg-warn}', 'tasks/{0-octopus']
2022-06-23T21:47:06.493 INFO:scrape:
2022-06-23T21:47:06.494 INFO:scrape:Dead: b'2022-06-23T09:55:37.108 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install cephadm'
2022-06-23T21:47:06.495 INFO:scrape:1 jobs: ['6894326']
2022-06-23T21:47:06.495 INFO:scrape:suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/no', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/v16.2.4']
2022-06-23T21:47:06.497 INFO:scrape: