2022-03-28T16:24:38.892 INFO:root:teuthology version: 1.1.0-70390753 2022-03-28T16:24:38.894 INFO:teuthology.results:subset: '111/120000' 2022-03-28T16:24:38.894 INFO:teuthology.results:seed: '2912' 2022-03-28T16:24:45.665 INFO:root:teuthology version: 1.1.0-70390753 2022-03-28T16:24:45.666 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-28T23:14:14.120 INFO:teuthology.results:Tests finished! gathering results... 2022-03-28T23:14:15.203 INFO:scrape:Found 12 jobs 2022-03-28T23:14:16.896 INFO:scrape:Found 4 distinct failure reasons 2022-03-28T23:14:16.897 INFO:scrape:Failure: Command failed on smithi037 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:14f44febaa74e8f8931e156f1a921292708ad47a -v bootstrap --fsid 4c4c1eb4-aeb6-11ec-8c35-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.37 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' 2022-03-28T23:14:16.897 INFO:scrape:5 jobs: ['6765510', '6765502', '6765503', '6765501', '6765499'] 2022-03-28T23:14:16.898 INFO:scrape:suites intersection: ['1-cephadm', '2-logrotate}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs/workload/{0-rhel_8', 'mds', 'mon', 'mount', 'ms-die-on-skipped}}', 'osd-asserts', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-03-28T23:14:16.898 INFO:scrape:suites union: ['1-cephadm', '2-logrotate}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs/workload/{0-rhel_8', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/{crc}', 'ms_mode/{legacy}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'ranks/1', 'ranks/5', 'scrub/no', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/direct_io}', 'workunit/fs/test_o_trunc}', 'workunit/suites/dbench}', 'workunit/suites/fsstress}', 'workunit/suites/pjd}', 'wsync/{no}}', 'wsync/{yes}}'] 2022-03-28T23:14:16.899 INFO:scrape: 2022-03-28T23:14:16.899 INFO:scrape:Failure: Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) 2022-03-28T23:14:16.899 INFO:scrape:1 jobs: ['6765500'] 2022-03-28T23:14:16.900 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'centos_latest', 'clients/mirror', 'cluster/1-node', 'debug', 'fs/valgrind/{begin/{0-install', 'mirror/{cephfs-mirror/one-per-cluster', 'mount/fuse', 'overrides/whitelist_health', 'tasks/mirror}}'] 2022-03-28T23:14:16.900 INFO:scrape: 2022-03-28T23:14:16.901 INFO:scrape:Failure: SSH connection to smithi026 was lost: 'sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0' 2022-03-28T23:14:16.901 INFO:scrape:1 jobs: ['6765512'] 2022-03-28T23:14:16.902 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/verify/{begin/{0-install', 'mds', 'mon', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-bitmap', 'osd}', 'overrides/{mon-debug', 'ranks/1', 'session_timeout', 'tasks/fsstress', 'validater/valgrind}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-03-28T23:14:16.902 INFO:scrape: 2022-03-28T23:14:16.902 INFO:scrape:Dead: b'2022-03-28T23:02:00.261 DEBUG:teuthology.exit:Finished running handlers' 2022-03-28T23:14:16.903 INFO:scrape:1 jobs: ['6765498'] 2022-03-28T23:14:16.903 INFO:scrape:suites: ['1-cephadm', '2-logrotate}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs/workload/{0-rhel_8', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/{crc}', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag', 'ranks/3', 'rhel_8}', 'scrub/no', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/blogbench}', 'wsync/{no}}'] 2022-03-28T23:14:16.904 INFO:scrape: