2022-01-11T16:35:07.442 INFO:root:teuthology version: 1.1.0-00e09f05 2022-01-11T16:35:07.444 INFO:teuthology.results:subset: '111/120000' 2022-01-11T16:35:07.444 INFO:teuthology.results:seed: '7922' 2022-01-11T16:40:02.964 INFO:root:teuthology version: 1.1.0-00e09f05 2022-01-11T16:40:02.968 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-01-11T20:04:18.381 INFO:teuthology.results:Tests finished! gathering results... 2022-01-11T20:04:19.166 INFO:scrape:Found 9 jobs 2022-01-11T20:04:21.576 INFO:scrape:Found 5 distinct failure reasons 2022-01-11T20:04:21.577 INFO:scrape:Failure: Command failed on smithi122 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/master' 2022-01-11T20:04:21.577 INFO:scrape:3 jobs: ['6608196', '6608197', '6608202'] 2022-01-11T20:04:21.578 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-01-11T20:04:21.578 INFO:scrape:suites union: ['2-workunit/suites/iozone}}', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin', 'fs/thrash/workloads/{begin', 'k-testing}', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag', 'overrides/{no_client_pidfile', 'prefetch_dirfrags/no', 'races', 'ranks/3', 'session_timeout', 'tasks/fragment}', 'tasks/workunit/dir-max-entries}', 'tasks/{1-thrash/osd', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-01-11T20:04:21.579 INFO:scrape: 2022-01-11T20:04:21.579 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/suites/ffsb.sh 2022-01-11T20:04:21.580 INFO:scrape:1 jobs: ['6608198'] 2022-01-11T20:04:21.581 INFO:scrape:suites: ['clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{centos_8.stream}', 'fs/workload/{begin', 'k-testing}', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/{crc}', 'objectstore-ec/bluestore-comp', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag', 'ranks/1', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/ffsb}', 'wsync/{no}}'] 2022-01-11T20:04:21.581 INFO:scrape: 2022-01-11T20:04:21.582 INFO:scrape:Failure: "2022-01-11T17:10:27.004500+0000 mon.a (mon.0) 553 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log 2022-01-11T20:04:21.582 INFO:scrape:2 jobs: ['6608194', '6608200'] 2022-01-11T20:04:21.583 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{no_client_pidfile', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-01-11T20:04:21.584 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{no_client_pidfile', 'tasks/client-recovery}', 'tasks/snap-schedule}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-01-11T20:04:21.584 INFO:scrape: 2022-01-11T20:04:21.585 INFO:scrape:Failure: Command failed on smithi018 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:173f3657914eae0a6406188d32ab3df66f6e7ba3 pull' 2022-01-11T20:04:21.585 INFO:scrape:1 jobs: ['6608195'] 2022-01-11T20:04:21.585 INFO:scrape:suites: ['1-mount', '2-workload/dbench', 'distro/centos_latest}', 'fs/cephadm/multivolume/{0-start'] 2022-01-11T20:04:21.586 INFO:scrape: 2022-01-11T20:04:21.586 INFO:scrape:Failure: Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 2022-01-11T20:04:21.587 INFO:scrape:1 jobs: ['6608199'] 2022-01-11T20:04:21.587 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{no_client_pidfile', 'rhel_8}', 'tasks/client-readahead}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-01-11T20:04:21.588 INFO:scrape: