2022-02-24T21:35:48.070 INFO:root:teuthology version: 1.1.0-5825e8d0 2022-02-24T21:35:48.071 INFO:teuthology.results:subset: '111/120000' 2022-02-24T21:35:48.071 INFO:teuthology.results:seed: '7511' 2022-02-24T22:19:11.350 INFO:root:teuthology version: 1.1.0-5825e8d0 2022-02-24T22:19:11.417 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-02-25T04:28:39.877 INFO:teuthology.results:Tests finished! gathering results... 2022-02-25T04:28:46.212 INFO:scrape:Found 55 jobs 2022-02-25T04:28:50.395 INFO:scrape:Found 5 distinct failure reasons 2022-02-25T04:28:50.397 INFO:scrape:Failure: "2022-02-24T22:30:50.070788+0000 mon.a (mon.0) 1464 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log 2022-02-25T04:28:50.398 INFO:scrape:2 jobs: ['6704697', '6704721'] 2022-02-25T04:28:50.399 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'mds', 'mon', 'osd}', 'overrides/{no_client_pidfile', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-02-25T04:28:50.400 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin/{0-install', 'fs/volumes/{begin/{0-install', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{no_client_pidfile', 'tasks/metrics}', 'tasks/volumes/{overrides', 'test/clone}}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-02-25T04:28:50.401 INFO:scrape: 2022-02-25T04:28:50.402 INFO:scrape:Failure: Test failure: test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) 2022-02-25T04:28:50.403 INFO:scrape:2 jobs: ['6704737', '6704682'] 2022-02-25T04:28:50.404 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/volumes/{begin/{0-install', 'mds', 'mon', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{no_client_pidfile', 'tasks/volumes/{overrides', 'test/misc}}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-02-25T04:28:50.405 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs/volumes/{begin/{0-install', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{no_client_pidfile', 'rhel_8}', 'tasks/volumes/{overrides', 'test/misc}}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-02-25T04:28:50.406 INFO:scrape: 2022-02-25T04:28:50.407 INFO:scrape:Failure: Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) 2022-02-25T04:28:50.408 INFO:scrape:1 jobs: ['6704681'] 2022-02-25T04:28:50.409 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'centos_latest', 'clients/mirror', 'cluster/1-node', 'debug', 'fs/valgrind/{begin/{0-install', 'mirror/{cephfs-mirror/one-per-cluster', 'mount/fuse', 'overrides/whitelist_health', 'tasks/mirror}}'] 2022-02-25T04:28:50.410 INFO:scrape: 2022-02-25T04:28:50.411 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/suites/ffsb.sh 2022-02-25T04:28:50.412 INFO:scrape:1 jobs: ['6704735'] 2022-02-25T04:28:50.413 INFO:scrape:suites: ['1-ceph', '2-logrotate}', '2-workunit/suites/ffsb}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'fs/thrash/workloads/{begin/{0-install', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'objectstore-ec/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'prefetch_dirfrags/yes', 'races', 'ranks/3', 'session_timeout', 'tasks/{1-thrash/mds', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-02-25T04:28:50.413 INFO:scrape: 2022-02-25T04:28:50.414 INFO:scrape:Dead: b'2022-02-25T04:24:58.402 DEBUG:teuthology.exit:Finished running handlers' 2022-02-25T04:28:50.415 INFO:scrape:1 jobs: ['6704690'] 2022-02-25T04:28:50.416 INFO:scrape:suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'syntax', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-02-25T04:28:50.416 INFO:scrape: