2022-09-07T15:03:11.164 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-07T15:03:11.166 INFO:teuthology.results:subset: '111/120000' 2022-09-07T15:03:11.166 INFO:teuthology.results:seed: '3058' 2022-09-07T15:29:31.695 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-07T15:29:31.722 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-09-07T18:53:48.399 INFO:teuthology.results:Tests finished! gathering results... 2022-09-07T18:53:49.711 INFO:scrape:Found 14 jobs 2022-09-07T18:53:55.269 INFO:scrape:Found 4 distinct failure reasons 2022-09-07T18:53:55.270 INFO:scrape:Failure: Test failure: test_subvolume_snapshot_info_if_orphan_clone (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2022-09-07T18:53:55.271 INFO:scrape:2 jobs: ['7018797', '7018806'] 2022-09-07T18:53:55.272 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/volumes/{begin/{0-install', 'mds', 'mon', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{no_client_pidfile', 'tasks/volumes/{overrides', 'test/clone}}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-09-07T18:53:55.273 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/volumes/{begin/{0-install', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{no_client_pidfile', 'tasks/volumes/{overrides', 'test/clone}}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-09-07T18:53:55.274 INFO:scrape: 2022-09-07T18:53:55.275 INFO:scrape:Failure: Test failure: test_subvolume_group_ls_filter_internal_directories (tasks.cephfs.test_volumes.TestSubvolumeGroups) 2022-09-07T18:53:55.276 INFO:scrape:2 jobs: ['7018796', '7018804'] 2022-09-07T18:53:55.277 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/volumes/{begin/{0-install', 'mds', 'mon', 'mount', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{no_client_pidfile', 'tasks/volumes/{overrides', 'test/basic}}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-09-07T18:53:55.277 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs/volumes/{begin/{0-install', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{no_client_pidfile', 'rhel_8}', 'tasks/volumes/{overrides', 'test/basic}}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-09-07T18:53:55.278 INFO:scrape: 2022-09-07T18:53:55.279 INFO:scrape:Failure: "2022-09-07T15:44:08.209792+0000 mon.a (mon.0) 387 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log 2022-09-07T18:53:55.280 INFO:scrape:1 jobs: ['7018809'] 2022-09-07T18:53:55.281 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin/{0-install', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{no_client_pidfile', 'rhel_8}', 'tasks/acls}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-09-07T18:53:55.282 INFO:scrape: 2022-09-07T18:53:55.283 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fa057dc6789b82a9e40ab5fe39d555445fdd68f1 2022-09-07T18:53:55.284 INFO:scrape:2 jobs: ['7018803', '7018807'] 2022-09-07T18:53:55.284 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'fs/mixed-clients/{begin/{0-install', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mon', 'ms-die-on-skipped}', 'osd}', 'overrides/{osd-asserts', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-09-07T18:53:55.285 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'fs/mixed-clients/{begin/{0-install', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mon', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{osd-asserts', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-09-07T18:53:55.286 INFO:scrape: