Found 179 jobs Found 3 distinct failure reasons Timeout 3h running clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh 4 jobs: ['5675896', '5675842', '5675868', '5675750'] suites intersection: ['clusters/{fixed-3', 'openstack}', 'qemu/xfstests', 'rbd/maintenance/{base/install', 'supported-random-distro$/{ubuntu_latest}'] suites union: ['clusters/{fixed-3', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'openstack}', 'qemu/xfstests', 'rbd/maintenance/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/dynamic_features_no_cache}', 'workloads/dynamic_features}'] Failure: "2020-12-02T18:32:31.099044+0000 osd.0 (osd.0) 3 : cluster [WRN] slow request osd_op(client.10049.0:773 3.3 3:ebf5a769:::rbd_data.273ecfec841e.00000000000000e0:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=9 ondisk+retry+write+known_if_redirected e123) initiated 2020-12-02T18:32:00.179844+0000 currently reached pg" in cluster log 2 jobs: ['5675773', '5675806'] suites intersection: ['clusters/{fixed-1', 'features/format-1', 'msgr-failures/few', 'openstack}', 'pool/small-cache-pool', 'rbd/cli_v1/{base/install', 'supported-random-distro$/{rhel_8}', 'workloads/rbd_cli_generic}'] suites union: ['clusters/{fixed-1', 'features/format-1', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'openstack}', 'pool/small-cache-pool', 'rbd/cli_v1/{base/install', 'supported-random-distro$/{rhel_8}', 'workloads/rbd_cli_generic}'] Failure: Command failed on smithi188 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" 1 jobs: ['5675892'] suites: ['clusters/{fixed-3', 'features/readbalance', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'pool/ec-data-pool', 'rbd/qemu/{cache/writethrough', 'supported-random-distro$/{ubuntu_latest}', 'workloads/qemu_xfstests}']