Found 100 jobs Found 5 distinct failure reasons Failure: "2020-08-26T08:31:53.446778+0000 mon.b (mon.0) 263 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log 1 jobs: ['5376972'] suites: ['clusters/{fixed-3', 'config/none', 'min-compat-client/default', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'openstack}', 'pool/replicated-data-pool', 'rbd/librbd/{cache/none', 'supported-random-distro$/{rhel_8}', 'workloads/c_api_tests_with_journaling}'] Dead: b"TypeError: argument of type 'NoneType' is not iterable" 1 jobs: ['5377027'] suites: ['clusters/{fixed-3', 'features/journaling', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'openstack}', 'pool/ec-cache-pool', 'rbd/qemu/{cache/writethrough', 'supported-random-distro$/{centos_8}', 'workloads/qemu_xfstests}'] Failure: "2020-08-26T09:07:04.195370+0000 osd.1 (osd.1) 3 : cluster [WRN] slow request osd_op(client.10025.0:2108 3.0 3:3209f588:::rbd_data.2726af839d3b.00000000000000de:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1552384~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=11 ondisk+retry+write+known_if_redirected e116) initiated 2020-08-26T09:06:33.308070+0000 currently reached pg" in cluster log 1 jobs: ['5377026'] suites: ['clusters/{fixed-1', 'features/layering', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'openstack}', 'pool/small-cache-pool', 'rbd/cli/{base/install', 'supported-random-distro$/{rhel_8}', 'workloads/rbd_cli_generic}'] Failure: Command failed on smithi110 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" 3 jobs: ['5377010', '5376975', '5377044'] suites intersection: ['clusters/{fixed-3', 'features/journaling', 'msgr-failures/few', 'openstack}', 'workloads/qemu_xfstests}'] suites union: ['clusters/{fixed-3', 'features/journaling', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-stupid', 'openstack}', 'pool/ec-data-pool', 'pool/none', 'pool/replicated-data-pool', 'rbd/qemu/{cache/none', 'rbd/qemu/{cache/writeback', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/qemu_xfstests}'] Timeout 3h running clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh 1 jobs: ['5377056'] suites: ['clusters/{fixed-3', 'objectstore/bluestore-hybrid', 'openstack}', 'qemu/xfstests', 'rbd/maintenance/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/dynamic_features_no_cache}']