Found 148 jobs Found 7 distinct failure reasons Dead: b'2020-07-01T05:00:20.860 DEBUG:teuthology.exit:Finished running handlers' 1 jobs: ['5189339'] suites: ['clients/{mirror-extra', 'cluster/{2-node', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rbd/mirror/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-workunit-minimum}'] Failure: "2020-06-30T14:53:26.209060+0000 mon.a (mon.0) 463 : cluster [WRN] Health check failed: 0 slow ops, oldest one blocked for 31 sec, osd.2 has slow ops (SLOW_OPS)" in cluster log 1 jobs: ['5189105'] suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{rhel_latest}', 'workloads/rbd-mirror-fsx-workunit}'] Failure: "2020-06-30T14:42:03.863787+0000 osd.1 (osd.1) 3 : cluster [WRN] slow request osd_op(client.11988.0:1429 3.2 3:68ace723:test1::rbd_data.2ed0af0ff88a.00000000000000b7:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3747840~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=8 ondisk+retry+write+known_if_redirected e119) initiated 2020-06-30T14:41:33.840798+0000 currently reached pg" in cluster log 2 jobs: ['5189109', '5189117'] suites intersection: ['clusters/{fixed-1', 'msgr-failures/few', 'openstack}', 'pool/small-cache-pool', 'supported-random-distro$/{centos_latest}', 'workloads/rbd_cli_generic}'] suites union: ['clusters/{fixed-1', 'features/format-1', 'features/journaling', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'pool/small-cache-pool', 'rbd/cli/{base/install', 'rbd/cli_v1/{base/install', 'supported-random-distro$/{centos_latest}', 'workloads/rbd_cli_generic}'] Failure: Command failed on smithi084 with status 1: 'sudo yum -y install ceph-test' 1 jobs: ['5189198'] suites: ['objectstore/bluestore-comp-snappy', 'openstack', 'rbd/singleton/{all/read-flags-writethrough', 'supported-random-distro$/{centos_latest}}'] Failure: Stale jobs detected, aborting. 1 jobs: ['5189157'] suites: ['clusters/{fixed-3', 'config/permit-partial-discard', 'min-compat-client/octopus', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'openstack}', 'pool/small-cache-pool', 'rbd/librbd/{cache/writearound', 'supported-random-distro$/{centos_latest}', 'workloads/c_api_tests_with_defaults}'] Failure: {'smithi066.front.sepia.ceph.com': {'changed': False, 'msg': 'Data could not be sent to remote host "smithi066.front.sepia.ceph.com". Make sure this host can be reached over ssh: ssh: connect to host smithi066.front.sepia.ceph.com port 22: No route to host\r\n', 'unreachable': True}, 'smithi047.front.sepia.ceph.com': {'changed': False, 'msg': 'Data could not be sent to remote host "smithi047.front.sepia.ceph.com". Make sure this host can be reached over ssh: Warning: Permanently added \'smithi047.front.sepia.ceph.com,172.21.15.47\' (ECDSA) to the list of known hosts.\r\nubuntu@smithi047.front.sepia.ceph.com: Permission denied (publickey,password,keyboard-interactive).\r\n', 'unreachable': True}} 1 jobs: ['5189165'] suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_latest}', 'workloads/rbd-mirror-stress-workunit}'] Failure: reached maximum tries (60) after waiting for 900 seconds 2 jobs: ['5189113', '5189144']