2022-11-24T16:49:30.424 INFO:root:teuthology version: 0.0.1.dev3+g4da97cf 2022-11-24T16:49:30.425 INFO:teuthology.results:seed: '4645' 2022-11-24T16:56:06.550 INFO:root:teuthology version: 0.0.1.dev3+g4da97cf 2022-11-24T16:56:06.555 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-11-24T17:40:36.876 INFO:teuthology.results:Tests finished! gathering results... 2022-11-24T17:40:42.284 INFO:scrape:Found 6 jobs 2022-11-24T17:40:44.037 INFO:scrape:Found 3 distinct failure reasons 2022-11-24T17:40:44.037 INFO:scrape:Crash: Test failure: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2022-11-24T17:40:44.038 INFO:scrape:ceph version 17.0.0-14202-g1b6951d3 (1b6951d333beab367fcd12961fc625c73a8860fd) quincy (dev) 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f55a20d2ce0] 2: gsignal() 3: abort() 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f55a3114d55] 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a6ec1) [0x7f55a3114ec1] 6: (MDCache::remove_inode(CInode*)+0x608) [0x556769434b58] 7: (StrayManager::_purge_stray_logged(CDentry*, unsigned long, boost::intrusive_ptr&)+0x18a) [0x5567694ed87a] 8: (MDSContext::complete(int)+0x5f) [0x5567696675bf] 9: (MDSIOContextBase::complete(int)+0x514) [0x556769667d34] 10: (MDSLogContextBase::complete(int)+0x45) [0x5567696680d5] 11: (Finisher::finisher_thread_entry()+0x18d) [0x7f55a31b6b6d] 12: /lib64/libpthread.so.0(+0x81cf) [0x7f55a20c81cf] 13: clone() 2022-11-24T17:40:44.038 INFO:scrape:2 jobs: ['7091191', '7091193'] 2022-11-24T17:40:44.038 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/scrub}'] 2022-11-24T17:40:44.038 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/scrub}'] 2022-11-24T17:40:44.038 INFO:scrape: 2022-11-24T17:40:44.039 INFO:scrape:Failure: machine smithi120.front.sepia.ceph.com is locked by scheduled_yuriw@teuthology, not scheduled_dparmar@teuthology 2022-11-24T17:40:44.039 INFO:scrape:1 jobs: ['7091196'] 2022-11-24T17:40:44.039 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/scrub}'] 2022-11-24T17:40:44.039 INFO:scrape: 2022-11-24T17:40:44.039 INFO:scrape:Failure: "2022-11-24T17:30:57.408517+0000 mon.a (mon.0) 962 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log 2022-11-24T17:40:44.039 INFO:scrape:1 jobs: ['7091195'] 2022-11-24T17:40:44.039 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/scrub}'] 2022-11-24T17:40:44.040 INFO:scrape: