2021-02-22T16:16:39.346 INFO:root:teuthology version: 1.1.0-9a6b849c
2021-02-22T16:16:39.348 INFO:teuthology.results:subset: '0/999'
2021-02-22T16:16:39.348 INFO:teuthology.results:seed: '5843'
2021-02-22T16:22:33.505 INFO:root:teuthology version: 1.1.0-9a6b849c
2021-02-22T16:22:33.543 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-02-23T04:22:46.499 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2021-02-23T04:22:56.236 INFO:scrape:Found 4 jobs
2021-02-23T04:22:58.603 INFO:scrape:Found 3 distinct failure reasons
2021-02-23T04:22:58.605 INFO:scrape:Failure: "2021-02-22T16:38:59.183379+0000 osd.1 (osd.1) 14 : cluster [ERR] 4.f scrub : stat mismatch, got 5/5 objects, 0/0 clones, 4/5 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 14067591/14067591 bytes, 3/3 manifest objects, 0/0 hit_set_archive bytes." in cluster log
2021-02-23T04:22:58.605 INFO:scrape:1 jobs: ['5903177']
2021-02-23T04:22:58.606 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-partial-recovery}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'msgr/async', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/dedup-io-mixed}']
2021-02-23T04:22:58.606 INFO:scrape:
2021-02-23T04:22:58.607 INFO:scrape:Dead: b'2021-02-23T04:20:00.000 INFO:tasks.ceph.mon.a.smithi067.stderr:2021-02-23T04:19:59.995+0000 7f8c8f8d3700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 32/194 objects unfound (16.495%); 1 osds down; Reduced data availability: 13 pgs inactive; Possible data damage: 3 pgs recovery_unfound; Degraded data redundancy: 117/388 objects degraded (30.155%), 10 pgs degraded, 13 pgs undersized; 1 pool(s) do not have an application enabled; 4 daemons have recently crashed'
2021-02-23T04:22:58.607 INFO:scrape:ceph version 17.0.0-570-g88af4193 (88af419391c07a0cf3582336fcdda66e2d387d90) quincy (dev)
 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7fdfe74de980]
 2: gsignal()
 3: abort()
 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x1a7) [0x56127d06eccf]
 5: (PrimaryLogPG::maybe_handle_manifest_detail(boost::intrusive_ptr<OpRequest>, bool, std::shared_ptr<ObjectContext>)+0x9f1) [0x56127d2468f1]
 6: (PrimaryLogPG::maybe_handle_manifest(boost::intrusive_ptr<OpRequest>, bool, std::shared_ptr<ObjectContext>)+0x5d) [0x56127d2c14bd]
 7: (PrimaryLogPG::do_op(boost::intrusive_ptr<OpRequest>&)+0x3b27) [0x56127d262937]
 8: (PrimaryLogPG::do_request(boost::intrusive_ptr<OpRequest>&, ThreadPool::TPHandle&)+0xcc7) [0x56127d26e317]
 9: (OSD::dequeue_op(boost::intrusive_ptr<PG>, boost::intrusive_ptr<OpRequest>, ThreadPool::TPHandle&)+0x17b) [0x56127d0f448b]
 10: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr<PG>&, ThreadPool::TPHandle&)+0x6a) [0x56127d355a6a]
 11: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xcd5) [0x56127d112225]
 12: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x56127d787d0c]
 13: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x56127d78afc0]
 14: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7fdfe74d36db]
 15: clone()
2021-02-23T04:22:58.608 INFO:scrape:1 jobs: ['5903174']
2021-02-23T04:22:58.608 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-recovery}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/none', 'thrashosds-health', 'workloads/dedup-io-snaps}']
2021-02-23T04:22:58.609 INFO:scrape:
2021-02-23T04:22:58.609 INFO:scrape:Dead: b'2021-02-23T04:22:58.561 INFO:tasks.ceph.osd.0.smithi083.stderr:2021-02-23T04:22:58.560+0000 7f1b55521700 -1 received  signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0  (PID: 16880) UID: 0'
2021-02-23T04:22:58.610 INFO:scrape:1 jobs: ['5903179']
2021-02-23T04:22:58.611 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/fastclose', 'msgr/async-v1only', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashosds-health', 'workloads/dedup-io-snaps}']
2021-02-23T04:22:58.611 INFO:scrape: