2021-04-23T10:50:37.652 INFO:root:teuthology version: 1.1.0-2713a3cd
2021-04-23T10:50:37.652 INFO:teuthology.results:subset: '1/10'
2021-04-23T10:50:37.652 INFO:teuthology.results:seed: '3519'
2021-04-23T12:44:19.722 INFO:root:teuthology version: 1.1.0-2713a3cd
2021-04-23T12:44:19.752 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-04-24T00:45:14.651 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2021-04-24T00:45:21.234 INFO:scrape:Found 24 jobs
2021-04-24T00:45:21.311 INFO:scrape:Found 5 distinct failure reasons
2021-04-24T00:45:21.312 INFO:scrape:Failure: reached maximum tries (800) after waiting for 4800 seconds
2021-04-24T00:45:21.312 INFO:scrape:1 jobs: ['6068069']
2021-04-24T00:45:21.312 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-recovery}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_8}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/admin_socket_objecter_requests}']
2021-04-24T00:45:21.312 INFO:scrape:
2021-04-24T00:45:21.312 INFO:scrape:Timeout 120 running ceph --cluster ceph osd dump --format=json
2021-04-24T00:45:21.312 INFO:scrape:2 jobs: ['6068054', '6068062']
2021-04-24T00:45:21.313 INFO:scrape:suites intersection: ['1-pg-log-overrides/short_pg_log', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/mapgap', 'thrashosds-health']
2021-04-24T00:45:21.313 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-async-partial-recovery}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/radosbench-high-concurrency}', 'workloads/small-objects-balanced}']
2021-04-24T00:45:21.313 INFO:scrape:
2021-04-24T00:45:21.313 INFO:scrape:Dead: b'2021-04-24T00:30:38.193 DEBUG:teuthology.exit:Finished running handlers'
2021-04-24T00:45:21.313 INFO:scrape:1 jobs: ['6068072']
2021-04-24T00:45:21.313 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_8}', 'thrashers/careful', 'thrashosds-health', 'workloads/cache-pool-snaps-readproxy}']
2021-04-24T00:45:21.313 INFO:scrape:
2021-04-24T00:45:21.313 INFO:scrape:Dead: b'2021-04-24T00:45:18.297 INFO:teuthology.orchestra.run.gibba023.stdout:{"epoch":4637,"fsid":"f2d2bd65-ab83-41d2-9fd6-7836af94b778","created":"2021-04-23T13:01:49.788516+0000","modified":"2021-04-24T00:44:58.159214+0000","last_up_change":"2021-04-23T15:19:38.917126+0000","last_in_change":"2021-04-23T13:25:13.832012+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-04-23T13:01:57.878039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":91,"pg_placement_num":91,"pg_placement_num_target":91,"pg_num_target":91,"pg_num_pending":91,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0\'0","target_version":"0\'0"},"last_change":"712","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"603","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-04-23T13:01:59.909565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":108,"pg_placement_num":108,"pg_placement_num_target":108,"pg_num_target":108,"pg_num_pending":108,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0\'0","target_version":"0\'0"},"last_change":"713","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"660","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"base","create_time":"2021-04-23T13:02:09.442738+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0\'0","target_version":"0\'0"},"last_change":"693","last_force_op_resend":"24","last_force_op_resend_prenautilus":"24","last_force_op_resend_preluminous":"24","auid":0,"snap_mode":"selfmanaged","snap_seq":572,"snap_epoch":693,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[4],"tier_of":-1,"read_tier":4,"write_tier":4,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":4,"pool_name":"cache","create_time":"2021-04-23T13:02:11.414879+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0\'0","target_version":"0\'0"},"last_change":"693","last_force_op_resend":"24","last_force_op_resend_prenautilus":"24","last_force_op_resend_preluminous":"24","auid":0,"snap_mode":"selfmanaged","snap_seq":572,"snap_epoch":693,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":3,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":3600,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":2,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"39d4f455-affd-44cb-91b2-65e9b6f8c785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":1415,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6804","nonce":35432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6805","nonce":35432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6807","nonce":35432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6806","nonce":35432}]},"public_addr":"172.21.2.123:6804/35432","cluster_addr":"172.21.2.123:6805/35432","heartbeat_back_addr":"172.21.2.123:6807/35432","heartbeat_front_addr":"172.21.2.123:6806/35432","state":["exists","up"]},{"osd":1,"uuid":"4886b2f0-4f3d-4cde-b0a5-91fc1b72672b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":239,"up_from":268,"up_thru":1415,"down_at":240,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6800","nonce":88410}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6801","nonce":88410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6803","nonce":88410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6802","nonce":88410}]},"public_addr":"172.21.2.123:6800/88410","cluster_addr":"172.21.2.123:6801/88410","heartbeat_back_addr":"172.21.2.123:6803/88410","heartbeat_front_addr":"172.21.2.123:6802/88410","state":["exists","up"]},{"osd":2,"uuid":"5707b68d-40c4-4784-9cab-e433cfd0dc1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":1415,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6808","nonce":35434}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6809","nonce":35434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6811","nonce":35434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6810","nonce":35434}]},"public_addr":"172.21.2.123:6808/35434","cluster_addr":"172.21.2.123:6809/35434","heartbeat_back_addr":"172.21.2.123:6811/35434","heartbeat_front_addr":"172.21.2.123:6810/35434","state":["exists","up"]},{"osd":3,"uuid":"48be88c7-e96f-4a97-bc4f-ea9299b43231","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":165,"last_clean_end":466,"up_from":481,"up_thru":1415,"down_at":467,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6812","nonce":126173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6813","nonce":126173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6815","nonce":126173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.123:6814","nonce":126173}]},"public_addr":"172.21.2.123:6812/126173","cluster_addr":"172.21.2.123:6813/126173","heartbeat_back_addr":"172.21.2.123:6815/126173","heartbeat_front_addr":"172.21.2.123:6814/126173","state":["exists","up"]},{"osd":4,"uuid":"bcd6b6b5-b9d8-4f73-b064-8e5e36526451","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":558,"down_at":589,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6800","nonce":35246}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6801","nonce":35246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6803","nonce":35246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6802","nonce":35246}]},"public_addr":"172.21.2.134:6800/35246","cluster_addr":"172.21.2.134:6801/35246","heartbeat_back_addr":"172.21.2.134:6803/35246","heartbeat_front_addr":"172.21.2.134:6802/35246","state":["autoout","exists"]},{"osd":5,"uuid":"87c580eb-aad1-4614-b3a1-3f86f809cec9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":1415,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6808","nonce":35247}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6810","nonce":35247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6814","nonce":35247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6812","nonce":35247}]},"public_addr":"172.21.2.134:6808/35247","cluster_addr":"172.21.2.134:6810/35247","heartbeat_back_addr":"172.21.2.134:6814/35247","heartbeat_front_addr":"172.21.2.134:6812/35247","state":["exists","up"]},{"osd":6,"uuid":"b64e504f-cb05-4998-830d-c68581507f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":523,"last_clean_end":1414,"up_from":1415,"up_thru":1415,"down_at":1412,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6804","nonce":91477}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6816","nonce":1091477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6807","nonce":91477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6806","nonce":91477}]},"public_addr":"172.21.2.134:6804/91477","cluster_addr":"172.21.2.134:6816/1091477","heartbeat_back_addr":"172.21.2.134:6807/91477","heartbeat_front_addr":"172.21.2.134:6806/91477","state":["exists","up"]},{"osd":7,"uuid":"e76abef6-ed8b-49ee-abfd-a737ebd7a5b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":1415,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6809","nonce":35250}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6811","nonce":35250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6815","nonce":35250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.2.134:6813","nonce":35250}]},"public_addr":"172.21.2.134:6809/35250","cluster_addr":"172.21.2.134:6811/35250","heartbeat_back_addr":"172.21.2.134:6815/35250","heartbeat_front_addr":"172.21.2.134:6813/35250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-04-24T00:44:39.618631+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-04-24T00:44:30.297867+0000","dead_epoch":240},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-04-24T00:44:57.489993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-04-24T00:44:41.377780+0000","dead_epoch":467},{"osd":4,"down_stamp":"2021-04-23T13:12:40.753913+0000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":65536,"last_purged_snaps_scrub":"2021-04-23T13:12:02.393440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-04-24T00:44:37.077443+0000","dead_epoch":0},{"osd":6,"down_stamp":"2021-04-23T15:19:33.896002+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-04-24T00:44:39.247626+0000","dead_epoch":1413},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-04-24T00:44:39.482839+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"1.4","osds":[1,0]},{"pgid":"1.11","osds":[4,0]},{"pgid":"1.27","osds":[0,5]}],"pg_upmap_items":[{"pgid":"1.8","mappings":[{"from":5,"to":6}]},{"pgid":"1.39","mappings":[{"from":0,"to":6}]},{"pgid":"1.3b","mappings":[{"from":0,"to":6}]},{"pgid":"1.4e","mappings":[{"from":5,"to":2}]},{"pgid":"1.55","mappings":[{"from":5,"to":1}]},{"pgid":"2.0","mappings":[{"from":7,"to":5}]},{"pgid":"2.5","mappings":[{"from":7,"to":2}]},{"pgid":"2.18","mappings":[{"from":5,"to":2}]},{"pgid":"2.2a","mappings":[{"from":7,"to":2}]},{"pgid":"2.33","mappings":[{"from":7,"to":2}]},{"pgid":"2.3c","mappings":[{"from":7,"to":2}]},{"pgid":"2.3f","mappings":[{"from":7,"to":5}]},{"pgid":"2.42","mappings":[{"from":7,"to":2}]},{"pgid":"2.4b","mappings":[{"from":7,"to":2}]},{"pgid":"2.54","mappings":[{"from":1,"to":2}]},{"pgid":"2.57","mappings":[{"from":5,"to":2}]},{"pgid":"2.61","mappings":[{"from":7,"to":2}]},{"pgid":"2.64","mappings":[{"from":7,"to":2}]},{"pgid":"2.66","mappings":[{"from":5,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}'
2021-04-24T00:45:21.314 INFO:scrape:1 jobs: ['6068075']
2021-04-24T00:45:21.314 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-recovery}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/cache-snaps}']
2021-04-24T00:45:21.314 INFO:scrape:
2021-04-24T00:45:21.314 INFO:scrape:Dead: b'2021-04-24T00:45:21.271 DEBUG:teuthology.orchestra.run.gibba026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight'
2021-04-24T00:45:21.314 INFO:scrape:1 jobs: ['6068074']
2021-04-24T00:45:21.314 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/cache-snaps-balanced}']
2021-04-24T00:45:21.314 INFO:scrape: