2020-09-14T10:03:32.067 INFO:root:teuthology version: 1.0.0-55bd2dc
2020-09-14T10:03:32.069 INFO:teuthology.results:subset: '421/2057'
2020-09-14T10:03:32.069 INFO:teuthology.results:seed: '5113'
2020-09-14T10:07:35.982 INFO:root:teuthology version: 1.0.0-55bd2dc
2020-09-14T10:07:36.841 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-09-14T11:19:38.057 INFO:teuthology.results:Tests finished! gathering results...
2020-09-14T11:19:39.046 INFO:scrape:Found 9 jobs
2020-09-14T11:19:39.239 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 14.2.11-61-gca501b55415 (ca501b55415f428ec1655333dd49a7fcd76fdacc) nautilus (stable)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::string const&)+0xdd) [0x7f1fcaaa9184]
,  2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x521) [0x55e106cb60c1]

2020-09-14T11:19:39.258 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:14.719 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd primary-affinity 2 1
, set osd.2 primary-affinity to 1 (8655362)
, 2020-09-14T10:22:15.770 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 3 1

2020-09-14T11:19:39.258 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:36.971 INFO:teuthology.orchestra.run.smithi078.stdout:    ],
, 2020-09-14T10:22:36.971 INFO:teuthology.orchestra.run.smithi078.stdout:    "quorum_age": 80,
, 2020-09-14T10:22:36.971 INFO:teuthology.orchestra.run.smithi078.stdout:    "monmap": {

2020-09-14T11:19:39.259 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:36.985 INFO:teuthology.orchestra.run.smithi078.stdout:        "data_bytes": 1859584,
, 2020-09-14T10:22:36.985 INFO:teuthology.orchestra.run.smithi078.stdout:        "bytes_used": 1746571264,
, 2020-09-14T10:22:36.985 INFO:teuthology.orchestra.run.smithi078.stdout:        "bytes_avail": 765838749696,

2020-09-14T11:19:39.259 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.000 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 1,
, 2020-09-14T10:22:37.000 INFO:teuthology.orchestra.run.smithi078.stdout:                                "default_value": "",
, 2020-09-14T10:22:37.000 INFO:teuthology.orchestra.run.smithi078.stdout:                                "min": "",

2020-09-14T11:19:39.260 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.013 INFO:teuthology.orchestra.run.smithi078.stdout:                            "username": {
, 2020-09-14T10:22:37.013 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "username",
, 2020-09-14T10:22:37.014 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "str",

2020-09-14T11:19:39.260 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.027 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.",
, 2020-09-14T10:22:37.027 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],
, 2020-09-14T10:22:37.027 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []

2020-09-14T11:19:39.261 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.040 INFO:teuthology.orchestra.run.smithi078.stdout:                                "desc": "how frequently to wake up and attempt optimization",
, 2020-09-14T10:22:37.041 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",
, 2020-09-14T10:22:37.041 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],

2020-09-14T11:19:39.261 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.054 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []
, 2020-09-14T10:22:37.054 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.054 INFO:teuthology.orchestra.run.smithi078.stdout:                            "AUDIT_API_LOG_PAYLOAD": {

2020-09-14T11:19:39.262 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.067 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE",
, 2020-09-14T10:22:37.067 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "str",
, 2020-09-14T10:22:37.068 INFO:teuthology.orchestra.run.smithi078.stdout:                                "level": "advanced",

2020-09-14T11:19:39.262 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.081 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 0,
, 2020-09-14T10:22:37.081 INFO:teuthology.orchestra.run.smithi078.stdout:                                "default_value": "",
, 2020-09-14T10:22:37.081 INFO:teuthology.orchestra.run.smithi078.stdout:                                "min": "",

2020-09-14T11:19:39.263 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.094 INFO:teuthology.orchestra.run.smithi078.stdout:                                "max": "",
, 2020-09-14T10:22:37.094 INFO:teuthology.orchestra.run.smithi078.stdout:                                "enum_allowed": [],
, 2020-09-14T10:22:37.094 INFO:teuthology.orchestra.run.smithi078.stdout:                                "desc": "",

2020-09-14T11:19:39.263 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.107 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",
, 2020-09-14T10:22:37.108 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],
, 2020-09-14T10:22:37.108 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []

2020-09-14T11:19:39.264 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.121 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",
, 2020-09-14T10:22:37.121 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],
, 2020-09-14T10:22:37.121 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []

2020-09-14T11:19:39.264 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.134 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.134 INFO:teuthology.orchestra.run.smithi078.stdout:                            "mark_out_threshold": {
, 2020-09-14T10:22:37.134 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "mark_out_threshold",

2020-09-14T11:19:39.265 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.148 INFO:teuthology.orchestra.run.smithi078.stdout:                    {
, 2020-09-14T10:22:37.148 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "diskprediction_cloud",
, 2020-09-14T10:22:37.148 INFO:teuthology.orchestra.run.smithi078.stdout:                        "can_run": true,

2020-09-14T11:19:39.265 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.161 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []
, 2020-09-14T10:22:37.161 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.161 INFO:teuthology.orchestra.run.smithi078.stdout:                            "diskprediction_upload_metrics_interval": {

2020-09-14T11:19:39.265 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.174 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "batch_size",
, 2020-09-14T10:22:37.174 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "str",
, 2020-09-14T10:22:37.175 INFO:teuthology.orchestra.run.smithi078.stdout:                                "level": "advanced",

2020-09-14T11:19:39.266 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.188 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 0,
, 2020-09-14T10:22:37.188 INFO:teuthology.orchestra.run.smithi078.stdout:                                "default_value": "5",
, 2020-09-14T10:22:37.188 INFO:teuthology.orchestra.run.smithi078.stdout:                                "min": "",

2020-09-14T11:19:39.266 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.201 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "int",
, 2020-09-14T10:22:37.201 INFO:teuthology.orchestra.run.smithi078.stdout:                                "level": "advanced",
, 2020-09-14T10:22:37.201 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 1,

2020-09-14T11:19:39.267 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.214 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []
, 2020-09-14T10:22:37.214 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.215 INFO:teuthology.orchestra.run.smithi078.stdout:                            "persist_interval": {

2020-09-14T11:19:39.267 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.228 INFO:teuthology.orchestra.run.smithi078.stdout:                                "enum_allowed": [],
, 2020-09-14T10:22:37.228 INFO:teuthology.orchestra.run.smithi078.stdout:                                "desc": "",
, 2020-09-14T10:22:37.228 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",

2020-09-14T11:19:39.268 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.241 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.241 INFO:teuthology.orchestra.run.smithi078.stdout:                            "rwoption1": {
, 2020-09-14T10:22:37.241 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "rwoption1",

2020-09-14T11:19:39.268 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.262 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "str",
, 2020-09-14T10:22:37.262 INFO:teuthology.orchestra.run.smithi078.stdout:                                "level": "advanced",
, 2020-09-14T10:22:37.262 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 0,

2020-09-14T11:19:39.269 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.290 INFO:teuthology.orchestra.run.smithi078.stdout:                            }
, 2020-09-14T10:22:37.290 INFO:teuthology.orchestra.run.smithi078.stdout:                        }
, 2020-09-14T10:22:37.291 INFO:teuthology.orchestra.run.smithi078.stdout:                    },

2020-09-14T11:19:39.269 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.312 INFO:teuthology.orchestra.run.smithi078.stdout:                                "desc": "",
, 2020-09-14T10:22:37.312 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",
, 2020-09-14T10:22:37.312 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],

2020-09-14T11:19:39.269 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.325 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []
, 2020-09-14T10:22:37.325 INFO:teuthology.orchestra.run.smithi078.stdout:                            }
, 2020-09-14T10:22:37.326 INFO:teuthology.orchestra.run.smithi078.stdout:                        }

2020-09-14T11:19:39.270 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.341 INFO:teuthology.orchestra.run.smithi078.stdout:            {
, 2020-09-14T10:22:37.341 INFO:teuthology.orchestra.run.smithi078.stdout:                "name": "alerts",
, 2020-09-14T10:22:37.341 INFO:teuthology.orchestra.run.smithi078.stdout:                "can_run": true,

2020-09-14T11:19:39.270 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.354 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []
, 2020-09-14T10:22:37.354 INFO:teuthology.orchestra.run.smithi078.stdout:                    },
, 2020-09-14T10:22:37.355 INFO:teuthology.orchestra.run.smithi078.stdout:                    "smtp_ssl": {

2020-09-14T11:19:39.271 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.368 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "active",
, 2020-09-14T10:22:37.368 INFO:teuthology.orchestra.run.smithi078.stdout:                        "type": "bool",
, 2020-09-14T10:22:37.368 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",

2020-09-14T11:19:39.271 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.381 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 1,
, 2020-09-14T10:22:37.381 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "7",
, 2020-09-14T10:22:37.382 INFO:teuthology.orchestra.run.smithi078.stdout:                        "min": "0",

2020-09-14T11:19:39.272 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.395 INFO:teuthology.orchestra.run.smithi078.stdout:                "name": "crash",
, 2020-09-14T10:22:37.395 INFO:teuthology.orchestra.run.smithi078.stdout:                "can_run": true,
, 2020-09-14T10:22:37.395 INFO:teuthology.orchestra.run.smithi078.stdout:                "error_string": "",

2020-09-14T11:19:39.272 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.408 INFO:teuthology.orchestra.run.smithi078.stdout:                        "min": "",
, 2020-09-14T10:22:37.408 INFO:teuthology.orchestra.run.smithi078.stdout:                        "max": "",
, 2020-09-14T10:22:37.408 INFO:teuthology.orchestra.run.smithi078.stdout:                        "enum_allowed": [],

2020-09-14T11:19:39.272 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.422 INFO:teuthology.orchestra.run.smithi078.stdout:                        "desc": "",
, 2020-09-14T10:22:37.422 INFO:teuthology.orchestra.run.smithi078.stdout:                        "long_desc": "",
, 2020-09-14T10:22:37.422 INFO:teuthology.orchestra.run.smithi078.stdout:                        "tags": [],

2020-09-14T11:19:39.273 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.435 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []
, 2020-09-14T10:22:37.435 INFO:teuthology.orchestra.run.smithi078.stdout:                    },
, 2020-09-14T10:22:37.435 INFO:teuthology.orchestra.run.smithi078.stdout:                    "RGW_API_ADMIN_RESOURCE": {

2020-09-14T11:19:39.273 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.448 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "crt_file",
, 2020-09-14T10:22:37.448 INFO:teuthology.orchestra.run.smithi078.stdout:                        "type": "str",
, 2020-09-14T10:22:37.449 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",

2020-09-14T11:19:39.274 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.462 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.462 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "True",
, 2020-09-14T10:22:37.462 INFO:teuthology.orchestra.run.smithi078.stdout:                        "min": "",

2020-09-14T11:19:39.275 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.475 INFO:teuthology.orchestra.run.smithi078.stdout:                        "tags": [],
, 2020-09-14T10:22:37.475 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []
, 2020-09-14T10:22:37.475 INFO:teuthology.orchestra.run.smithi078.stdout:                    },

2020-09-14T11:19:39.275 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.488 INFO:teuthology.orchestra.run.smithi078.stdout:                        "max": "",
, 2020-09-14T10:22:37.488 INFO:teuthology.orchestra.run.smithi078.stdout:                        "enum_allowed": [],
, 2020-09-14T10:22:37.488 INFO:teuthology.orchestra.run.smithi078.stdout:                        "desc": "how long to retain device health metrics",

2020-09-14T11:19:39.276 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.501 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",
, 2020-09-14T10:22:37.502 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.502 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "",

2020-09-14T11:19:39.276 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.515 INFO:teuthology.orchestra.run.smithi078.stdout:                        "min": "",
, 2020-09-14T10:22:37.515 INFO:teuthology.orchestra.run.smithi078.stdout:                        "max": "",
, 2020-09-14T10:22:37.515 INFO:teuthology.orchestra.run.smithi078.stdout:                        "enum_allowed": [],

2020-09-14T11:19:39.276 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.528 INFO:teuthology.orchestra.run.smithi078.stdout:                        "desc": "",
, 2020-09-14T10:22:37.528 INFO:teuthology.orchestra.run.smithi078.stdout:                        "long_desc": "",
, 2020-09-14T10:22:37.528 INFO:teuthology.orchestra.run.smithi078.stdout:                        "tags": [],

2020-09-14T11:19:39.277 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.541 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []
, 2020-09-14T10:22:37.541 INFO:teuthology.orchestra.run.smithi078.stdout:                    }
, 2020-09-14T10:22:37.542 INFO:teuthology.orchestra.run.smithi078.stdout:                }

2020-09-14T11:19:39.277 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.555 INFO:teuthology.orchestra.run.smithi078.stdout:                        "long_desc": "",
, 2020-09-14T10:22:37.555 INFO:teuthology.orchestra.run.smithi078.stdout:                        "tags": [],
, 2020-09-14T10:22:37.555 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []

2020-09-14T11:19:39.278 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.568 INFO:teuthology.orchestra.run.smithi078.stdout:                    },
, 2020-09-14T10:22:37.568 INFO:teuthology.orchestra.run.smithi078.stdout:                    "rbd_stats_pools_refresh_interval": {
, 2020-09-14T10:22:37.568 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "rbd_stats_pools_refresh_interval",

2020-09-14T11:19:39.278 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.581 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",
, 2020-09-14T10:22:37.581 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.581 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "",

2020-09-14T11:19:39.279 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.594 INFO:teuthology.orchestra.run.smithi078.stdout:                        "max": "",
, 2020-09-14T10:22:37.594 INFO:teuthology.orchestra.run.smithi078.stdout:                        "enum_allowed": [],
, 2020-09-14T10:22:37.594 INFO:teuthology.orchestra.run.smithi078.stdout:                        "desc": "",

2020-09-14T11:19:39.279 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.607 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",
, 2020-09-14T10:22:37.607 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.608 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "",

2020-09-14T11:19:39.280 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.621 INFO:teuthology.orchestra.run.smithi078.stdout:                    "channel_device": {
, 2020-09-14T10:22:37.621 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "channel_device",
, 2020-09-14T10:22:37.621 INFO:teuthology.orchestra.run.smithi078.stdout:                        "type": "bool",

2020-09-14T11:19:39.280 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.634 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",
, 2020-09-14T10:22:37.634 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.634 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "1",

2020-09-14T11:19:39.281 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.647 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "interval",
, 2020-09-14T10:22:37.647 INFO:teuthology.orchestra.run.smithi078.stdout:                        "type": "secs",
, 2020-09-14T10:22:37.647 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",

2020-09-14T11:19:39.282 WARNING:scrape:Ignoring malparsed backtrace: Set osd_debug_deep_scrub_sleep to 0
, 2020-09-14T10:22:42.541 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd deep-scrub 1
, instructed osd(s) 1 to deep-scrub

2020-09-14T11:19:39.283 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:23:32.451 DEBUG:tasks.ceph.osd.0:waiting for process to exit
, 2020-09-14T10:23:32.452 INFO:teuthology.orchestra.run:waiting for 300
, 2020-09-14T10:23:32.469 INFO:tasks.ceph.osd.0:Stopped

2020-09-14T11:19:39.283 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:23:38.833 INFO:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/log/ceph -- .
, 2020-09-14T10:23:39.135 DEBUG:teuthology.run_tasks:Unwinding manager install
, 2020-09-14T10:23:39.146 ERROR:teuthology.contextutil:Saw exception from nested tasks

2020-09-14T11:19:39.284 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:23:58.683 DEBUG:teuthology.orchestra.run:got remote process result: 1
, 2020-09-14T10:23:58.683 ERROR:teuthology.run_tasks:Manager failed: internal.archive
, Traceback (most recent call last):

2020-09-14T11:19:39.309 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 14.2.11-61-gca501b55415 (ca501b55415f428ec1655333dd49a7fcd76fdacc) nautilus (stable)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::string const&)+0xdd) [0x7f1fcaaa9184]
,  2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x521) [0x55e106cb60c1]

2020-09-14T11:19:39.311 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:14.719 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd primary-affinity 2 1
, set osd.2 primary-affinity to 1 (8655362)
, 2020-09-14T10:22:15.770 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 3 1

2020-09-14T11:19:39.312 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:36.971 INFO:teuthology.orchestra.run.smithi078.stdout:    ],
, 2020-09-14T10:22:36.971 INFO:teuthology.orchestra.run.smithi078.stdout:    "quorum_age": 80,
, 2020-09-14T10:22:36.971 INFO:teuthology.orchestra.run.smithi078.stdout:    "monmap": {

2020-09-14T11:19:39.312 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:36.985 INFO:teuthology.orchestra.run.smithi078.stdout:        "data_bytes": 1859584,
, 2020-09-14T10:22:36.985 INFO:teuthology.orchestra.run.smithi078.stdout:        "bytes_used": 1746571264,
, 2020-09-14T10:22:36.985 INFO:teuthology.orchestra.run.smithi078.stdout:        "bytes_avail": 765838749696,

2020-09-14T11:19:39.312 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.000 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 1,
, 2020-09-14T10:22:37.000 INFO:teuthology.orchestra.run.smithi078.stdout:                                "default_value": "",
, 2020-09-14T10:22:37.000 INFO:teuthology.orchestra.run.smithi078.stdout:                                "min": "",

2020-09-14T11:19:39.313 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.013 INFO:teuthology.orchestra.run.smithi078.stdout:                            "username": {
, 2020-09-14T10:22:37.013 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "username",
, 2020-09-14T10:22:37.014 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "str",

2020-09-14T11:19:39.313 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.027 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.",
, 2020-09-14T10:22:37.027 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],
, 2020-09-14T10:22:37.027 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []

2020-09-14T11:19:39.314 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.040 INFO:teuthology.orchestra.run.smithi078.stdout:                                "desc": "how frequently to wake up and attempt optimization",
, 2020-09-14T10:22:37.041 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",
, 2020-09-14T10:22:37.041 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],

2020-09-14T11:19:39.314 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.054 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []
, 2020-09-14T10:22:37.054 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.054 INFO:teuthology.orchestra.run.smithi078.stdout:                            "AUDIT_API_LOG_PAYLOAD": {

2020-09-14T11:19:39.315 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.067 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE",
, 2020-09-14T10:22:37.067 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "str",
, 2020-09-14T10:22:37.068 INFO:teuthology.orchestra.run.smithi078.stdout:                                "level": "advanced",

2020-09-14T11:19:39.315 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.081 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 0,
, 2020-09-14T10:22:37.081 INFO:teuthology.orchestra.run.smithi078.stdout:                                "default_value": "",
, 2020-09-14T10:22:37.081 INFO:teuthology.orchestra.run.smithi078.stdout:                                "min": "",

2020-09-14T11:19:39.316 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.094 INFO:teuthology.orchestra.run.smithi078.stdout:                                "max": "",
, 2020-09-14T10:22:37.094 INFO:teuthology.orchestra.run.smithi078.stdout:                                "enum_allowed": [],
, 2020-09-14T10:22:37.094 INFO:teuthology.orchestra.run.smithi078.stdout:                                "desc": "",

2020-09-14T11:19:39.316 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.107 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",
, 2020-09-14T10:22:37.108 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],
, 2020-09-14T10:22:37.108 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []

2020-09-14T11:19:39.316 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.121 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",
, 2020-09-14T10:22:37.121 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],
, 2020-09-14T10:22:37.121 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []

2020-09-14T11:19:39.317 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.134 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.134 INFO:teuthology.orchestra.run.smithi078.stdout:                            "mark_out_threshold": {
, 2020-09-14T10:22:37.134 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "mark_out_threshold",

2020-09-14T11:19:39.317 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.148 INFO:teuthology.orchestra.run.smithi078.stdout:                    {
, 2020-09-14T10:22:37.148 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "diskprediction_cloud",
, 2020-09-14T10:22:37.148 INFO:teuthology.orchestra.run.smithi078.stdout:                        "can_run": true,

2020-09-14T11:19:39.318 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.161 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []
, 2020-09-14T10:22:37.161 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.161 INFO:teuthology.orchestra.run.smithi078.stdout:                            "diskprediction_upload_metrics_interval": {

2020-09-14T11:19:39.318 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.174 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "batch_size",
, 2020-09-14T10:22:37.174 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "str",
, 2020-09-14T10:22:37.175 INFO:teuthology.orchestra.run.smithi078.stdout:                                "level": "advanced",

2020-09-14T11:19:39.319 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.188 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 0,
, 2020-09-14T10:22:37.188 INFO:teuthology.orchestra.run.smithi078.stdout:                                "default_value": "5",
, 2020-09-14T10:22:37.188 INFO:teuthology.orchestra.run.smithi078.stdout:                                "min": "",

2020-09-14T11:19:39.319 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.201 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "int",
, 2020-09-14T10:22:37.201 INFO:teuthology.orchestra.run.smithi078.stdout:                                "level": "advanced",
, 2020-09-14T10:22:37.201 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 1,

2020-09-14T11:19:39.319 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.214 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []
, 2020-09-14T10:22:37.214 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.215 INFO:teuthology.orchestra.run.smithi078.stdout:                            "persist_interval": {

2020-09-14T11:19:39.320 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.228 INFO:teuthology.orchestra.run.smithi078.stdout:                                "enum_allowed": [],
, 2020-09-14T10:22:37.228 INFO:teuthology.orchestra.run.smithi078.stdout:                                "desc": "",
, 2020-09-14T10:22:37.228 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",

2020-09-14T11:19:39.320 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.241 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.241 INFO:teuthology.orchestra.run.smithi078.stdout:                            "rwoption1": {
, 2020-09-14T10:22:37.241 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "rwoption1",

2020-09-14T11:19:39.321 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.262 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "str",
, 2020-09-14T10:22:37.262 INFO:teuthology.orchestra.run.smithi078.stdout:                                "level": "advanced",
, 2020-09-14T10:22:37.262 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 0,

2020-09-14T11:19:39.321 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.290 INFO:teuthology.orchestra.run.smithi078.stdout:                            }
, 2020-09-14T10:22:37.290 INFO:teuthology.orchestra.run.smithi078.stdout:                        }
, 2020-09-14T10:22:37.291 INFO:teuthology.orchestra.run.smithi078.stdout:                    },

2020-09-14T11:19:39.322 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.312 INFO:teuthology.orchestra.run.smithi078.stdout:                                "desc": "",
, 2020-09-14T10:22:37.312 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",
, 2020-09-14T10:22:37.312 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],

2020-09-14T11:19:39.322 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.325 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []
, 2020-09-14T10:22:37.325 INFO:teuthology.orchestra.run.smithi078.stdout:                            }
, 2020-09-14T10:22:37.326 INFO:teuthology.orchestra.run.smithi078.stdout:                        }

2020-09-14T11:19:39.322 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.341 INFO:teuthology.orchestra.run.smithi078.stdout:            {
, 2020-09-14T10:22:37.341 INFO:teuthology.orchestra.run.smithi078.stdout:                "name": "alerts",
, 2020-09-14T10:22:37.341 INFO:teuthology.orchestra.run.smithi078.stdout:                "can_run": true,

2020-09-14T11:19:39.323 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.354 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []
, 2020-09-14T10:22:37.354 INFO:teuthology.orchestra.run.smithi078.stdout:                    },
, 2020-09-14T10:22:37.355 INFO:teuthology.orchestra.run.smithi078.stdout:                    "smtp_ssl": {

2020-09-14T11:19:39.323 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.368 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "active",
, 2020-09-14T10:22:37.368 INFO:teuthology.orchestra.run.smithi078.stdout:                        "type": "bool",
, 2020-09-14T10:22:37.368 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",

2020-09-14T11:19:39.324 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.381 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 1,
, 2020-09-14T10:22:37.381 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "7",
, 2020-09-14T10:22:37.382 INFO:teuthology.orchestra.run.smithi078.stdout:                        "min": "0",

2020-09-14T11:19:39.324 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.395 INFO:teuthology.orchestra.run.smithi078.stdout:                "name": "crash",
, 2020-09-14T10:22:37.395 INFO:teuthology.orchestra.run.smithi078.stdout:                "can_run": true,
, 2020-09-14T10:22:37.395 INFO:teuthology.orchestra.run.smithi078.stdout:                "error_string": "",

2020-09-14T11:19:39.325 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.408 INFO:teuthology.orchestra.run.smithi078.stdout:                        "min": "",
, 2020-09-14T10:22:37.408 INFO:teuthology.orchestra.run.smithi078.stdout:                        "max": "",
, 2020-09-14T10:22:37.408 INFO:teuthology.orchestra.run.smithi078.stdout:                        "enum_allowed": [],

2020-09-14T11:19:39.325 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.422 INFO:teuthology.orchestra.run.smithi078.stdout:                        "desc": "",
, 2020-09-14T10:22:37.422 INFO:teuthology.orchestra.run.smithi078.stdout:                        "long_desc": "",
, 2020-09-14T10:22:37.422 INFO:teuthology.orchestra.run.smithi078.stdout:                        "tags": [],

2020-09-14T11:19:39.325 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.435 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []
, 2020-09-14T10:22:37.435 INFO:teuthology.orchestra.run.smithi078.stdout:                    },
, 2020-09-14T10:22:37.435 INFO:teuthology.orchestra.run.smithi078.stdout:                    "RGW_API_ADMIN_RESOURCE": {

2020-09-14T11:19:39.326 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.448 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "crt_file",
, 2020-09-14T10:22:37.448 INFO:teuthology.orchestra.run.smithi078.stdout:                        "type": "str",
, 2020-09-14T10:22:37.449 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",

2020-09-14T11:19:39.326 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.462 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.462 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "True",
, 2020-09-14T10:22:37.462 INFO:teuthology.orchestra.run.smithi078.stdout:                        "min": "",

2020-09-14T11:19:39.327 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.475 INFO:teuthology.orchestra.run.smithi078.stdout:                        "tags": [],
, 2020-09-14T10:22:37.475 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []
, 2020-09-14T10:22:37.475 INFO:teuthology.orchestra.run.smithi078.stdout:                    },

2020-09-14T11:19:39.327 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.488 INFO:teuthology.orchestra.run.smithi078.stdout:                        "max": "",
, 2020-09-14T10:22:37.488 INFO:teuthology.orchestra.run.smithi078.stdout:                        "enum_allowed": [],
, 2020-09-14T10:22:37.488 INFO:teuthology.orchestra.run.smithi078.stdout:                        "desc": "how long to retain device health metrics",

2020-09-14T11:19:39.328 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.501 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",
, 2020-09-14T10:22:37.502 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.502 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "",

2020-09-14T11:19:39.328 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.515 INFO:teuthology.orchestra.run.smithi078.stdout:                        "min": "",
, 2020-09-14T10:22:37.515 INFO:teuthology.orchestra.run.smithi078.stdout:                        "max": "",
, 2020-09-14T10:22:37.515 INFO:teuthology.orchestra.run.smithi078.stdout:                        "enum_allowed": [],

2020-09-14T11:19:39.328 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.528 INFO:teuthology.orchestra.run.smithi078.stdout:                        "desc": "",
, 2020-09-14T10:22:37.528 INFO:teuthology.orchestra.run.smithi078.stdout:                        "long_desc": "",
, 2020-09-14T10:22:37.528 INFO:teuthology.orchestra.run.smithi078.stdout:                        "tags": [],

2020-09-14T11:19:39.329 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.541 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []
, 2020-09-14T10:22:37.541 INFO:teuthology.orchestra.run.smithi078.stdout:                    }
, 2020-09-14T10:22:37.542 INFO:teuthology.orchestra.run.smithi078.stdout:                }

2020-09-14T11:19:39.329 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.555 INFO:teuthology.orchestra.run.smithi078.stdout:                        "long_desc": "",
, 2020-09-14T10:22:37.555 INFO:teuthology.orchestra.run.smithi078.stdout:                        "tags": [],
, 2020-09-14T10:22:37.555 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []

2020-09-14T11:19:39.330 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.568 INFO:teuthology.orchestra.run.smithi078.stdout:                    },
, 2020-09-14T10:22:37.568 INFO:teuthology.orchestra.run.smithi078.stdout:                    "rbd_stats_pools_refresh_interval": {
, 2020-09-14T10:22:37.568 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "rbd_stats_pools_refresh_interval",

2020-09-14T11:19:39.330 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.581 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",
, 2020-09-14T10:22:37.581 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.581 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "",

2020-09-14T11:19:39.331 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.594 INFO:teuthology.orchestra.run.smithi078.stdout:                        "max": "",
, 2020-09-14T10:22:37.594 INFO:teuthology.orchestra.run.smithi078.stdout:                        "enum_allowed": [],
, 2020-09-14T10:22:37.594 INFO:teuthology.orchestra.run.smithi078.stdout:                        "desc": "",

2020-09-14T11:19:39.331 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.607 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",
, 2020-09-14T10:22:37.607 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.608 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "",

2020-09-14T11:19:39.331 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.621 INFO:teuthology.orchestra.run.smithi078.stdout:                    "channel_device": {
, 2020-09-14T10:22:37.621 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "channel_device",
, 2020-09-14T10:22:37.621 INFO:teuthology.orchestra.run.smithi078.stdout:                        "type": "bool",

2020-09-14T11:19:39.332 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.634 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",
, 2020-09-14T10:22:37.634 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.634 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "1",

2020-09-14T11:19:39.333 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.647 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "interval",
, 2020-09-14T10:22:37.647 INFO:teuthology.orchestra.run.smithi078.stdout:                        "type": "secs",
, 2020-09-14T10:22:37.647 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",

2020-09-14T11:19:39.334 WARNING:scrape:Ignoring malparsed backtrace: Set osd_debug_deep_scrub_sleep to 0
, 2020-09-14T10:22:42.541 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd deep-scrub 1
, instructed osd(s) 1 to deep-scrub

2020-09-14T11:19:39.335 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:23:32.451 DEBUG:tasks.ceph.osd.0:waiting for process to exit
, 2020-09-14T10:23:32.452 INFO:teuthology.orchestra.run:waiting for 300
, 2020-09-14T10:23:32.469 INFO:tasks.ceph.osd.0:Stopped

2020-09-14T11:19:39.335 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:23:38.833 INFO:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/log/ceph -- .
, 2020-09-14T10:23:39.135 DEBUG:teuthology.run_tasks:Unwinding manager install
, 2020-09-14T10:23:39.146 ERROR:teuthology.contextutil:Saw exception from nested tasks

2020-09-14T11:19:39.336 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:23:58.683 DEBUG:teuthology.orchestra.run:got remote process result: 1
, 2020-09-14T10:23:58.683 ERROR:teuthology.run_tasks:Manager failed: internal.archive
, Traceback (most recent call last):

2020-09-14T11:19:39.361 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 14.2.11-61-gca501b55415 (ca501b55415f428ec1655333dd49a7fcd76fdacc) nautilus (stable)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::string const&)+0xdd) [0x7f1fcaaa9184]
,  2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x521) [0x55e106cb60c1]

2020-09-14T11:19:39.363 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:14.719 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd primary-affinity 2 1
, set osd.2 primary-affinity to 1 (8655362)
, 2020-09-14T10:22:15.770 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 3 1

2020-09-14T11:19:39.363 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:36.971 INFO:teuthology.orchestra.run.smithi078.stdout:    ],
, 2020-09-14T10:22:36.971 INFO:teuthology.orchestra.run.smithi078.stdout:    "quorum_age": 80,
, 2020-09-14T10:22:36.971 INFO:teuthology.orchestra.run.smithi078.stdout:    "monmap": {

2020-09-14T11:19:39.364 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:36.985 INFO:teuthology.orchestra.run.smithi078.stdout:        "data_bytes": 1859584,
, 2020-09-14T10:22:36.985 INFO:teuthology.orchestra.run.smithi078.stdout:        "bytes_used": 1746571264,
, 2020-09-14T10:22:36.985 INFO:teuthology.orchestra.run.smithi078.stdout:        "bytes_avail": 765838749696,

2020-09-14T11:19:39.364 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.000 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 1,
, 2020-09-14T10:22:37.000 INFO:teuthology.orchestra.run.smithi078.stdout:                                "default_value": "",
, 2020-09-14T10:22:37.000 INFO:teuthology.orchestra.run.smithi078.stdout:                                "min": "",

2020-09-14T11:19:39.365 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.013 INFO:teuthology.orchestra.run.smithi078.stdout:                            "username": {
, 2020-09-14T10:22:37.013 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "username",
, 2020-09-14T10:22:37.014 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "str",

2020-09-14T11:19:39.365 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.027 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.",
, 2020-09-14T10:22:37.027 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],
, 2020-09-14T10:22:37.027 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []

2020-09-14T11:19:39.366 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.040 INFO:teuthology.orchestra.run.smithi078.stdout:                                "desc": "how frequently to wake up and attempt optimization",
, 2020-09-14T10:22:37.041 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",
, 2020-09-14T10:22:37.041 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],

2020-09-14T11:19:39.366 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.054 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []
, 2020-09-14T10:22:37.054 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.054 INFO:teuthology.orchestra.run.smithi078.stdout:                            "AUDIT_API_LOG_PAYLOAD": {

2020-09-14T11:19:39.366 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.067 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE",
, 2020-09-14T10:22:37.067 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "str",
, 2020-09-14T10:22:37.068 INFO:teuthology.orchestra.run.smithi078.stdout:                                "level": "advanced",

2020-09-14T11:19:39.367 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.081 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 0,
, 2020-09-14T10:22:37.081 INFO:teuthology.orchestra.run.smithi078.stdout:                                "default_value": "",
, 2020-09-14T10:22:37.081 INFO:teuthology.orchestra.run.smithi078.stdout:                                "min": "",

2020-09-14T11:19:39.367 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.094 INFO:teuthology.orchestra.run.smithi078.stdout:                                "max": "",
, 2020-09-14T10:22:37.094 INFO:teuthology.orchestra.run.smithi078.stdout:                                "enum_allowed": [],
, 2020-09-14T10:22:37.094 INFO:teuthology.orchestra.run.smithi078.stdout:                                "desc": "",

2020-09-14T11:19:39.368 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.107 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",
, 2020-09-14T10:22:37.108 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],
, 2020-09-14T10:22:37.108 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []

2020-09-14T11:19:39.368 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.121 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",
, 2020-09-14T10:22:37.121 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],
, 2020-09-14T10:22:37.121 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []

2020-09-14T11:19:39.369 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.134 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.134 INFO:teuthology.orchestra.run.smithi078.stdout:                            "mark_out_threshold": {
, 2020-09-14T10:22:37.134 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "mark_out_threshold",

2020-09-14T11:19:39.369 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.148 INFO:teuthology.orchestra.run.smithi078.stdout:                    {
, 2020-09-14T10:22:37.148 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "diskprediction_cloud",
, 2020-09-14T10:22:37.148 INFO:teuthology.orchestra.run.smithi078.stdout:                        "can_run": true,

2020-09-14T11:19:39.369 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.161 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []
, 2020-09-14T10:22:37.161 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.161 INFO:teuthology.orchestra.run.smithi078.stdout:                            "diskprediction_upload_metrics_interval": {

2020-09-14T11:19:39.370 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.174 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "batch_size",
, 2020-09-14T10:22:37.174 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "str",
, 2020-09-14T10:22:37.175 INFO:teuthology.orchestra.run.smithi078.stdout:                                "level": "advanced",

2020-09-14T11:19:39.370 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.188 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 0,
, 2020-09-14T10:22:37.188 INFO:teuthology.orchestra.run.smithi078.stdout:                                "default_value": "5",
, 2020-09-14T10:22:37.188 INFO:teuthology.orchestra.run.smithi078.stdout:                                "min": "",

2020-09-14T11:19:39.371 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.201 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "int",
, 2020-09-14T10:22:37.201 INFO:teuthology.orchestra.run.smithi078.stdout:                                "level": "advanced",
, 2020-09-14T10:22:37.201 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 1,

2020-09-14T11:19:39.371 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.214 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []
, 2020-09-14T10:22:37.214 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.215 INFO:teuthology.orchestra.run.smithi078.stdout:                            "persist_interval": {

2020-09-14T11:19:39.372 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.228 INFO:teuthology.orchestra.run.smithi078.stdout:                                "enum_allowed": [],
, 2020-09-14T10:22:37.228 INFO:teuthology.orchestra.run.smithi078.stdout:                                "desc": "",
, 2020-09-14T10:22:37.228 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",

2020-09-14T11:19:39.372 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.241 INFO:teuthology.orchestra.run.smithi078.stdout:                            },
, 2020-09-14T10:22:37.241 INFO:teuthology.orchestra.run.smithi078.stdout:                            "rwoption1": {
, 2020-09-14T10:22:37.241 INFO:teuthology.orchestra.run.smithi078.stdout:                                "name": "rwoption1",

2020-09-14T11:19:39.372 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.262 INFO:teuthology.orchestra.run.smithi078.stdout:                                "type": "str",
, 2020-09-14T10:22:37.262 INFO:teuthology.orchestra.run.smithi078.stdout:                                "level": "advanced",
, 2020-09-14T10:22:37.262 INFO:teuthology.orchestra.run.smithi078.stdout:                                "flags": 0,

2020-09-14T11:19:39.373 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.290 INFO:teuthology.orchestra.run.smithi078.stdout:                            }
, 2020-09-14T10:22:37.290 INFO:teuthology.orchestra.run.smithi078.stdout:                        }
, 2020-09-14T10:22:37.291 INFO:teuthology.orchestra.run.smithi078.stdout:                    },

2020-09-14T11:19:39.373 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.312 INFO:teuthology.orchestra.run.smithi078.stdout:                                "desc": "",
, 2020-09-14T10:22:37.312 INFO:teuthology.orchestra.run.smithi078.stdout:                                "long_desc": "",
, 2020-09-14T10:22:37.312 INFO:teuthology.orchestra.run.smithi078.stdout:                                "tags": [],

2020-09-14T11:19:39.374 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.325 INFO:teuthology.orchestra.run.smithi078.stdout:                                "see_also": []
, 2020-09-14T10:22:37.325 INFO:teuthology.orchestra.run.smithi078.stdout:                            }
, 2020-09-14T10:22:37.326 INFO:teuthology.orchestra.run.smithi078.stdout:                        }

2020-09-14T11:19:39.374 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.341 INFO:teuthology.orchestra.run.smithi078.stdout:            {
, 2020-09-14T10:22:37.341 INFO:teuthology.orchestra.run.smithi078.stdout:                "name": "alerts",
, 2020-09-14T10:22:37.341 INFO:teuthology.orchestra.run.smithi078.stdout:                "can_run": true,

2020-09-14T11:19:39.375 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.354 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []
, 2020-09-14T10:22:37.354 INFO:teuthology.orchestra.run.smithi078.stdout:                    },
, 2020-09-14T10:22:37.355 INFO:teuthology.orchestra.run.smithi078.stdout:                    "smtp_ssl": {

2020-09-14T11:19:39.375 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.368 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "active",
, 2020-09-14T10:22:37.368 INFO:teuthology.orchestra.run.smithi078.stdout:                        "type": "bool",
, 2020-09-14T10:22:37.368 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",

2020-09-14T11:19:39.375 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.381 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 1,
, 2020-09-14T10:22:37.381 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "7",
, 2020-09-14T10:22:37.382 INFO:teuthology.orchestra.run.smithi078.stdout:                        "min": "0",

2020-09-14T11:19:39.376 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.395 INFO:teuthology.orchestra.run.smithi078.stdout:                "name": "crash",
, 2020-09-14T10:22:37.395 INFO:teuthology.orchestra.run.smithi078.stdout:                "can_run": true,
, 2020-09-14T10:22:37.395 INFO:teuthology.orchestra.run.smithi078.stdout:                "error_string": "",

2020-09-14T11:19:39.376 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.408 INFO:teuthology.orchestra.run.smithi078.stdout:                        "min": "",
, 2020-09-14T10:22:37.408 INFO:teuthology.orchestra.run.smithi078.stdout:                        "max": "",
, 2020-09-14T10:22:37.408 INFO:teuthology.orchestra.run.smithi078.stdout:                        "enum_allowed": [],

2020-09-14T11:19:39.377 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.422 INFO:teuthology.orchestra.run.smithi078.stdout:                        "desc": "",
, 2020-09-14T10:22:37.422 INFO:teuthology.orchestra.run.smithi078.stdout:                        "long_desc": "",
, 2020-09-14T10:22:37.422 INFO:teuthology.orchestra.run.smithi078.stdout:                        "tags": [],

2020-09-14T11:19:39.377 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.435 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []
, 2020-09-14T10:22:37.435 INFO:teuthology.orchestra.run.smithi078.stdout:                    },
, 2020-09-14T10:22:37.435 INFO:teuthology.orchestra.run.smithi078.stdout:                    "RGW_API_ADMIN_RESOURCE": {

2020-09-14T11:19:39.378 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.448 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "crt_file",
, 2020-09-14T10:22:37.448 INFO:teuthology.orchestra.run.smithi078.stdout:                        "type": "str",
, 2020-09-14T10:22:37.449 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",

2020-09-14T11:19:39.378 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.462 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.462 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "True",
, 2020-09-14T10:22:37.462 INFO:teuthology.orchestra.run.smithi078.stdout:                        "min": "",

2020-09-14T11:19:39.378 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.475 INFO:teuthology.orchestra.run.smithi078.stdout:                        "tags": [],
, 2020-09-14T10:22:37.475 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []
, 2020-09-14T10:22:37.475 INFO:teuthology.orchestra.run.smithi078.stdout:                    },

2020-09-14T11:19:39.379 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.488 INFO:teuthology.orchestra.run.smithi078.stdout:                        "max": "",
, 2020-09-14T10:22:37.488 INFO:teuthology.orchestra.run.smithi078.stdout:                        "enum_allowed": [],
, 2020-09-14T10:22:37.488 INFO:teuthology.orchestra.run.smithi078.stdout:                        "desc": "how long to retain device health metrics",

2020-09-14T11:19:39.379 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.501 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",
, 2020-09-14T10:22:37.502 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.502 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "",

2020-09-14T11:19:39.380 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.515 INFO:teuthology.orchestra.run.smithi078.stdout:                        "min": "",
, 2020-09-14T10:22:37.515 INFO:teuthology.orchestra.run.smithi078.stdout:                        "max": "",
, 2020-09-14T10:22:37.515 INFO:teuthology.orchestra.run.smithi078.stdout:                        "enum_allowed": [],

2020-09-14T11:19:39.380 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.528 INFO:teuthology.orchestra.run.smithi078.stdout:                        "desc": "",
, 2020-09-14T10:22:37.528 INFO:teuthology.orchestra.run.smithi078.stdout:                        "long_desc": "",
, 2020-09-14T10:22:37.528 INFO:teuthology.orchestra.run.smithi078.stdout:                        "tags": [],

2020-09-14T11:19:39.381 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.541 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []
, 2020-09-14T10:22:37.541 INFO:teuthology.orchestra.run.smithi078.stdout:                    }
, 2020-09-14T10:22:37.542 INFO:teuthology.orchestra.run.smithi078.stdout:                }

2020-09-14T11:19:39.381 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.555 INFO:teuthology.orchestra.run.smithi078.stdout:                        "long_desc": "",
, 2020-09-14T10:22:37.555 INFO:teuthology.orchestra.run.smithi078.stdout:                        "tags": [],
, 2020-09-14T10:22:37.555 INFO:teuthology.orchestra.run.smithi078.stdout:                        "see_also": []

2020-09-14T11:19:39.381 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.568 INFO:teuthology.orchestra.run.smithi078.stdout:                    },
, 2020-09-14T10:22:37.568 INFO:teuthology.orchestra.run.smithi078.stdout:                    "rbd_stats_pools_refresh_interval": {
, 2020-09-14T10:22:37.568 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "rbd_stats_pools_refresh_interval",

2020-09-14T11:19:39.382 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.581 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",
, 2020-09-14T10:22:37.581 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.581 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "",

2020-09-14T11:19:39.382 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.594 INFO:teuthology.orchestra.run.smithi078.stdout:                        "max": "",
, 2020-09-14T10:22:37.594 INFO:teuthology.orchestra.run.smithi078.stdout:                        "enum_allowed": [],
, 2020-09-14T10:22:37.594 INFO:teuthology.orchestra.run.smithi078.stdout:                        "desc": "",

2020-09-14T11:19:39.383 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.607 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",
, 2020-09-14T10:22:37.607 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.608 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "",

2020-09-14T11:19:39.383 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.621 INFO:teuthology.orchestra.run.smithi078.stdout:                    "channel_device": {
, 2020-09-14T10:22:37.621 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "channel_device",
, 2020-09-14T10:22:37.621 INFO:teuthology.orchestra.run.smithi078.stdout:                        "type": "bool",

2020-09-14T11:19:39.384 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.634 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",
, 2020-09-14T10:22:37.634 INFO:teuthology.orchestra.run.smithi078.stdout:                        "flags": 0,
, 2020-09-14T10:22:37.634 INFO:teuthology.orchestra.run.smithi078.stdout:                        "default_value": "1",

2020-09-14T11:19:39.384 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:22:37.647 INFO:teuthology.orchestra.run.smithi078.stdout:                        "name": "interval",
, 2020-09-14T10:22:37.647 INFO:teuthology.orchestra.run.smithi078.stdout:                        "type": "secs",
, 2020-09-14T10:22:37.647 INFO:teuthology.orchestra.run.smithi078.stdout:                        "level": "advanced",

2020-09-14T11:19:39.386 WARNING:scrape:Ignoring malparsed backtrace: Set osd_debug_deep_scrub_sleep to 0
, 2020-09-14T10:22:42.541 INFO:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd deep-scrub 1
, instructed osd(s) 1 to deep-scrub

2020-09-14T11:19:39.386 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:23:32.451 DEBUG:tasks.ceph.osd.0:waiting for process to exit
, 2020-09-14T10:23:32.452 INFO:teuthology.orchestra.run:waiting for 300
, 2020-09-14T10:23:32.469 INFO:tasks.ceph.osd.0:Stopped

2020-09-14T11:19:39.387 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:23:38.833 INFO:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/log/ceph -- .
, 2020-09-14T10:23:39.135 DEBUG:teuthology.run_tasks:Unwinding manager install
, 2020-09-14T10:23:39.146 ERROR:teuthology.contextutil:Saw exception from nested tasks

2020-09-14T11:19:39.387 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-14T10:23:58.683 DEBUG:teuthology.orchestra.run:got remote process result: 1
, 2020-09-14T10:23:58.683 ERROR:teuthology.run_tasks:Manager failed: internal.archive
, Traceback (most recent call last):

2020-09-14T11:19:39.395 INFO:scrape:Found 1 distinct failure reasons
2020-09-14T11:19:39.396 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 50 --op write_excl 0 --op append_excl 50 --pool unique_pool_0'
2020-09-14T11:19:39.397 INFO:scrape:1 jobs: ['5434264']
2020-09-14T11:19:39.397 INFO:scrape:suites: ['clusters/{fixed-2.yaml', 'fast/normal.yaml', 'msgr-failures/osd-delay.yaml', 'objectstore/filestore-xfs.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash-erasure-code/{ceph.yaml', 'recovery-overrides/{default.yaml}', 'supported-random-distro$/{centos_latest.yaml}', 'thrashers/default.yaml', 'thrashosds-health.yaml', 'workloads/ec-small-objects-fast-read.yaml}']
2020-09-14T11:19:39.397 INFO:scrape: