2020-08-31T11:38:54.121 INFO:root:teuthology version: 1.0.0-018d708 2020-08-31T11:38:54.130 INFO:teuthology.results:subset: '27/2999' 2020-08-31T11:38:54.130 INFO:teuthology.results:seed: '773' 2020-09-01T18:12:07.127 INFO:root:teuthology version: 1.0.0-f1fe128 2020-09-01T18:12:07.226 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-09-01T23:06:22.204 INFO:teuthology.results:Tests finished! gathering results... 2020-09-01T23:07:38.485 INFO:scrape:Found 514 jobs 2020-09-01T23:07:41.490 WARNING:scrape:Ignoring malparsed backtrace: ceph version 14.2.11-99-gaf0268dc91 (af0268dc910f84b47655e83a83ca54b6fb92dbaf) nautilus (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x7f9e42176b3c] , 2: (CopyOp::_finish(TestOp::CallbackInfo*)+0x1c0) [0x55ff62d8bc80] 2020-09-01T23:07:41.491 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.288652", 2020-09-01T23:07:41.492 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.356 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.493 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.484354", , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.493 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "sub_op_commit_rec" , 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.396 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.494 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.506592", 2020-09-01T23:07:41.494 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.802461", , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" 2020-09-01T23:07:41.495 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.037345", , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.496 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.496 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.515 INFO:teuthology.orchestra.run.smithi058.stdout: "client": "client.4505", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 633 2020-09-01T23:07:41.497 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.224835", , 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:07.536 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.498 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.498 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.643343", 2020-09-01T23:07:41.499 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.604 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.633818", , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:41.500 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout:} 2020-09-01T23:07:41.500 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", , 2020-09-01T14:37:07.997 INFO:teuthology.orchestra.run.smithi058.stdout: "client_info": { 2020-09-01T23:07:41.501 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.023 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.747256", , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for peered" , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.501 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.070 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.502 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748752", 2020-09-01T23:07:41.503 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748827", , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:41.503 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.148 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.776856", , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.504 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.505 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.784217", 2020-09-01T23:07:41.505 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.751733", , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" 2020-09-01T23:07:41.506 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.790101", , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.507 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.256 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.507 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.277 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.812554", 2020-09-01T23:07:41.508 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.302 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.755045", , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" 2020-09-01T23:07:41.509 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.724 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.509 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.749 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.000402", 2020-09-01T23:07:41.510 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.986835", , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:41.510 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: ] 2020-09-01T23:07:41.511 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.270261", , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:41.512 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.830 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.497981", 2020-09-01T23:07:41.512 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.849 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:733 3.b 3:d93ca490:::smithi14112534-168:head [write 2303522~503247] snapc 0=[] ondisk+write+known_if_redirected e43)", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "initiated_at": "2020-09-01 14:36:09.506623", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "age": 59.168450086999997, 2020-09-01T23:07:41.513 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.507237", , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.514 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.888 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for rw locks" , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.514 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:18.359829", , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.515 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.934 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.516 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.745111", , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.516 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.517 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.517 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.326 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804094", 2020-09-01T23:07:41.518 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.368 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.750666", , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" 2020-09-01T23:07:41.519 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804723", , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.519 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "queued_for_pg" , 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.427 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.520 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.757709", 2020-09-01T23:07:41.520 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.475 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805080", , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" 2020-09-01T23:07:41.521 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805146", , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:41.522 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.528 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:1048 3.0 3.7401b340 (undecoded) ondisk+retry+write+known_if_redirected e79)", 2020-09-01T23:07:41.522 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.550 INFO:teuthology.orchestra.run.smithi058.stdout: "duration": 0.040257653999999997, , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", 2020-09-01T23:07:41.523 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 1098 , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.524 WARNING:scrape:Ignoring malparsed backtrace: mon.c: injectargs:mon_osd_down_out_interval = '600' (not observed, change may require restart) , 2020-09-01T14:37:15.607 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 0 1 , reweighted osd.0 to 1 (10000) 2020-09-01T23:07:41.526 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:37.198 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd last-stat-seq osd.7 , 2020-09-01T14:37:37.501 INFO:teuthology.orchestra.run.smithi141.stdout:55834574882 , 2020-09-01T14:37:37.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574882 for osd.7 2020-09-01T23:07:41.527 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: } , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: ] , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:41.527 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "smtp_host", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:41.528 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.646 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:41.529 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "250", , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "maximum number of iterations to attempt optimization", 2020-09-01T23:07:41.529 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.693 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:41.530 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.723 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:41.531 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.745 INFO:teuthology.orchestra.run.smithi141.stdout: "FEATURE_TOGGLE_rgw": { 2020-09-01T23:07:41.531 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ISCSI_API_SSL_VERIFICATION", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "bool", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:41.532 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.797 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "http", , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:41.533 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:41.533 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "599", , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:41.534 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "devicehealth", , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:41.535 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "warn_threshold": { , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "warn_threshold", 2020-09-01T23:07:41.535 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:41.536 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "600", , 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.935 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:41.536 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ssl", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:41.537 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: "num_rep": { , 2020-09-01T14:37:38.974 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "num_rep", 2020-09-01T23:07:41.538 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "progress", , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, 2020-09-01T23:07:41.539 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:41.539 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.031 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:41.540 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "testkey": { , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "testkey", 2020-09-01T23:07:41.540 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.071 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:41.541 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:41.542 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.109 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:41.542 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:41.543 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "SMTP port", , 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.149 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:41.543 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:41.544 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "end_time", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:41.545 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "upmap_max_iterations": { , 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "upmap_max_iterations", , 2020-09-01T14:37:39.213 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "uint", 2020-09-01T23:07:41.545 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "True", 2020-09-01T23:07:41.546 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.252 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:41.547 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.272 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:41.547 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "RGW_API_USER_ID": { 2020-09-01T23:07:41.548 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "server_port", , 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", , 2020-09-01T14:37:39.311 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:41.548 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "deepsea", 2020-09-01T23:07:41.549 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 1, , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "device_health_metrics", , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:41.550 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "diskprediction_default_authority": { , 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "diskprediction_default_authority", , 2020-09-01T14:37:39.370 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:41.550 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "43200", 2020-09-01T23:07:41.551 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.424 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:41.551 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:41.552 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "name prefix for any created local pool", 2020-09-01T23:07:41.553 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.485 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "prometheus", , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:41.553 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.509 INFO:teuthology.orchestra.run.smithi141.stdout: "key_file": { , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "key_file", , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:41.554 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.528 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:41.554 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:41.555 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:41.556 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "interval": { , 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "interval", , 2020-09-01T14:37:39.588 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", 2020-09-01T23:07:41.557 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "module_options": { , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "identifier": { 2020-09-01T23:07:41.559 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:40.005 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd dump --format=json , 2020-09-01T14:37:40.296 INFO:teuthology.orchestra.run.smithi141.stdout: , 2020-09-01T14:37:40.297 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":101,"fsid":"b01533b7-eb64-4c69-a77b-81afe14e6ec6","created":"2020-09-01 14:34:48.210564","modified":"2020-09-01 14:37:31.955273","last_up_change":"2020-09-01 14:37:05.711181","last_in_change":"2020-09-01 14:34:57.693154","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-09-01 14:35:01.816445","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":28,"pg_placement_num":28,"pg_placement_num_target":28,"pg_num_target":28,"pg_num_pending":28,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"74","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"low_tier","create_time":"2020-09-01 14:35:19.604696","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2020-09-01 14:35:20.557567","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":46,"pg_placement_num":46,"pg_placement_num_target":46,"pg_num_target":46,"pg_num_pending":46,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"59","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"ad2190ac-ef12-4852-bbe2-ef34cfc93f8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6810","nonce":9569}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6811","nonce":9569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6816","nonce":9569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6813","nonce":9569}]},"public_addr":"172.21.15.141:6810/9569","cluster_addr":"172.21.15.141:6811/9569","heartbeat_back_addr":"172.21.15.141:6816/9569","heartbeat_front_addr":"172.21.15.141:6813/9569","state":["exists","up"]},{"osd":1,"uuid":"c4175e28-bb35-4f38-abbe-3b0b6c71bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6805","nonce":9570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6806","nonce":9570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6808","nonce":9570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6807","nonce":9570}]},"public_addr":"172.21.15.141:6805/9570","cluster_addr":"172.21.15.141:6806/9570","heartbeat_back_addr":"172.21.15.141:6808/9570","heartbeat_front_addr":"172.21.15.141:6807/9570","state":["exists","up"]},{"osd":2,"uuid":"f143c687-c20f-42d8-beba-5624b0a40a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6809","nonce":9568}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6812","nonce":9568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6815","nonce":9568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6814","nonce":9568}]},"public_addr":"172.21.15.141:6809/9568","cluster_addr":"172.21.15.141:6812/9568","heartbeat_back_addr":"172.21.15.141:6815/9568","heartbeat_front_addr":"172.21.15.141:6814/9568","state":["exists","up"]},{"osd":3,"uuid":"ebf39121-d9db-4d23-9982-25531ed6b081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6801","nonce":9567}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6802","nonce":9567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6804","nonce":9567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6803","nonce":9567}]},"public_addr":"172.21.15.141:6801/9567","cluster_addr":"172.21.15.141:6802/9567","heartbeat_back_addr":"172.21.15.141:6804/9567","heartbeat_front_addr":"172.21.15.141:6803/9567","state":["exists","up"]},{"osd":4,"uuid":"0b327f3e-7dae-4356-aa2e-49f78d7a6810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6808","nonce":9744}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6810","nonce":9744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6813","nonce":9744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6812","nonce":9744}]},"public_addr":"172.21.15.58:6808/9744","cluster_addr":"172.21.15.58:6810/9744","heartbeat_back_addr":"172.21.15.58:6813/9744","heartbeat_front_addr":"172.21.15.58:6812/9744","state":["exists","up"]},{"osd":5,"uuid":"4f43aa54-96fe-468d-8957-28d797a0217d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":17,"up_from":79,"up_thru":80,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6804","nonce":12737}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6805","nonce":12737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6807","nonce":12737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6806","nonce":12737}]},"public_addr":"172.21.15.58:6804/12737","cluster_addr":"172.21.15.58:6805/12737","heartbeat_back_addr":"172.21.15.58:6807/12737","heartbeat_front_addr":"172.21.15.58:6806/12737","state":["exists","up"]},{"osd":6,"uuid":"81031507-bad8-4ecc-8fab-2cfd93f9d1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6809","nonce":9746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6811","nonce":9746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6815","nonce":9746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6814","nonce":9746}]},"public_addr":"172.21.15.58:6809/9746","cluster_addr":"172.21.15.58:6811/9746","heartbeat_back_addr":"172.21.15.58:6815/9746","heartbeat_front_addr":"172.21.15.58:6814/9746","state":["exists","up"]},{"osd":7,"uuid":"d421ee69-bd5a-4242-a37d-9df62e06d40d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6800","nonce":9747}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6801","nonce":9747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6803","nonce":9747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6802","nonce":9747}]},"public_addr":"172.21.15.58:6800/9747","cluster_addr":"172.21.15.58:6801/9747","heartbeat_back_addr":"172.21.15.58:6803/9747","heartbeat_front_addr":"172.21.15.58:6802/9747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":5,"down_stamp":"2020-09-01 14:35:20.110432","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0}],"pg_upmap":[{"pgid":"3.7","osds":[6,3]}],"pg_upmap_items":[{"pgid":"1.6","mappings":[{"from":6,"to":2}]}],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-09-01T23:07:41.562 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:45.950 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2020-09-01 14:37:15.958440 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 1.8 last_scrub_stamp 2020-09-01 14:37:05.369868 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=5, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2020-09-01 14:37:12.980647 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=12, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) 2020-09-01T23:07:41.562 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:38:27.671 DEBUG:tasks.ceph.osd.3:waiting for process to exit , 2020-09-01T14:38:27.672 INFO:teuthology.orchestra.run:waiting for 300 , 2020-09-01T14:38:27.733 INFO:tasks.ceph.osd.3:Stopped 2020-09-01T23:07:41.563 WARNING:scrape:Ignoring malparsed backtrace: suppress = manager.__exit__(*exc_info) , File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ , next(self.gen) 2020-09-01T23:07:41.714 WARNING:scrape:Ignoring malparsed backtrace: ceph version 14.2.11-99-gaf0268dc91 (af0268dc910f84b47655e83a83ca54b6fb92dbaf) nautilus (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x7f9e42176b3c] , 2: (CopyOp::_finish(TestOp::CallbackInfo*)+0x1c0) [0x55ff62d8bc80] 2020-09-01T23:07:41.716 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.288652", 2020-09-01T23:07:41.717 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.356 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.717 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.484354", , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.718 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "sub_op_commit_rec" , 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.396 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.719 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.506592", 2020-09-01T23:07:41.719 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.802461", , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" 2020-09-01T23:07:41.720 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.037345", , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.731 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.732 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.515 INFO:teuthology.orchestra.run.smithi058.stdout: "client": "client.4505", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 633 2020-09-01T23:07:41.732 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.224835", , 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:07.536 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.733 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.734 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.643343", 2020-09-01T23:07:41.734 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.604 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.633818", , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:41.735 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout:} 2020-09-01T23:07:41.735 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", , 2020-09-01T14:37:07.997 INFO:teuthology.orchestra.run.smithi058.stdout: "client_info": { 2020-09-01T23:07:41.736 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.023 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.747256", , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for peered" , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.737 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.070 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.737 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748752", 2020-09-01T23:07:41.738 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748827", , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:41.739 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.148 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.776856", , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.739 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.740 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.784217", 2020-09-01T23:07:41.740 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.751733", , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" 2020-09-01T23:07:41.750 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.790101", , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.751 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.256 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.752 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.277 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.812554", 2020-09-01T23:07:41.753 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.302 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.755045", , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" 2020-09-01T23:07:41.754 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.724 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.755 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.749 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.000402", 2020-09-01T23:07:41.755 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.986835", , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:41.756 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: ] 2020-09-01T23:07:41.756 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.270261", , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:41.757 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.830 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.497981", 2020-09-01T23:07:41.758 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.849 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:733 3.b 3:d93ca490:::smithi14112534-168:head [write 2303522~503247] snapc 0=[] ondisk+write+known_if_redirected e43)", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "initiated_at": "2020-09-01 14:36:09.506623", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "age": 59.168450086999997, 2020-09-01T23:07:41.762 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.507237", , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.763 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.888 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for rw locks" , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.764 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:18.359829", , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.764 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.934 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.765 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.745111", , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.766 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.766 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.767 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.326 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804094", 2020-09-01T23:07:41.767 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.368 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.750666", , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" 2020-09-01T23:07:41.768 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804723", , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.769 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "queued_for_pg" , 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.427 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.769 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.757709", 2020-09-01T23:07:41.770 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.475 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805080", , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" 2020-09-01T23:07:41.771 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805146", , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:41.771 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.528 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:1048 3.0 3.7401b340 (undecoded) ondisk+retry+write+known_if_redirected e79)", 2020-09-01T23:07:41.772 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.550 INFO:teuthology.orchestra.run.smithi058.stdout: "duration": 0.040257653999999997, , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", 2020-09-01T23:07:41.773 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 1098 , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.774 WARNING:scrape:Ignoring malparsed backtrace: mon.c: injectargs:mon_osd_down_out_interval = '600' (not observed, change may require restart) , 2020-09-01T14:37:15.607 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 0 1 , reweighted osd.0 to 1 (10000) 2020-09-01T23:07:41.776 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:37.198 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd last-stat-seq osd.7 , 2020-09-01T14:37:37.501 INFO:teuthology.orchestra.run.smithi141.stdout:55834574882 , 2020-09-01T14:37:37.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574882 for osd.7 2020-09-01T23:07:41.777 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: } , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: ] , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:41.777 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "smtp_host", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:41.778 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.646 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:41.779 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "250", , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "maximum number of iterations to attempt optimization", 2020-09-01T23:07:41.779 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.693 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:41.780 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.723 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:41.781 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.745 INFO:teuthology.orchestra.run.smithi141.stdout: "FEATURE_TOGGLE_rgw": { 2020-09-01T23:07:41.781 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ISCSI_API_SSL_VERIFICATION", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "bool", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:41.782 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.797 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "http", , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:41.782 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:41.783 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "599", , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:41.784 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "devicehealth", , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:41.785 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "warn_threshold": { , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "warn_threshold", 2020-09-01T23:07:41.785 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:41.786 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "600", , 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.935 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:41.787 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ssl", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:41.787 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: "num_rep": { , 2020-09-01T14:37:38.974 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "num_rep", 2020-09-01T23:07:41.788 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "progress", , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, 2020-09-01T23:07:41.790 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:41.791 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.031 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:41.792 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "testkey": { , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "testkey", 2020-09-01T23:07:41.793 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.071 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:41.794 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:41.794 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.109 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:41.795 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:41.796 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "SMTP port", , 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.149 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:41.797 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:41.798 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "end_time", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:41.798 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "upmap_max_iterations": { , 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "upmap_max_iterations", , 2020-09-01T14:37:39.213 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "uint", 2020-09-01T23:07:41.799 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "True", 2020-09-01T23:07:41.800 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.252 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:41.800 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.272 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:41.801 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "RGW_API_USER_ID": { 2020-09-01T23:07:41.802 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "server_port", , 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", , 2020-09-01T14:37:39.311 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:41.803 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "deepsea", 2020-09-01T23:07:41.803 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 1, , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "device_health_metrics", , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:41.804 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "diskprediction_default_authority": { , 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "diskprediction_default_authority", , 2020-09-01T14:37:39.370 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:41.805 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "43200", 2020-09-01T23:07:41.806 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.424 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:41.807 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:41.808 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "name prefix for any created local pool", 2020-09-01T23:07:41.809 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.485 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "prometheus", , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:41.810 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.509 INFO:teuthology.orchestra.run.smithi141.stdout: "key_file": { , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "key_file", , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:41.810 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.528 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:41.811 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:41.812 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:41.813 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "interval": { , 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "interval", , 2020-09-01T14:37:39.588 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", 2020-09-01T23:07:41.814 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "module_options": { , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "identifier": { 2020-09-01T23:07:41.817 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:40.005 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd dump --format=json , 2020-09-01T14:37:40.296 INFO:teuthology.orchestra.run.smithi141.stdout: , 2020-09-01T14:37:40.297 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":101,"fsid":"b01533b7-eb64-4c69-a77b-81afe14e6ec6","created":"2020-09-01 14:34:48.210564","modified":"2020-09-01 14:37:31.955273","last_up_change":"2020-09-01 14:37:05.711181","last_in_change":"2020-09-01 14:34:57.693154","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-09-01 14:35:01.816445","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":28,"pg_placement_num":28,"pg_placement_num_target":28,"pg_num_target":28,"pg_num_pending":28,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"74","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"low_tier","create_time":"2020-09-01 14:35:19.604696","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2020-09-01 14:35:20.557567","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":46,"pg_placement_num":46,"pg_placement_num_target":46,"pg_num_target":46,"pg_num_pending":46,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"59","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"ad2190ac-ef12-4852-bbe2-ef34cfc93f8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6810","nonce":9569}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6811","nonce":9569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6816","nonce":9569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6813","nonce":9569}]},"public_addr":"172.21.15.141:6810/9569","cluster_addr":"172.21.15.141:6811/9569","heartbeat_back_addr":"172.21.15.141:6816/9569","heartbeat_front_addr":"172.21.15.141:6813/9569","state":["exists","up"]},{"osd":1,"uuid":"c4175e28-bb35-4f38-abbe-3b0b6c71bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6805","nonce":9570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6806","nonce":9570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6808","nonce":9570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6807","nonce":9570}]},"public_addr":"172.21.15.141:6805/9570","cluster_addr":"172.21.15.141:6806/9570","heartbeat_back_addr":"172.21.15.141:6808/9570","heartbeat_front_addr":"172.21.15.141:6807/9570","state":["exists","up"]},{"osd":2,"uuid":"f143c687-c20f-42d8-beba-5624b0a40a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6809","nonce":9568}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6812","nonce":9568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6815","nonce":9568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6814","nonce":9568}]},"public_addr":"172.21.15.141:6809/9568","cluster_addr":"172.21.15.141:6812/9568","heartbeat_back_addr":"172.21.15.141:6815/9568","heartbeat_front_addr":"172.21.15.141:6814/9568","state":["exists","up"]},{"osd":3,"uuid":"ebf39121-d9db-4d23-9982-25531ed6b081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6801","nonce":9567}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6802","nonce":9567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6804","nonce":9567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6803","nonce":9567}]},"public_addr":"172.21.15.141:6801/9567","cluster_addr":"172.21.15.141:6802/9567","heartbeat_back_addr":"172.21.15.141:6804/9567","heartbeat_front_addr":"172.21.15.141:6803/9567","state":["exists","up"]},{"osd":4,"uuid":"0b327f3e-7dae-4356-aa2e-49f78d7a6810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6808","nonce":9744}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6810","nonce":9744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6813","nonce":9744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6812","nonce":9744}]},"public_addr":"172.21.15.58:6808/9744","cluster_addr":"172.21.15.58:6810/9744","heartbeat_back_addr":"172.21.15.58:6813/9744","heartbeat_front_addr":"172.21.15.58:6812/9744","state":["exists","up"]},{"osd":5,"uuid":"4f43aa54-96fe-468d-8957-28d797a0217d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":17,"up_from":79,"up_thru":80,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6804","nonce":12737}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6805","nonce":12737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6807","nonce":12737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6806","nonce":12737}]},"public_addr":"172.21.15.58:6804/12737","cluster_addr":"172.21.15.58:6805/12737","heartbeat_back_addr":"172.21.15.58:6807/12737","heartbeat_front_addr":"172.21.15.58:6806/12737","state":["exists","up"]},{"osd":6,"uuid":"81031507-bad8-4ecc-8fab-2cfd93f9d1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6809","nonce":9746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6811","nonce":9746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6815","nonce":9746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6814","nonce":9746}]},"public_addr":"172.21.15.58:6809/9746","cluster_addr":"172.21.15.58:6811/9746","heartbeat_back_addr":"172.21.15.58:6815/9746","heartbeat_front_addr":"172.21.15.58:6814/9746","state":["exists","up"]},{"osd":7,"uuid":"d421ee69-bd5a-4242-a37d-9df62e06d40d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6800","nonce":9747}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6801","nonce":9747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6803","nonce":9747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6802","nonce":9747}]},"public_addr":"172.21.15.58:6800/9747","cluster_addr":"172.21.15.58:6801/9747","heartbeat_back_addr":"172.21.15.58:6803/9747","heartbeat_front_addr":"172.21.15.58:6802/9747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":5,"down_stamp":"2020-09-01 14:35:20.110432","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0}],"pg_upmap":[{"pgid":"3.7","osds":[6,3]}],"pg_upmap_items":[{"pgid":"1.6","mappings":[{"from":6,"to":2}]}],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-09-01T23:07:41.821 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:45.950 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2020-09-01 14:37:15.958440 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 1.8 last_scrub_stamp 2020-09-01 14:37:05.369868 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=5, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2020-09-01 14:37:12.980647 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=12, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) 2020-09-01T23:07:41.822 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:38:27.671 DEBUG:tasks.ceph.osd.3:waiting for process to exit , 2020-09-01T14:38:27.672 INFO:teuthology.orchestra.run:waiting for 300 , 2020-09-01T14:38:27.733 INFO:tasks.ceph.osd.3:Stopped 2020-09-01T23:07:41.823 WARNING:scrape:Ignoring malparsed backtrace: suppress = manager.__exit__(*exc_info) , File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ , next(self.gen) 2020-09-01T23:07:41.990 WARNING:scrape:Ignoring malparsed backtrace: ceph version 14.2.11-99-gaf0268dc91 (af0268dc910f84b47655e83a83ca54b6fb92dbaf) nautilus (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x7f9e42176b3c] , 2: (CopyOp::_finish(TestOp::CallbackInfo*)+0x1c0) [0x55ff62d8bc80] 2020-09-01T23:07:41.992 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.288652", 2020-09-01T23:07:41.993 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.356 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.994 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.484354", , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.994 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "sub_op_commit_rec" , 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.396 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.995 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.506592", 2020-09-01T23:07:41.996 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.802461", , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" 2020-09-01T23:07:41.997 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.037345", , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.997 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:41.998 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.515 INFO:teuthology.orchestra.run.smithi058.stdout: "client": "client.4505", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 633 2020-09-01T23:07:41.999 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.224835", , 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:07.536 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:41.999 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.000 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.643343", 2020-09-01T23:07:42.001 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.604 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.633818", , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:42.001 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout:} 2020-09-01T23:07:42.002 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", , 2020-09-01T14:37:07.997 INFO:teuthology.orchestra.run.smithi058.stdout: "client_info": { 2020-09-01T23:07:42.003 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.023 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.747256", , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for peered" , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.005 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.070 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.006 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748752", 2020-09-01T23:07:42.006 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748827", , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:42.007 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.148 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.776856", , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.008 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.008 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.784217", 2020-09-01T23:07:42.009 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.751733", , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" 2020-09-01T23:07:42.010 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.790101", , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.010 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.256 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.011 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.277 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.812554", 2020-09-01T23:07:42.011 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.302 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.755045", , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" 2020-09-01T23:07:42.012 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.724 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.013 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.749 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.000402", 2020-09-01T23:07:42.013 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.986835", , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:42.014 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: ] 2020-09-01T23:07:42.015 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.270261", , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:42.016 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.830 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.497981", 2020-09-01T23:07:42.017 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.849 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:733 3.b 3:d93ca490:::smithi14112534-168:head [write 2303522~503247] snapc 0=[] ondisk+write+known_if_redirected e43)", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "initiated_at": "2020-09-01 14:36:09.506623", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "age": 59.168450086999997, 2020-09-01T23:07:42.017 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.507237", , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.018 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.888 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for rw locks" , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.019 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:18.359829", , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.020 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.934 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.020 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.745111", , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.021 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.024 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.027 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.326 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804094", 2020-09-01T23:07:42.028 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.368 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.750666", , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" 2020-09-01T23:07:42.028 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804723", , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.029 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "queued_for_pg" , 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.427 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.030 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.757709", 2020-09-01T23:07:42.030 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.475 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805080", , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" 2020-09-01T23:07:42.031 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805146", , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:42.032 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.528 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:1048 3.0 3.7401b340 (undecoded) ondisk+retry+write+known_if_redirected e79)", 2020-09-01T23:07:42.032 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.550 INFO:teuthology.orchestra.run.smithi058.stdout: "duration": 0.040257653999999997, , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", 2020-09-01T23:07:42.033 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 1098 , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.034 WARNING:scrape:Ignoring malparsed backtrace: mon.c: injectargs:mon_osd_down_out_interval = '600' (not observed, change may require restart) , 2020-09-01T14:37:15.607 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 0 1 , reweighted osd.0 to 1 (10000) 2020-09-01T23:07:42.036 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:37.198 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd last-stat-seq osd.7 , 2020-09-01T14:37:37.501 INFO:teuthology.orchestra.run.smithi141.stdout:55834574882 , 2020-09-01T14:37:37.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574882 for osd.7 2020-09-01T23:07:42.038 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: } , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: ] , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:42.038 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "smtp_host", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.039 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.646 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:42.039 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "250", , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "maximum number of iterations to attempt optimization", 2020-09-01T23:07:42.040 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.693 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.041 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.723 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.045 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.745 INFO:teuthology.orchestra.run.smithi141.stdout: "FEATURE_TOGGLE_rgw": { 2020-09-01T23:07:42.045 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ISCSI_API_SSL_VERIFICATION", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "bool", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.046 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.797 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "http", , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:42.047 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.047 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "599", , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.048 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "devicehealth", , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:42.049 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "warn_threshold": { , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "warn_threshold", 2020-09-01T23:07:42.049 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.050 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "600", , 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.935 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:42.051 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ssl", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.051 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: "num_rep": { , 2020-09-01T14:37:38.974 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "num_rep", 2020-09-01T23:07:42.052 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "progress", , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, 2020-09-01T23:07:42.053 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:42.053 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.031 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:42.054 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "testkey": { , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "testkey", 2020-09-01T23:07:42.055 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.071 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:42.056 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.056 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.109 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.057 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.058 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "SMTP port", , 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.149 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.058 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:42.061 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "end_time", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.065 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "upmap_max_iterations": { , 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "upmap_max_iterations", , 2020-09-01T14:37:39.213 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "uint", 2020-09-01T23:07:42.066 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "True", 2020-09-01T23:07:42.066 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.252 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.067 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.272 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.067 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "RGW_API_USER_ID": { 2020-09-01T23:07:42.068 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "server_port", , 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", , 2020-09-01T14:37:39.311 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.069 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "deepsea", 2020-09-01T23:07:42.070 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 1, , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "device_health_metrics", , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:42.070 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "diskprediction_default_authority": { , 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "diskprediction_default_authority", , 2020-09-01T14:37:39.370 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:42.071 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "43200", 2020-09-01T23:07:42.072 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.424 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.072 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.073 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "name prefix for any created local pool", 2020-09-01T23:07:42.073 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.485 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "prometheus", , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:42.074 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.509 INFO:teuthology.orchestra.run.smithi141.stdout: "key_file": { , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "key_file", , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:42.075 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.528 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:42.075 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.076 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:42.076 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "interval": { , 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "interval", , 2020-09-01T14:37:39.588 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", 2020-09-01T23:07:42.077 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "module_options": { , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "identifier": { 2020-09-01T23:07:42.080 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:40.005 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd dump --format=json , 2020-09-01T14:37:40.296 INFO:teuthology.orchestra.run.smithi141.stdout: , 2020-09-01T14:37:40.297 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":101,"fsid":"b01533b7-eb64-4c69-a77b-81afe14e6ec6","created":"2020-09-01 14:34:48.210564","modified":"2020-09-01 14:37:31.955273","last_up_change":"2020-09-01 14:37:05.711181","last_in_change":"2020-09-01 14:34:57.693154","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-09-01 14:35:01.816445","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":28,"pg_placement_num":28,"pg_placement_num_target":28,"pg_num_target":28,"pg_num_pending":28,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"74","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"low_tier","create_time":"2020-09-01 14:35:19.604696","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2020-09-01 14:35:20.557567","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":46,"pg_placement_num":46,"pg_placement_num_target":46,"pg_num_target":46,"pg_num_pending":46,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"59","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"ad2190ac-ef12-4852-bbe2-ef34cfc93f8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6810","nonce":9569}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6811","nonce":9569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6816","nonce":9569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6813","nonce":9569}]},"public_addr":"172.21.15.141:6810/9569","cluster_addr":"172.21.15.141:6811/9569","heartbeat_back_addr":"172.21.15.141:6816/9569","heartbeat_front_addr":"172.21.15.141:6813/9569","state":["exists","up"]},{"osd":1,"uuid":"c4175e28-bb35-4f38-abbe-3b0b6c71bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6805","nonce":9570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6806","nonce":9570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6808","nonce":9570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6807","nonce":9570}]},"public_addr":"172.21.15.141:6805/9570","cluster_addr":"172.21.15.141:6806/9570","heartbeat_back_addr":"172.21.15.141:6808/9570","heartbeat_front_addr":"172.21.15.141:6807/9570","state":["exists","up"]},{"osd":2,"uuid":"f143c687-c20f-42d8-beba-5624b0a40a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6809","nonce":9568}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6812","nonce":9568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6815","nonce":9568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6814","nonce":9568}]},"public_addr":"172.21.15.141:6809/9568","cluster_addr":"172.21.15.141:6812/9568","heartbeat_back_addr":"172.21.15.141:6815/9568","heartbeat_front_addr":"172.21.15.141:6814/9568","state":["exists","up"]},{"osd":3,"uuid":"ebf39121-d9db-4d23-9982-25531ed6b081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6801","nonce":9567}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6802","nonce":9567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6804","nonce":9567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6803","nonce":9567}]},"public_addr":"172.21.15.141:6801/9567","cluster_addr":"172.21.15.141:6802/9567","heartbeat_back_addr":"172.21.15.141:6804/9567","heartbeat_front_addr":"172.21.15.141:6803/9567","state":["exists","up"]},{"osd":4,"uuid":"0b327f3e-7dae-4356-aa2e-49f78d7a6810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6808","nonce":9744}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6810","nonce":9744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6813","nonce":9744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6812","nonce":9744}]},"public_addr":"172.21.15.58:6808/9744","cluster_addr":"172.21.15.58:6810/9744","heartbeat_back_addr":"172.21.15.58:6813/9744","heartbeat_front_addr":"172.21.15.58:6812/9744","state":["exists","up"]},{"osd":5,"uuid":"4f43aa54-96fe-468d-8957-28d797a0217d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":17,"up_from":79,"up_thru":80,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6804","nonce":12737}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6805","nonce":12737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6807","nonce":12737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6806","nonce":12737}]},"public_addr":"172.21.15.58:6804/12737","cluster_addr":"172.21.15.58:6805/12737","heartbeat_back_addr":"172.21.15.58:6807/12737","heartbeat_front_addr":"172.21.15.58:6806/12737","state":["exists","up"]},{"osd":6,"uuid":"81031507-bad8-4ecc-8fab-2cfd93f9d1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6809","nonce":9746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6811","nonce":9746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6815","nonce":9746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6814","nonce":9746}]},"public_addr":"172.21.15.58:6809/9746","cluster_addr":"172.21.15.58:6811/9746","heartbeat_back_addr":"172.21.15.58:6815/9746","heartbeat_front_addr":"172.21.15.58:6814/9746","state":["exists","up"]},{"osd":7,"uuid":"d421ee69-bd5a-4242-a37d-9df62e06d40d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6800","nonce":9747}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6801","nonce":9747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6803","nonce":9747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6802","nonce":9747}]},"public_addr":"172.21.15.58:6800/9747","cluster_addr":"172.21.15.58:6801/9747","heartbeat_back_addr":"172.21.15.58:6803/9747","heartbeat_front_addr":"172.21.15.58:6802/9747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":5,"down_stamp":"2020-09-01 14:35:20.110432","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0}],"pg_upmap":[{"pgid":"3.7","osds":[6,3]}],"pg_upmap_items":[{"pgid":"1.6","mappings":[{"from":6,"to":2}]}],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-09-01T23:07:42.084 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:45.950 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2020-09-01 14:37:15.958440 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 1.8 last_scrub_stamp 2020-09-01 14:37:05.369868 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=5, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2020-09-01 14:37:12.980647 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=12, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) 2020-09-01T23:07:42.085 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:38:27.671 DEBUG:tasks.ceph.osd.3:waiting for process to exit , 2020-09-01T14:38:27.672 INFO:teuthology.orchestra.run:waiting for 300 , 2020-09-01T14:38:27.733 INFO:tasks.ceph.osd.3:Stopped 2020-09-01T23:07:42.086 WARNING:scrape:Ignoring malparsed backtrace: suppress = manager.__exit__(*exc_info) , File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ , next(self.gen) 2020-09-01T23:07:42.229 WARNING:scrape:Ignoring malparsed backtrace: ceph version 14.2.11-99-gaf0268dc91 (af0268dc910f84b47655e83a83ca54b6fb92dbaf) nautilus (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x7f9e42176b3c] , 2: (CopyOp::_finish(TestOp::CallbackInfo*)+0x1c0) [0x55ff62d8bc80] 2020-09-01T23:07:42.230 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.288652", 2020-09-01T23:07:42.231 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.356 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.232 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.484354", , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.232 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "sub_op_commit_rec" , 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.396 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.233 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.506592", 2020-09-01T23:07:42.234 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.802461", , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" 2020-09-01T23:07:42.234 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.037345", , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.235 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.235 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.515 INFO:teuthology.orchestra.run.smithi058.stdout: "client": "client.4505", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 633 2020-09-01T23:07:42.236 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.224835", , 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:07.536 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.238 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.239 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.643343", 2020-09-01T23:07:42.240 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.604 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.633818", , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:42.240 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout:} 2020-09-01T23:07:42.241 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", , 2020-09-01T14:37:07.997 INFO:teuthology.orchestra.run.smithi058.stdout: "client_info": { 2020-09-01T23:07:42.242 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.023 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.747256", , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for peered" , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.242 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.070 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.243 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748752", 2020-09-01T23:07:42.243 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748827", , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:42.244 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.148 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.776856", , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.245 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.245 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.784217", 2020-09-01T23:07:42.247 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.751733", , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" 2020-09-01T23:07:42.248 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.790101", , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.248 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.256 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.249 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.277 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.812554", 2020-09-01T23:07:42.250 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.302 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.755045", , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" 2020-09-01T23:07:42.250 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.724 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.251 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.749 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.000402", 2020-09-01T23:07:42.252 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.986835", , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:42.253 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: ] 2020-09-01T23:07:42.254 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.270261", , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:42.254 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.830 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.497981", 2020-09-01T23:07:42.255 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.849 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:733 3.b 3:d93ca490:::smithi14112534-168:head [write 2303522~503247] snapc 0=[] ondisk+write+known_if_redirected e43)", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "initiated_at": "2020-09-01 14:36:09.506623", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "age": 59.168450086999997, 2020-09-01T23:07:42.256 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.507237", , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.257 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.888 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for rw locks" , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.257 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:18.359829", , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.258 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.934 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.259 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.745111", , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.263 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.264 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.265 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.326 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804094", 2020-09-01T23:07:42.265 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.368 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.750666", , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" 2020-09-01T23:07:42.266 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804723", , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.267 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "queued_for_pg" , 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.427 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.268 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.757709", 2020-09-01T23:07:42.269 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.475 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805080", , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" 2020-09-01T23:07:42.270 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805146", , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:42.270 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.528 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:1048 3.0 3.7401b340 (undecoded) ondisk+retry+write+known_if_redirected e79)", 2020-09-01T23:07:42.271 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.550 INFO:teuthology.orchestra.run.smithi058.stdout: "duration": 0.040257653999999997, , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", 2020-09-01T23:07:42.272 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 1098 , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.272 WARNING:scrape:Ignoring malparsed backtrace: mon.c: injectargs:mon_osd_down_out_interval = '600' (not observed, change may require restart) , 2020-09-01T14:37:15.607 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 0 1 , reweighted osd.0 to 1 (10000) 2020-09-01T23:07:42.275 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:37.198 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd last-stat-seq osd.7 , 2020-09-01T14:37:37.501 INFO:teuthology.orchestra.run.smithi141.stdout:55834574882 , 2020-09-01T14:37:37.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574882 for osd.7 2020-09-01T23:07:42.276 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: } , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: ] , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:42.277 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "smtp_host", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.277 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.646 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:42.278 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "250", , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "maximum number of iterations to attempt optimization", 2020-09-01T23:07:42.279 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.693 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.280 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.723 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.281 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.745 INFO:teuthology.orchestra.run.smithi141.stdout: "FEATURE_TOGGLE_rgw": { 2020-09-01T23:07:42.281 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ISCSI_API_SSL_VERIFICATION", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "bool", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.282 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.797 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "http", , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:42.283 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.284 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "599", , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.285 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "devicehealth", , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:42.286 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "warn_threshold": { , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "warn_threshold", 2020-09-01T23:07:42.286 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.287 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "600", , 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.935 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:42.288 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ssl", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.289 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: "num_rep": { , 2020-09-01T14:37:38.974 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "num_rep", 2020-09-01T23:07:42.289 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "progress", , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, 2020-09-01T23:07:42.290 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:42.291 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.031 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:42.291 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "testkey": { , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "testkey", 2020-09-01T23:07:42.292 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.071 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:42.293 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.293 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.109 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.294 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.295 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "SMTP port", , 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.149 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.296 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:42.296 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "end_time", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.297 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "upmap_max_iterations": { , 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "upmap_max_iterations", , 2020-09-01T14:37:39.213 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "uint", 2020-09-01T23:07:42.298 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "True", 2020-09-01T23:07:42.299 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.252 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.300 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.272 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.300 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "RGW_API_USER_ID": { 2020-09-01T23:07:42.301 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "server_port", , 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", , 2020-09-01T14:37:39.311 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.302 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "deepsea", 2020-09-01T23:07:42.303 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 1, , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "device_health_metrics", , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:42.303 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "diskprediction_default_authority": { , 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "diskprediction_default_authority", , 2020-09-01T14:37:39.370 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:42.304 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "43200", 2020-09-01T23:07:42.304 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.424 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.306 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.306 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "name prefix for any created local pool", 2020-09-01T23:07:42.307 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.485 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "prometheus", , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:42.307 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.509 INFO:teuthology.orchestra.run.smithi141.stdout: "key_file": { , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "key_file", , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:42.308 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.528 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:42.309 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.309 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:42.310 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "interval": { , 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "interval", , 2020-09-01T14:37:39.588 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", 2020-09-01T23:07:42.311 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "module_options": { , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "identifier": { 2020-09-01T23:07:42.313 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:40.005 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd dump --format=json , 2020-09-01T14:37:40.296 INFO:teuthology.orchestra.run.smithi141.stdout: , 2020-09-01T14:37:40.297 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":101,"fsid":"b01533b7-eb64-4c69-a77b-81afe14e6ec6","created":"2020-09-01 14:34:48.210564","modified":"2020-09-01 14:37:31.955273","last_up_change":"2020-09-01 14:37:05.711181","last_in_change":"2020-09-01 14:34:57.693154","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-09-01 14:35:01.816445","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":28,"pg_placement_num":28,"pg_placement_num_target":28,"pg_num_target":28,"pg_num_pending":28,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"74","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"low_tier","create_time":"2020-09-01 14:35:19.604696","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2020-09-01 14:35:20.557567","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":46,"pg_placement_num":46,"pg_placement_num_target":46,"pg_num_target":46,"pg_num_pending":46,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"59","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"ad2190ac-ef12-4852-bbe2-ef34cfc93f8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6810","nonce":9569}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6811","nonce":9569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6816","nonce":9569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6813","nonce":9569}]},"public_addr":"172.21.15.141:6810/9569","cluster_addr":"172.21.15.141:6811/9569","heartbeat_back_addr":"172.21.15.141:6816/9569","heartbeat_front_addr":"172.21.15.141:6813/9569","state":["exists","up"]},{"osd":1,"uuid":"c4175e28-bb35-4f38-abbe-3b0b6c71bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6805","nonce":9570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6806","nonce":9570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6808","nonce":9570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6807","nonce":9570}]},"public_addr":"172.21.15.141:6805/9570","cluster_addr":"172.21.15.141:6806/9570","heartbeat_back_addr":"172.21.15.141:6808/9570","heartbeat_front_addr":"172.21.15.141:6807/9570","state":["exists","up"]},{"osd":2,"uuid":"f143c687-c20f-42d8-beba-5624b0a40a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6809","nonce":9568}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6812","nonce":9568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6815","nonce":9568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6814","nonce":9568}]},"public_addr":"172.21.15.141:6809/9568","cluster_addr":"172.21.15.141:6812/9568","heartbeat_back_addr":"172.21.15.141:6815/9568","heartbeat_front_addr":"172.21.15.141:6814/9568","state":["exists","up"]},{"osd":3,"uuid":"ebf39121-d9db-4d23-9982-25531ed6b081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6801","nonce":9567}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6802","nonce":9567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6804","nonce":9567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6803","nonce":9567}]},"public_addr":"172.21.15.141:6801/9567","cluster_addr":"172.21.15.141:6802/9567","heartbeat_back_addr":"172.21.15.141:6804/9567","heartbeat_front_addr":"172.21.15.141:6803/9567","state":["exists","up"]},{"osd":4,"uuid":"0b327f3e-7dae-4356-aa2e-49f78d7a6810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6808","nonce":9744}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6810","nonce":9744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6813","nonce":9744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6812","nonce":9744}]},"public_addr":"172.21.15.58:6808/9744","cluster_addr":"172.21.15.58:6810/9744","heartbeat_back_addr":"172.21.15.58:6813/9744","heartbeat_front_addr":"172.21.15.58:6812/9744","state":["exists","up"]},{"osd":5,"uuid":"4f43aa54-96fe-468d-8957-28d797a0217d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":17,"up_from":79,"up_thru":80,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6804","nonce":12737}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6805","nonce":12737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6807","nonce":12737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6806","nonce":12737}]},"public_addr":"172.21.15.58:6804/12737","cluster_addr":"172.21.15.58:6805/12737","heartbeat_back_addr":"172.21.15.58:6807/12737","heartbeat_front_addr":"172.21.15.58:6806/12737","state":["exists","up"]},{"osd":6,"uuid":"81031507-bad8-4ecc-8fab-2cfd93f9d1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6809","nonce":9746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6811","nonce":9746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6815","nonce":9746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6814","nonce":9746}]},"public_addr":"172.21.15.58:6809/9746","cluster_addr":"172.21.15.58:6811/9746","heartbeat_back_addr":"172.21.15.58:6815/9746","heartbeat_front_addr":"172.21.15.58:6814/9746","state":["exists","up"]},{"osd":7,"uuid":"d421ee69-bd5a-4242-a37d-9df62e06d40d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6800","nonce":9747}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6801","nonce":9747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6803","nonce":9747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6802","nonce":9747}]},"public_addr":"172.21.15.58:6800/9747","cluster_addr":"172.21.15.58:6801/9747","heartbeat_back_addr":"172.21.15.58:6803/9747","heartbeat_front_addr":"172.21.15.58:6802/9747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":5,"down_stamp":"2020-09-01 14:35:20.110432","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0}],"pg_upmap":[{"pgid":"3.7","osds":[6,3]}],"pg_upmap_items":[{"pgid":"1.6","mappings":[{"from":6,"to":2}]}],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-09-01T23:07:42.316 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:45.950 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2020-09-01 14:37:15.958440 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 1.8 last_scrub_stamp 2020-09-01 14:37:05.369868 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=5, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2020-09-01 14:37:12.980647 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=12, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) 2020-09-01T23:07:42.317 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:38:27.671 DEBUG:tasks.ceph.osd.3:waiting for process to exit , 2020-09-01T14:38:27.672 INFO:teuthology.orchestra.run:waiting for 300 , 2020-09-01T14:38:27.733 INFO:tasks.ceph.osd.3:Stopped 2020-09-01T23:07:42.318 WARNING:scrape:Ignoring malparsed backtrace: suppress = manager.__exit__(*exc_info) , File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ , next(self.gen) 2020-09-01T23:07:42.536 WARNING:scrape:Ignoring malparsed backtrace: ceph version 14.2.11-99-gaf0268dc91 (af0268dc910f84b47655e83a83ca54b6fb92dbaf) nautilus (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x7f9e42176b3c] , 2: (CopyOp::_finish(TestOp::CallbackInfo*)+0x1c0) [0x55ff62d8bc80] 2020-09-01T23:07:42.537 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.288652", 2020-09-01T23:07:42.538 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.356 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.539 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.484354", , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.539 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "sub_op_commit_rec" , 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.396 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.540 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.506592", 2020-09-01T23:07:42.541 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.802461", , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" 2020-09-01T23:07:42.542 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.037345", , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.542 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.543 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.515 INFO:teuthology.orchestra.run.smithi058.stdout: "client": "client.4505", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 633 2020-09-01T23:07:42.543 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.224835", , 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:07.536 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.544 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.545 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.643343", 2020-09-01T23:07:42.546 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.604 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.633818", , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:42.547 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout:} 2020-09-01T23:07:42.548 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", , 2020-09-01T14:37:07.997 INFO:teuthology.orchestra.run.smithi058.stdout: "client_info": { 2020-09-01T23:07:42.549 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.023 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.747256", , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for peered" , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.551 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.070 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.552 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748752", 2020-09-01T23:07:42.553 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748827", , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:42.554 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.148 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.776856", , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.555 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.556 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.784217", 2020-09-01T23:07:42.558 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.751733", , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" 2020-09-01T23:07:42.559 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.790101", , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.560 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.256 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.561 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.277 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.812554", 2020-09-01T23:07:42.563 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.302 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.755045", , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" 2020-09-01T23:07:42.564 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.724 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.565 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.749 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.000402", 2020-09-01T23:07:42.566 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.986835", , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:42.567 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: ] 2020-09-01T23:07:42.568 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.270261", , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:42.569 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.830 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.497981", 2020-09-01T23:07:42.570 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.849 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:733 3.b 3:d93ca490:::smithi14112534-168:head [write 2303522~503247] snapc 0=[] ondisk+write+known_if_redirected e43)", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "initiated_at": "2020-09-01 14:36:09.506623", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "age": 59.168450086999997, 2020-09-01T23:07:42.571 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.507237", , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.572 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.888 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for rw locks" , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.574 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:18.359829", , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.574 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.934 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.575 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.745111", , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.576 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.577 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.578 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.326 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804094", 2020-09-01T23:07:42.579 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.368 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.750666", , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" 2020-09-01T23:07:42.580 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804723", , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.581 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "queued_for_pg" , 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.427 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.582 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.757709", 2020-09-01T23:07:42.584 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.475 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805080", , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" 2020-09-01T23:07:42.585 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805146", , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:42.586 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.528 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:1048 3.0 3.7401b340 (undecoded) ondisk+retry+write+known_if_redirected e79)", 2020-09-01T23:07:42.587 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.550 INFO:teuthology.orchestra.run.smithi058.stdout: "duration": 0.040257653999999997, , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", 2020-09-01T23:07:42.588 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 1098 , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.589 WARNING:scrape:Ignoring malparsed backtrace: mon.c: injectargs:mon_osd_down_out_interval = '600' (not observed, change may require restart) , 2020-09-01T14:37:15.607 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 0 1 , reweighted osd.0 to 1 (10000) 2020-09-01T23:07:42.593 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:37.198 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd last-stat-seq osd.7 , 2020-09-01T14:37:37.501 INFO:teuthology.orchestra.run.smithi141.stdout:55834574882 , 2020-09-01T14:37:37.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574882 for osd.7 2020-09-01T23:07:42.594 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: } , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: ] , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:42.595 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "smtp_host", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.596 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.646 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:42.597 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "250", , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "maximum number of iterations to attempt optimization", 2020-09-01T23:07:42.598 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.693 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.599 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.723 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.600 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.745 INFO:teuthology.orchestra.run.smithi141.stdout: "FEATURE_TOGGLE_rgw": { 2020-09-01T23:07:42.601 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ISCSI_API_SSL_VERIFICATION", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "bool", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.602 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.797 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "http", , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:42.603 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.605 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "599", , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.606 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "devicehealth", , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:42.607 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "warn_threshold": { , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "warn_threshold", 2020-09-01T23:07:42.608 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.609 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "600", , 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.935 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:42.610 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ssl", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.611 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: "num_rep": { , 2020-09-01T14:37:38.974 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "num_rep", 2020-09-01T23:07:42.612 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "progress", , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, 2020-09-01T23:07:42.613 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:42.614 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.031 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:42.616 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "testkey": { , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "testkey", 2020-09-01T23:07:42.617 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.071 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:42.618 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.619 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.109 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.620 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.621 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "SMTP port", , 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.149 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.622 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:42.623 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "end_time", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.624 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "upmap_max_iterations": { , 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "upmap_max_iterations", , 2020-09-01T14:37:39.213 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "uint", 2020-09-01T23:07:42.625 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "True", 2020-09-01T23:07:42.626 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.252 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.627 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.272 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.629 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "RGW_API_USER_ID": { 2020-09-01T23:07:42.630 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "server_port", , 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", , 2020-09-01T14:37:39.311 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.631 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "deepsea", 2020-09-01T23:07:42.632 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 1, , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "device_health_metrics", , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:42.632 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "diskprediction_default_authority": { , 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "diskprediction_default_authority", , 2020-09-01T14:37:39.370 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:42.633 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "43200", 2020-09-01T23:07:42.634 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.424 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.635 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.637 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "name prefix for any created local pool", 2020-09-01T23:07:42.638 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.485 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "prometheus", , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:42.639 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.509 INFO:teuthology.orchestra.run.smithi141.stdout: "key_file": { , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "key_file", , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:42.640 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.528 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:42.641 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.642 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:42.643 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "interval": { , 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "interval", , 2020-09-01T14:37:39.588 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", 2020-09-01T23:07:42.644 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "module_options": { , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "identifier": { 2020-09-01T23:07:42.649 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:40.005 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd dump --format=json , 2020-09-01T14:37:40.296 INFO:teuthology.orchestra.run.smithi141.stdout: , 2020-09-01T14:37:40.297 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":101,"fsid":"b01533b7-eb64-4c69-a77b-81afe14e6ec6","created":"2020-09-01 14:34:48.210564","modified":"2020-09-01 14:37:31.955273","last_up_change":"2020-09-01 14:37:05.711181","last_in_change":"2020-09-01 14:34:57.693154","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-09-01 14:35:01.816445","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":28,"pg_placement_num":28,"pg_placement_num_target":28,"pg_num_target":28,"pg_num_pending":28,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"74","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"low_tier","create_time":"2020-09-01 14:35:19.604696","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2020-09-01 14:35:20.557567","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":46,"pg_placement_num":46,"pg_placement_num_target":46,"pg_num_target":46,"pg_num_pending":46,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"59","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"ad2190ac-ef12-4852-bbe2-ef34cfc93f8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6810","nonce":9569}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6811","nonce":9569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6816","nonce":9569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6813","nonce":9569}]},"public_addr":"172.21.15.141:6810/9569","cluster_addr":"172.21.15.141:6811/9569","heartbeat_back_addr":"172.21.15.141:6816/9569","heartbeat_front_addr":"172.21.15.141:6813/9569","state":["exists","up"]},{"osd":1,"uuid":"c4175e28-bb35-4f38-abbe-3b0b6c71bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6805","nonce":9570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6806","nonce":9570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6808","nonce":9570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6807","nonce":9570}]},"public_addr":"172.21.15.141:6805/9570","cluster_addr":"172.21.15.141:6806/9570","heartbeat_back_addr":"172.21.15.141:6808/9570","heartbeat_front_addr":"172.21.15.141:6807/9570","state":["exists","up"]},{"osd":2,"uuid":"f143c687-c20f-42d8-beba-5624b0a40a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6809","nonce":9568}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6812","nonce":9568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6815","nonce":9568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6814","nonce":9568}]},"public_addr":"172.21.15.141:6809/9568","cluster_addr":"172.21.15.141:6812/9568","heartbeat_back_addr":"172.21.15.141:6815/9568","heartbeat_front_addr":"172.21.15.141:6814/9568","state":["exists","up"]},{"osd":3,"uuid":"ebf39121-d9db-4d23-9982-25531ed6b081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6801","nonce":9567}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6802","nonce":9567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6804","nonce":9567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6803","nonce":9567}]},"public_addr":"172.21.15.141:6801/9567","cluster_addr":"172.21.15.141:6802/9567","heartbeat_back_addr":"172.21.15.141:6804/9567","heartbeat_front_addr":"172.21.15.141:6803/9567","state":["exists","up"]},{"osd":4,"uuid":"0b327f3e-7dae-4356-aa2e-49f78d7a6810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6808","nonce":9744}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6810","nonce":9744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6813","nonce":9744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6812","nonce":9744}]},"public_addr":"172.21.15.58:6808/9744","cluster_addr":"172.21.15.58:6810/9744","heartbeat_back_addr":"172.21.15.58:6813/9744","heartbeat_front_addr":"172.21.15.58:6812/9744","state":["exists","up"]},{"osd":5,"uuid":"4f43aa54-96fe-468d-8957-28d797a0217d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":17,"up_from":79,"up_thru":80,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6804","nonce":12737}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6805","nonce":12737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6807","nonce":12737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6806","nonce":12737}]},"public_addr":"172.21.15.58:6804/12737","cluster_addr":"172.21.15.58:6805/12737","heartbeat_back_addr":"172.21.15.58:6807/12737","heartbeat_front_addr":"172.21.15.58:6806/12737","state":["exists","up"]},{"osd":6,"uuid":"81031507-bad8-4ecc-8fab-2cfd93f9d1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6809","nonce":9746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6811","nonce":9746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6815","nonce":9746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6814","nonce":9746}]},"public_addr":"172.21.15.58:6809/9746","cluster_addr":"172.21.15.58:6811/9746","heartbeat_back_addr":"172.21.15.58:6815/9746","heartbeat_front_addr":"172.21.15.58:6814/9746","state":["exists","up"]},{"osd":7,"uuid":"d421ee69-bd5a-4242-a37d-9df62e06d40d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6800","nonce":9747}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6801","nonce":9747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6803","nonce":9747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6802","nonce":9747}]},"public_addr":"172.21.15.58:6800/9747","cluster_addr":"172.21.15.58:6801/9747","heartbeat_back_addr":"172.21.15.58:6803/9747","heartbeat_front_addr":"172.21.15.58:6802/9747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":5,"down_stamp":"2020-09-01 14:35:20.110432","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0}],"pg_upmap":[{"pgid":"3.7","osds":[6,3]}],"pg_upmap_items":[{"pgid":"1.6","mappings":[{"from":6,"to":2}]}],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-09-01T23:07:42.652 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:45.950 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2020-09-01 14:37:15.958440 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 1.8 last_scrub_stamp 2020-09-01 14:37:05.369868 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=5, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2020-09-01 14:37:12.980647 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=12, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) 2020-09-01T23:07:42.654 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:38:27.671 DEBUG:tasks.ceph.osd.3:waiting for process to exit , 2020-09-01T14:38:27.672 INFO:teuthology.orchestra.run:waiting for 300 , 2020-09-01T14:38:27.733 INFO:tasks.ceph.osd.3:Stopped 2020-09-01T23:07:42.655 WARNING:scrape:Ignoring malparsed backtrace: suppress = manager.__exit__(*exc_info) , File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ , next(self.gen) 2020-09-01T23:07:42.860 WARNING:scrape:Ignoring malparsed backtrace: ceph version 14.2.11-99-gaf0268dc91 (af0268dc910f84b47655e83a83ca54b6fb92dbaf) nautilus (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x7f9e42176b3c] , 2: (CopyOp::_finish(TestOp::CallbackInfo*)+0x1c0) [0x55ff62d8bc80] 2020-09-01T23:07:42.862 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.288652", 2020-09-01T23:07:42.863 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.356 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.864 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.484354", , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.865 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "sub_op_commit_rec" , 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.396 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.866 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.506592", 2020-09-01T23:07:42.868 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.802461", , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" 2020-09-01T23:07:42.869 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.037345", , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.870 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.871 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.515 INFO:teuthology.orchestra.run.smithi058.stdout: "client": "client.4505", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 633 2020-09-01T23:07:42.872 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.224835", , 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:07.536 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.873 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.874 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.643343", 2020-09-01T23:07:42.875 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.604 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.633818", , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:42.876 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout:} 2020-09-01T23:07:42.878 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", , 2020-09-01T14:37:07.997 INFO:teuthology.orchestra.run.smithi058.stdout: "client_info": { 2020-09-01T23:07:42.879 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.023 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.747256", , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for peered" , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.880 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.070 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.881 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748752", 2020-09-01T23:07:42.882 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748827", , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:42.883 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.148 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.776856", , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.884 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.885 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.784217", 2020-09-01T23:07:42.886 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.751733", , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" 2020-09-01T23:07:42.887 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.790101", , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.888 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.256 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.889 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.277 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.812554", 2020-09-01T23:07:42.890 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.302 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.755045", , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" 2020-09-01T23:07:42.891 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.724 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.892 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.749 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.000402", 2020-09-01T23:07:42.893 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.986835", , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:42.895 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: ] 2020-09-01T23:07:42.896 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.270261", , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:42.897 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.830 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.497981", 2020-09-01T23:07:42.898 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.849 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:733 3.b 3:d93ca490:::smithi14112534-168:head [write 2303522~503247] snapc 0=[] ondisk+write+known_if_redirected e43)", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "initiated_at": "2020-09-01 14:36:09.506623", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "age": 59.168450086999997, 2020-09-01T23:07:42.899 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.507237", , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.900 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.888 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for rw locks" , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.901 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:18.359829", , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.902 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.934 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.903 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.745111", , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.904 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.905 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.906 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.326 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804094", 2020-09-01T23:07:42.907 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.368 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.750666", , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" 2020-09-01T23:07:42.908 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804723", , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.909 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "queued_for_pg" , 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.427 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:42.910 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.757709", 2020-09-01T23:07:42.911 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.475 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805080", , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" 2020-09-01T23:07:42.912 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805146", , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:42.913 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.528 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:1048 3.0 3.7401b340 (undecoded) ondisk+retry+write+known_if_redirected e79)", 2020-09-01T23:07:42.914 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.550 INFO:teuthology.orchestra.run.smithi058.stdout: "duration": 0.040257653999999997, , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", 2020-09-01T23:07:42.915 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 1098 , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:42.916 WARNING:scrape:Ignoring malparsed backtrace: mon.c: injectargs:mon_osd_down_out_interval = '600' (not observed, change may require restart) , 2020-09-01T14:37:15.607 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 0 1 , reweighted osd.0 to 1 (10000) 2020-09-01T23:07:42.919 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:37.198 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd last-stat-seq osd.7 , 2020-09-01T14:37:37.501 INFO:teuthology.orchestra.run.smithi141.stdout:55834574882 , 2020-09-01T14:37:37.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574882 for osd.7 2020-09-01T23:07:42.920 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: } , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: ] , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:42.922 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "smtp_host", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.923 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.646 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:42.924 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "250", , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "maximum number of iterations to attempt optimization", 2020-09-01T23:07:42.925 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.693 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.926 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.723 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.927 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.745 INFO:teuthology.orchestra.run.smithi141.stdout: "FEATURE_TOGGLE_rgw": { 2020-09-01T23:07:42.928 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ISCSI_API_SSL_VERIFICATION", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "bool", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.929 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.797 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "http", , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:42.930 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.931 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "599", , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.932 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "devicehealth", , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:42.934 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "warn_threshold": { , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "warn_threshold", 2020-09-01T23:07:42.935 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.936 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "600", , 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.935 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:42.937 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ssl", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.938 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: "num_rep": { , 2020-09-01T14:37:38.974 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "num_rep", 2020-09-01T23:07:42.939 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "progress", , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, 2020-09-01T23:07:42.940 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:42.941 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.031 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:42.942 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "testkey": { , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "testkey", 2020-09-01T23:07:42.942 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.071 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:42.943 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.944 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.109 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.945 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.946 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "SMTP port", , 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.149 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.947 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:42.948 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "end_time", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.949 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "upmap_max_iterations": { , 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "upmap_max_iterations", , 2020-09-01T14:37:39.213 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "uint", 2020-09-01T23:07:42.950 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "True", 2020-09-01T23:07:42.951 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.252 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.952 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.272 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.953 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "RGW_API_USER_ID": { 2020-09-01T23:07:42.954 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "server_port", , 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", , 2020-09-01T14:37:39.311 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:42.955 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "deepsea", 2020-09-01T23:07:42.956 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 1, , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "device_health_metrics", , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:42.957 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "diskprediction_default_authority": { , 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "diskprediction_default_authority", , 2020-09-01T14:37:39.370 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:42.959 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "43200", 2020-09-01T23:07:42.959 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.424 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:42.960 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:42.961 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "name prefix for any created local pool", 2020-09-01T23:07:42.961 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.485 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "prometheus", , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:42.963 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.509 INFO:teuthology.orchestra.run.smithi141.stdout: "key_file": { , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "key_file", , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:42.964 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.528 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:42.964 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:42.969 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:42.970 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "interval": { , 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "interval", , 2020-09-01T14:37:39.588 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", 2020-09-01T23:07:42.972 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "module_options": { , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "identifier": { 2020-09-01T23:07:42.975 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:40.005 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd dump --format=json , 2020-09-01T14:37:40.296 INFO:teuthology.orchestra.run.smithi141.stdout: , 2020-09-01T14:37:40.297 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":101,"fsid":"b01533b7-eb64-4c69-a77b-81afe14e6ec6","created":"2020-09-01 14:34:48.210564","modified":"2020-09-01 14:37:31.955273","last_up_change":"2020-09-01 14:37:05.711181","last_in_change":"2020-09-01 14:34:57.693154","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-09-01 14:35:01.816445","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":28,"pg_placement_num":28,"pg_placement_num_target":28,"pg_num_target":28,"pg_num_pending":28,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"74","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"low_tier","create_time":"2020-09-01 14:35:19.604696","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2020-09-01 14:35:20.557567","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":46,"pg_placement_num":46,"pg_placement_num_target":46,"pg_num_target":46,"pg_num_pending":46,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"59","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"ad2190ac-ef12-4852-bbe2-ef34cfc93f8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6810","nonce":9569}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6811","nonce":9569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6816","nonce":9569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6813","nonce":9569}]},"public_addr":"172.21.15.141:6810/9569","cluster_addr":"172.21.15.141:6811/9569","heartbeat_back_addr":"172.21.15.141:6816/9569","heartbeat_front_addr":"172.21.15.141:6813/9569","state":["exists","up"]},{"osd":1,"uuid":"c4175e28-bb35-4f38-abbe-3b0b6c71bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6805","nonce":9570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6806","nonce":9570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6808","nonce":9570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6807","nonce":9570}]},"public_addr":"172.21.15.141:6805/9570","cluster_addr":"172.21.15.141:6806/9570","heartbeat_back_addr":"172.21.15.141:6808/9570","heartbeat_front_addr":"172.21.15.141:6807/9570","state":["exists","up"]},{"osd":2,"uuid":"f143c687-c20f-42d8-beba-5624b0a40a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6809","nonce":9568}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6812","nonce":9568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6815","nonce":9568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6814","nonce":9568}]},"public_addr":"172.21.15.141:6809/9568","cluster_addr":"172.21.15.141:6812/9568","heartbeat_back_addr":"172.21.15.141:6815/9568","heartbeat_front_addr":"172.21.15.141:6814/9568","state":["exists","up"]},{"osd":3,"uuid":"ebf39121-d9db-4d23-9982-25531ed6b081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6801","nonce":9567}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6802","nonce":9567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6804","nonce":9567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6803","nonce":9567}]},"public_addr":"172.21.15.141:6801/9567","cluster_addr":"172.21.15.141:6802/9567","heartbeat_back_addr":"172.21.15.141:6804/9567","heartbeat_front_addr":"172.21.15.141:6803/9567","state":["exists","up"]},{"osd":4,"uuid":"0b327f3e-7dae-4356-aa2e-49f78d7a6810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6808","nonce":9744}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6810","nonce":9744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6813","nonce":9744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6812","nonce":9744}]},"public_addr":"172.21.15.58:6808/9744","cluster_addr":"172.21.15.58:6810/9744","heartbeat_back_addr":"172.21.15.58:6813/9744","heartbeat_front_addr":"172.21.15.58:6812/9744","state":["exists","up"]},{"osd":5,"uuid":"4f43aa54-96fe-468d-8957-28d797a0217d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":17,"up_from":79,"up_thru":80,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6804","nonce":12737}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6805","nonce":12737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6807","nonce":12737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6806","nonce":12737}]},"public_addr":"172.21.15.58:6804/12737","cluster_addr":"172.21.15.58:6805/12737","heartbeat_back_addr":"172.21.15.58:6807/12737","heartbeat_front_addr":"172.21.15.58:6806/12737","state":["exists","up"]},{"osd":6,"uuid":"81031507-bad8-4ecc-8fab-2cfd93f9d1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6809","nonce":9746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6811","nonce":9746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6815","nonce":9746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6814","nonce":9746}]},"public_addr":"172.21.15.58:6809/9746","cluster_addr":"172.21.15.58:6811/9746","heartbeat_back_addr":"172.21.15.58:6815/9746","heartbeat_front_addr":"172.21.15.58:6814/9746","state":["exists","up"]},{"osd":7,"uuid":"d421ee69-bd5a-4242-a37d-9df62e06d40d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6800","nonce":9747}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6801","nonce":9747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6803","nonce":9747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6802","nonce":9747}]},"public_addr":"172.21.15.58:6800/9747","cluster_addr":"172.21.15.58:6801/9747","heartbeat_back_addr":"172.21.15.58:6803/9747","heartbeat_front_addr":"172.21.15.58:6802/9747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":5,"down_stamp":"2020-09-01 14:35:20.110432","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0}],"pg_upmap":[{"pgid":"3.7","osds":[6,3]}],"pg_upmap_items":[{"pgid":"1.6","mappings":[{"from":6,"to":2}]}],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-09-01T23:07:42.994 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:45.950 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2020-09-01 14:37:15.958440 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 1.8 last_scrub_stamp 2020-09-01 14:37:05.369868 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=5, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2020-09-01 14:37:12.980647 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=12, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) 2020-09-01T23:07:42.996 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:38:27.671 DEBUG:tasks.ceph.osd.3:waiting for process to exit , 2020-09-01T14:38:27.672 INFO:teuthology.orchestra.run:waiting for 300 , 2020-09-01T14:38:27.733 INFO:tasks.ceph.osd.3:Stopped 2020-09-01T23:07:42.997 WARNING:scrape:Ignoring malparsed backtrace: suppress = manager.__exit__(*exc_info) , File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ , next(self.gen) 2020-09-01T23:07:43.172 WARNING:scrape:Ignoring malparsed backtrace: ceph version 14.2.11-99-gaf0268dc91 (af0268dc910f84b47655e83a83ca54b6fb92dbaf) nautilus (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x7f9e42176b3c] , 2: (CopyOp::_finish(TestOp::CallbackInfo*)+0x1c0) [0x55ff62d8bc80] 2020-09-01T23:07:43.173 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.288652", 2020-09-01T23:07:43.174 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.356 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.175 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.484354", , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.175 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "sub_op_commit_rec" , 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.396 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.176 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.506592", 2020-09-01T23:07:43.176 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.802461", , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" 2020-09-01T23:07:43.177 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.037345", , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.178 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.178 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.515 INFO:teuthology.orchestra.run.smithi058.stdout: "client": "client.4505", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 633 2020-09-01T23:07:43.179 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.224835", , 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:07.536 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.180 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.180 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.643343", 2020-09-01T23:07:43.181 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.604 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.633818", , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:43.182 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout:} 2020-09-01T23:07:43.182 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", , 2020-09-01T14:37:07.997 INFO:teuthology.orchestra.run.smithi058.stdout: "client_info": { 2020-09-01T23:07:43.183 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.023 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.747256", , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for peered" , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.183 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.070 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.184 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748752", 2020-09-01T23:07:43.185 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748827", , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:43.185 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.148 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.776856", , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.186 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.187 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.784217", 2020-09-01T23:07:43.187 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.751733", , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" 2020-09-01T23:07:43.188 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.790101", , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.188 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.256 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.189 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.277 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.812554", 2020-09-01T23:07:43.190 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.302 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.755045", , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" 2020-09-01T23:07:43.190 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.724 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.191 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.749 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.000402", 2020-09-01T23:07:43.192 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.986835", , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:43.192 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: ] 2020-09-01T23:07:43.193 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.270261", , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:43.195 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.830 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.497981", 2020-09-01T23:07:43.195 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.849 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:733 3.b 3:d93ca490:::smithi14112534-168:head [write 2303522~503247] snapc 0=[] ondisk+write+known_if_redirected e43)", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "initiated_at": "2020-09-01 14:36:09.506623", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "age": 59.168450086999997, 2020-09-01T23:07:43.196 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.507237", , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.197 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.888 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for rw locks" , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.197 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:18.359829", , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.198 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.934 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.199 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.745111", , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.199 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.200 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.200 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.326 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804094", 2020-09-01T23:07:43.201 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.368 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.750666", , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" 2020-09-01T23:07:43.203 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804723", , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.204 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "queued_for_pg" , 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.427 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.204 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.757709", 2020-09-01T23:07:43.205 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.475 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805080", , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" 2020-09-01T23:07:43.206 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805146", , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:43.206 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.528 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:1048 3.0 3.7401b340 (undecoded) ondisk+retry+write+known_if_redirected e79)", 2020-09-01T23:07:43.207 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.550 INFO:teuthology.orchestra.run.smithi058.stdout: "duration": 0.040257653999999997, , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", 2020-09-01T23:07:43.208 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 1098 , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.209 WARNING:scrape:Ignoring malparsed backtrace: mon.c: injectargs:mon_osd_down_out_interval = '600' (not observed, change may require restart) , 2020-09-01T14:37:15.607 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 0 1 , reweighted osd.0 to 1 (10000) 2020-09-01T23:07:43.213 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:37.198 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd last-stat-seq osd.7 , 2020-09-01T14:37:37.501 INFO:teuthology.orchestra.run.smithi141.stdout:55834574882 , 2020-09-01T14:37:37.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574882 for osd.7 2020-09-01T23:07:43.214 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: } , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: ] , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:43.214 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "smtp_host", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:43.215 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.646 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:43.216 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "250", , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "maximum number of iterations to attempt optimization", 2020-09-01T23:07:43.216 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.693 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:43.217 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.723 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:43.218 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.745 INFO:teuthology.orchestra.run.smithi141.stdout: "FEATURE_TOGGLE_rgw": { 2020-09-01T23:07:43.218 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ISCSI_API_SSL_VERIFICATION", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "bool", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:43.219 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.797 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "http", , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:43.219 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:43.220 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "599", , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:43.221 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "devicehealth", , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:43.221 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "warn_threshold": { , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "warn_threshold", 2020-09-01T23:07:43.222 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:43.223 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "600", , 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.935 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:43.223 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ssl", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:43.224 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: "num_rep": { , 2020-09-01T14:37:38.974 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "num_rep", 2020-09-01T23:07:43.224 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "progress", , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, 2020-09-01T23:07:43.225 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:43.226 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.031 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:43.226 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "testkey": { , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "testkey", 2020-09-01T23:07:43.227 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.071 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:43.228 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:43.228 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.109 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:43.229 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:43.230 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "SMTP port", , 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.149 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:43.231 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:43.231 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "end_time", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:43.232 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "upmap_max_iterations": { , 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "upmap_max_iterations", , 2020-09-01T14:37:39.213 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "uint", 2020-09-01T23:07:43.233 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "True", 2020-09-01T23:07:43.233 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.252 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:43.234 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.272 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:43.234 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "RGW_API_USER_ID": { 2020-09-01T23:07:43.235 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "server_port", , 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", , 2020-09-01T14:37:39.311 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:43.236 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "deepsea", 2020-09-01T23:07:43.236 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 1, , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "device_health_metrics", , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:43.237 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "diskprediction_default_authority": { , 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "diskprediction_default_authority", , 2020-09-01T14:37:39.370 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:43.237 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "43200", 2020-09-01T23:07:43.238 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.424 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:43.239 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:43.239 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "name prefix for any created local pool", 2020-09-01T23:07:43.240 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.485 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "prometheus", , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:43.241 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.509 INFO:teuthology.orchestra.run.smithi141.stdout: "key_file": { , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "key_file", , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:43.241 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.528 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:43.242 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:43.246 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:43.247 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "interval": { , 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "interval", , 2020-09-01T14:37:39.588 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", 2020-09-01T23:07:43.248 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "module_options": { , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "identifier": { 2020-09-01T23:07:43.251 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:40.005 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd dump --format=json , 2020-09-01T14:37:40.296 INFO:teuthology.orchestra.run.smithi141.stdout: , 2020-09-01T14:37:40.297 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":101,"fsid":"b01533b7-eb64-4c69-a77b-81afe14e6ec6","created":"2020-09-01 14:34:48.210564","modified":"2020-09-01 14:37:31.955273","last_up_change":"2020-09-01 14:37:05.711181","last_in_change":"2020-09-01 14:34:57.693154","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-09-01 14:35:01.816445","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":28,"pg_placement_num":28,"pg_placement_num_target":28,"pg_num_target":28,"pg_num_pending":28,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"74","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"low_tier","create_time":"2020-09-01 14:35:19.604696","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2020-09-01 14:35:20.557567","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":46,"pg_placement_num":46,"pg_placement_num_target":46,"pg_num_target":46,"pg_num_pending":46,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"59","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"ad2190ac-ef12-4852-bbe2-ef34cfc93f8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6810","nonce":9569}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6811","nonce":9569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6816","nonce":9569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6813","nonce":9569}]},"public_addr":"172.21.15.141:6810/9569","cluster_addr":"172.21.15.141:6811/9569","heartbeat_back_addr":"172.21.15.141:6816/9569","heartbeat_front_addr":"172.21.15.141:6813/9569","state":["exists","up"]},{"osd":1,"uuid":"c4175e28-bb35-4f38-abbe-3b0b6c71bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6805","nonce":9570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6806","nonce":9570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6808","nonce":9570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6807","nonce":9570}]},"public_addr":"172.21.15.141:6805/9570","cluster_addr":"172.21.15.141:6806/9570","heartbeat_back_addr":"172.21.15.141:6808/9570","heartbeat_front_addr":"172.21.15.141:6807/9570","state":["exists","up"]},{"osd":2,"uuid":"f143c687-c20f-42d8-beba-5624b0a40a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6809","nonce":9568}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6812","nonce":9568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6815","nonce":9568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6814","nonce":9568}]},"public_addr":"172.21.15.141:6809/9568","cluster_addr":"172.21.15.141:6812/9568","heartbeat_back_addr":"172.21.15.141:6815/9568","heartbeat_front_addr":"172.21.15.141:6814/9568","state":["exists","up"]},{"osd":3,"uuid":"ebf39121-d9db-4d23-9982-25531ed6b081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6801","nonce":9567}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6802","nonce":9567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6804","nonce":9567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6803","nonce":9567}]},"public_addr":"172.21.15.141:6801/9567","cluster_addr":"172.21.15.141:6802/9567","heartbeat_back_addr":"172.21.15.141:6804/9567","heartbeat_front_addr":"172.21.15.141:6803/9567","state":["exists","up"]},{"osd":4,"uuid":"0b327f3e-7dae-4356-aa2e-49f78d7a6810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6808","nonce":9744}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6810","nonce":9744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6813","nonce":9744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6812","nonce":9744}]},"public_addr":"172.21.15.58:6808/9744","cluster_addr":"172.21.15.58:6810/9744","heartbeat_back_addr":"172.21.15.58:6813/9744","heartbeat_front_addr":"172.21.15.58:6812/9744","state":["exists","up"]},{"osd":5,"uuid":"4f43aa54-96fe-468d-8957-28d797a0217d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":17,"up_from":79,"up_thru":80,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6804","nonce":12737}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6805","nonce":12737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6807","nonce":12737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6806","nonce":12737}]},"public_addr":"172.21.15.58:6804/12737","cluster_addr":"172.21.15.58:6805/12737","heartbeat_back_addr":"172.21.15.58:6807/12737","heartbeat_front_addr":"172.21.15.58:6806/12737","state":["exists","up"]},{"osd":6,"uuid":"81031507-bad8-4ecc-8fab-2cfd93f9d1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6809","nonce":9746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6811","nonce":9746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6815","nonce":9746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6814","nonce":9746}]},"public_addr":"172.21.15.58:6809/9746","cluster_addr":"172.21.15.58:6811/9746","heartbeat_back_addr":"172.21.15.58:6815/9746","heartbeat_front_addr":"172.21.15.58:6814/9746","state":["exists","up"]},{"osd":7,"uuid":"d421ee69-bd5a-4242-a37d-9df62e06d40d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6800","nonce":9747}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6801","nonce":9747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6803","nonce":9747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6802","nonce":9747}]},"public_addr":"172.21.15.58:6800/9747","cluster_addr":"172.21.15.58:6801/9747","heartbeat_back_addr":"172.21.15.58:6803/9747","heartbeat_front_addr":"172.21.15.58:6802/9747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":5,"down_stamp":"2020-09-01 14:35:20.110432","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0}],"pg_upmap":[{"pgid":"3.7","osds":[6,3]}],"pg_upmap_items":[{"pgid":"1.6","mappings":[{"from":6,"to":2}]}],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-09-01T23:07:43.254 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:45.950 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2020-09-01 14:37:15.958440 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 1.8 last_scrub_stamp 2020-09-01 14:37:05.369868 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=5, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2020-09-01 14:37:12.980647 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=12, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) 2020-09-01T23:07:43.255 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:38:27.671 DEBUG:tasks.ceph.osd.3:waiting for process to exit , 2020-09-01T14:38:27.672 INFO:teuthology.orchestra.run:waiting for 300 , 2020-09-01T14:38:27.733 INFO:tasks.ceph.osd.3:Stopped 2020-09-01T23:07:43.255 WARNING:scrape:Ignoring malparsed backtrace: suppress = manager.__exit__(*exc_info) , File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ , next(self.gen) 2020-09-01T23:07:43.416 WARNING:scrape:Ignoring malparsed backtrace: ceph version 14.2.11-99-gaf0268dc91 (af0268dc910f84b47655e83a83ca54b6fb92dbaf) nautilus (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x7f9e42176b3c] , 2: (CopyOp::_finish(TestOp::CallbackInfo*)+0x1c0) [0x55ff62d8bc80] 2020-09-01T23:07:43.417 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.323 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.288652", 2020-09-01T23:07:43.418 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.356 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.357 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.419 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.484354", , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:07.376 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.420 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "sub_op_commit_rec" , 2020-09-01T14:37:07.395 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.396 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.420 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.417 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.506592", 2020-09-01T23:07:43.421 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.802461", , 2020-09-01T14:37:07.441 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" 2020-09-01T23:07:43.422 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.037345", , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:07.465 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.422 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "op_commit" , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.496 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.423 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.515 INFO:teuthology.orchestra.run.smithi058.stdout: "client": "client.4505", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:07.516 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 633 2020-09-01T23:07:43.424 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.224835", , 2020-09-01T14:37:07.535 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:07.536 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.424 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.556 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.425 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.581 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.643343", 2020-09-01T23:07:43.425 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.604 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.633818", , 2020-09-01T14:37:07.605 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:43.426 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:07.624 INFO:teuthology.orchestra.run.smithi058.stdout:} 2020-09-01T23:07:43.427 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:07.996 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", , 2020-09-01T14:37:07.997 INFO:teuthology.orchestra.run.smithi058.stdout: "client_info": { 2020-09-01T23:07:43.427 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.023 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.747256", , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for peered" , 2020-09-01T14:37:08.024 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.428 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.070 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.071 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.429 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.109 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748752", 2020-09-01T23:07:43.429 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.748827", , 2020-09-01T14:37:08.129 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:43.430 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.148 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.776856", , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.149 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.430 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:08.168 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.431 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.192 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.784217", 2020-09-01T23:07:43.432 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.751733", , 2020-09-01T14:37:08.215 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" 2020-09-01T23:07:43.432 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.790101", , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.237 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.433 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.256 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.257 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.434 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.276 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.277 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.812554", 2020-09-01T23:07:43.434 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.302 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.755045", , 2020-09-01T14:37:08.303 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "header_read" 2020-09-01T23:07:43.435 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" , 2020-09-01T14:37:08.723 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.724 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.435 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.748 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.749 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.000402", 2020-09-01T23:07:43.436 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:08.986835", , 2020-09-01T14:37:08.770 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "initiated" 2020-09-01T23:07:43.437 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.790 INFO:teuthology.orchestra.run.smithi058.stdout: ] 2020-09-01T23:07:43.437 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.270261", , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:08.810 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:43.438 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.830 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:08.831 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.497981", 2020-09-01T23:07:43.439 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.849 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:733 3.b 3:d93ca490:::smithi14112534-168:head [write 2303522~503247] snapc 0=[] ondisk+write+known_if_redirected e43)", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "initiated_at": "2020-09-01 14:36:09.506623", , 2020-09-01T14:37:08.850 INFO:teuthology.orchestra.run.smithi058.stdout: "age": 59.168450086999997, 2020-09-01T23:07:43.439 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:09.507237", , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "all_read" , 2020-09-01T14:37:08.869 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.440 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.888 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "waiting for rw locks" , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.889 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.441 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:36:18.359829", , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:08.915 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.441 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.934 INFO:teuthology.orchestra.run.smithi058.stdout: ] , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: } , 2020-09-01T14:37:08.935 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.442 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.745111", , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "throttled" , 2020-09-01T14:37:08.956 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.442 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:08.975 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.443 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "started" , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.285 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.444 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.326 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.327 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804094", 2020-09-01T23:07:43.444 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.368 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.750666", , 2020-09-01T14:37:09.369 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "dispatched" 2020-09-01T23:07:43.445 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.804723", , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "commit_sent" , 2020-09-01T14:37:09.403 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.446 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "queued_for_pg" , 2020-09-01T14:37:09.426 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.427 INFO:teuthology.orchestra.run.smithi058.stdout: { 2020-09-01T23:07:43.446 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "events": [ , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.451 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.757709", 2020-09-01T23:07:43.447 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.475 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805080", , 2020-09-01T14:37:09.476 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "reached_pg" 2020-09-01T23:07:43.448 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "time": "2020-09-01 14:37:06.805146", , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: "event": "done" , 2020-09-01T14:37:09.500 INFO:teuthology.orchestra.run.smithi058.stdout: } 2020-09-01T23:07:43.448 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.528 INFO:teuthology.orchestra.run.smithi058.stdout: }, , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: { , 2020-09-01T14:37:09.529 INFO:teuthology.orchestra.run.smithi058.stdout: "description": "osd_op(client.4505.0:1048 3.0 3.7401b340 (undecoded) ondisk+retry+write+known_if_redirected e79)", 2020-09-01T23:07:43.449 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.550 INFO:teuthology.orchestra.run.smithi058.stdout: "duration": 0.040257653999999997, , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "type_data": { , 2020-09-01T14:37:09.551 INFO:teuthology.orchestra.run.smithi058.stdout: "flag_point": "reached pg", 2020-09-01T23:07:43.449 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "client_addr": "v1:172.21.15.141:0/3513969552", , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: "tid": 1098 , 2020-09-01T14:37:09.573 INFO:teuthology.orchestra.run.smithi058.stdout: }, 2020-09-01T23:07:43.450 WARNING:scrape:Ignoring malparsed backtrace: mon.c: injectargs:mon_osd_down_out_interval = '600' (not observed, change may require restart) , 2020-09-01T14:37:15.607 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 0 1 , reweighted osd.0 to 1 (10000) 2020-09-01T23:07:43.456 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:37.198 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd last-stat-seq osd.7 , 2020-09-01T14:37:37.501 INFO:teuthology.orchestra.run.smithi141.stdout:55834574882 , 2020-09-01T14:37:37.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574882 for osd.7 2020-09-01T23:07:43.457 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: } , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: ] , 2020-09-01T14:37:38.590 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:43.458 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "smtp_host", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.612 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:43.459 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.646 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.647 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:43.459 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "250", , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.669 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "maximum number of iterations to attempt optimization", 2020-09-01T23:07:43.460 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.692 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.693 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:43.461 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.722 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.723 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:43.462 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:38.744 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.745 INFO:teuthology.orchestra.run.smithi141.stdout: "FEATURE_TOGGLE_rgw": { 2020-09-01T23:07:43.462 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ISCSI_API_SSL_VERIFICATION", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "bool", , 2020-09-01T14:37:38.767 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:43.463 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.797 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "http", , 2020-09-01T14:37:38.798 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:43.464 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.821 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:43.464 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "599", , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:38.844 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:43.466 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "devicehealth", , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:38.866 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:43.467 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "warn_threshold": { , 2020-09-01T14:37:38.893 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "warn_threshold", 2020-09-01T23:07:43.468 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:38.912 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:43.469 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "600", , 2020-09-01T14:37:38.934 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:38.935 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:43.471 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "ssl", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:38.954 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:43.474 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:38.973 INFO:teuthology.orchestra.run.smithi141.stdout: "num_rep": { , 2020-09-01T14:37:38.974 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "num_rep", 2020-09-01T23:07:43.475 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "progress", , 2020-09-01T14:37:38.993 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, 2020-09-01T23:07:43.476 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.012 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:43.477 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.031 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.032 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:43.478 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "testkey": { , 2020-09-01T14:37:39.051 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "testkey", 2020-09-01T23:07:43.480 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.070 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.071 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] 2020-09-01T23:07:43.482 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.090 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:43.483 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.109 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.110 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:43.484 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.129 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:43.485 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "SMTP port", , 2020-09-01T14:37:39.148 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.149 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:43.486 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.168 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", 2020-09-01T23:07:43.487 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "end_time", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", , 2020-09-01T14:37:39.187 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:43.488 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "upmap_max_iterations": { , 2020-09-01T14:37:39.212 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "upmap_max_iterations", , 2020-09-01T14:37:39.213 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "uint", 2020-09-01T23:07:43.489 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.232 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "True", 2020-09-01T23:07:43.492 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.251 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.252 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:43.494 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.271 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.272 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:43.496 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.291 INFO:teuthology.orchestra.run.smithi141.stdout: "RGW_API_USER_ID": { 2020-09-01T23:07:43.497 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "server_port", , 2020-09-01T14:37:39.310 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", , 2020-09-01T14:37:39.311 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", 2020-09-01T23:07:43.497 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: { , 2020-09-01T14:37:39.330 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "deepsea", 2020-09-01T23:07:43.499 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 1, , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "device_health_metrics", , 2020-09-01T14:37:39.350 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:43.500 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "diskprediction_default_authority": { , 2020-09-01T14:37:39.369 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "diskprediction_default_authority", , 2020-09-01T14:37:39.370 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:43.500 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "level": "advanced", , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.389 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "43200", 2020-09-01T23:07:43.501 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", , 2020-09-01T14:37:39.423 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.424 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], 2020-09-01T23:07:43.502 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "long_desc": "", , 2020-09-01T14:37:39.444 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], 2020-09-01T23:07:43.504 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.465 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "name prefix for any created local pool", 2020-09-01T23:07:43.505 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.485 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "prometheus", , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "can_run": true, , 2020-09-01T14:37:39.490 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", 2020-09-01T23:07:43.505 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.509 INFO:teuthology.orchestra.run.smithi141.stdout: "key_file": { , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "key_file", , 2020-09-01T14:37:39.510 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "str", 2020-09-01T23:07:43.506 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.528 INFO:teuthology.orchestra.run.smithi141.stdout: "flags": 0, , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "default_value": "", , 2020-09-01T14:37:39.529 INFO:teuthology.orchestra.run.smithi141.stdout: "min": "", 2020-09-01T23:07:43.507 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "max": "", , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "enum_allowed": [], , 2020-09-01T14:37:39.549 INFO:teuthology.orchestra.run.smithi141.stdout: "desc": "", 2020-09-01T23:07:43.507 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "tags": [], , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: "see_also": [] , 2020-09-01T14:37:39.568 INFO:teuthology.orchestra.run.smithi141.stdout: }, 2020-09-01T23:07:43.508 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "interval": { , 2020-09-01T14:37:39.587 INFO:teuthology.orchestra.run.smithi141.stdout: "name": "interval", , 2020-09-01T14:37:39.588 INFO:teuthology.orchestra.run.smithi141.stdout: "type": "int", 2020-09-01T23:07:43.509 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "error_string": "", , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "module_options": { , 2020-09-01T14:37:39.607 INFO:teuthology.orchestra.run.smithi141.stdout: "identifier": { 2020-09-01T23:07:43.511 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:40.005 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd dump --format=json , 2020-09-01T14:37:40.296 INFO:teuthology.orchestra.run.smithi141.stdout: , 2020-09-01T14:37:40.297 INFO:teuthology.orchestra.run.smithi141.stdout:{"epoch":101,"fsid":"b01533b7-eb64-4c69-a77b-81afe14e6ec6","created":"2020-09-01 14:34:48.210564","modified":"2020-09-01 14:37:31.955273","last_up_change":"2020-09-01 14:37:05.711181","last_in_change":"2020-09-01 14:34:57.693154","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-09-01 14:35:01.816445","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":28,"pg_placement_num":28,"pg_placement_num_target":28,"pg_num_target":28,"pg_num_pending":28,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"74","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"low_tier","create_time":"2020-09-01 14:35:19.604696","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2020-09-01 14:35:20.557567","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":46,"pg_placement_num":46,"pg_placement_num_target":46,"pg_num_target":46,"pg_num_pending":46,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"59","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"ad2190ac-ef12-4852-bbe2-ef34cfc93f8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6810","nonce":9569}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6811","nonce":9569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6816","nonce":9569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6813","nonce":9569}]},"public_addr":"172.21.15.141:6810/9569","cluster_addr":"172.21.15.141:6811/9569","heartbeat_back_addr":"172.21.15.141:6816/9569","heartbeat_front_addr":"172.21.15.141:6813/9569","state":["exists","up"]},{"osd":1,"uuid":"c4175e28-bb35-4f38-abbe-3b0b6c71bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6805","nonce":9570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6806","nonce":9570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6808","nonce":9570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6807","nonce":9570}]},"public_addr":"172.21.15.141:6805/9570","cluster_addr":"172.21.15.141:6806/9570","heartbeat_back_addr":"172.21.15.141:6808/9570","heartbeat_front_addr":"172.21.15.141:6807/9570","state":["exists","up"]},{"osd":2,"uuid":"f143c687-c20f-42d8-beba-5624b0a40a31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6809","nonce":9568}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6812","nonce":9568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6815","nonce":9568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6814","nonce":9568}]},"public_addr":"172.21.15.141:6809/9568","cluster_addr":"172.21.15.141:6812/9568","heartbeat_back_addr":"172.21.15.141:6815/9568","heartbeat_front_addr":"172.21.15.141:6814/9568","state":["exists","up"]},{"osd":3,"uuid":"ebf39121-d9db-4d23-9982-25531ed6b081","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6801","nonce":9567}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6802","nonce":9567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6804","nonce":9567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.141:6803","nonce":9567}]},"public_addr":"172.21.15.141:6801/9567","cluster_addr":"172.21.15.141:6802/9567","heartbeat_back_addr":"172.21.15.141:6804/9567","heartbeat_front_addr":"172.21.15.141:6803/9567","state":["exists","up"]},{"osd":4,"uuid":"0b327f3e-7dae-4356-aa2e-49f78d7a6810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6808","nonce":9744}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6810","nonce":9744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6813","nonce":9744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6812","nonce":9744}]},"public_addr":"172.21.15.58:6808/9744","cluster_addr":"172.21.15.58:6810/9744","heartbeat_back_addr":"172.21.15.58:6813/9744","heartbeat_front_addr":"172.21.15.58:6812/9744","state":["exists","up"]},{"osd":5,"uuid":"4f43aa54-96fe-468d-8957-28d797a0217d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":17,"up_from":79,"up_thru":80,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6804","nonce":12737}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6805","nonce":12737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6807","nonce":12737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6806","nonce":12737}]},"public_addr":"172.21.15.58:6804/12737","cluster_addr":"172.21.15.58:6805/12737","heartbeat_back_addr":"172.21.15.58:6807/12737","heartbeat_front_addr":"172.21.15.58:6806/12737","state":["exists","up"]},{"osd":6,"uuid":"81031507-bad8-4ecc-8fab-2cfd93f9d1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6809","nonce":9746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6811","nonce":9746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6815","nonce":9746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6814","nonce":9746}]},"public_addr":"172.21.15.58:6809/9746","cluster_addr":"172.21.15.58:6811/9746","heartbeat_back_addr":"172.21.15.58:6815/9746","heartbeat_front_addr":"172.21.15.58:6814/9746","state":["exists","up"]},{"osd":7,"uuid":"d421ee69-bd5a-4242-a37d-9df62e06d40d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6800","nonce":9747}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6801","nonce":9747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6803","nonce":9747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.58:6802","nonce":9747}]},"public_addr":"172.21.15.58:6800/9747","cluster_addr":"172.21.15.58:6801/9747","heartbeat_back_addr":"172.21.15.58:6803/9747","heartbeat_front_addr":"172.21.15.58:6802/9747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":5,"down_stamp":"2020-09-01 14:35:20.110432","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667199,"old_weight":0}],"pg_upmap":[{"pgid":"3.7","osds":[6,3]}],"pg_upmap_items":[{"pgid":"1.6","mappings":[{"from":6,"to":2}]}],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-09-01T23:07:43.514 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:37:45.950 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2020-09-01 14:37:15.958440 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 1.8 last_scrub_stamp 2020-09-01 14:37:05.369868 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=5, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) , 2020-09-01T14:37:45.951 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2020-09-01 14:37:12.980647 time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=12, tm_wday=1, tm_yday=245, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=9, tm_mday=1, tm_hour=14, tm_min=37, tm_sec=40, tm_wday=1, tm_yday=245, tm_isdst=0) 2020-09-01T23:07:43.515 WARNING:scrape:Ignoring malparsed backtrace: 2020-09-01T14:38:27.671 DEBUG:tasks.ceph.osd.3:waiting for process to exit , 2020-09-01T14:38:27.672 INFO:teuthology.orchestra.run:waiting for 300 , 2020-09-01T14:38:27.733 INFO:tasks.ceph.osd.3:Stopped 2020-09-01T23:07:43.516 WARNING:scrape:Ignoring malparsed backtrace: suppress = manager.__exit__(*exc_info) , File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ , next(self.gen) 2020-09-01T23:07:48.904 INFO:scrape:Found 8 distinct failure reasons 2020-09-01T23:07:48.912 INFO:scrape:Failure: {'Failure object was': {'smithi055.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} 2020-09-01T23:07:48.913 INFO:scrape:44 jobs 2020-09-01T23:07:48.914 INFO:scrape:suites intersection: [] 2020-09-01T23:07:48.914 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'cluster/{12-osds', 'clusters/9-mons', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/off', 'd-balancer/upmap', 'debug/mgr', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'msgr/random', 'msgr/simple', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/dashboard/{clusters/{2-node-mgr}', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/singleton-nomsgr/{all/balancer', 'rados/singleton-nomsgr/{all/cache-fs-trunc', 'rados/singleton-nomsgr/{all/ceph-kvstore-tool', 'rados/singleton-nomsgr/{all/full-tiering', 'rados/singleton/{all/ec-lost-unfound', 'rados/singleton/{all/mon-config', 'rados/singleton/{all/mon-config-key-caps', 'rados/singleton/{all/osd-recovery-incomplete', 'rados/standalone/{supported-random-distro$/{rhel_latest}', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'supported-random-distro$/{rhel_latest}', 'supported-random-distro$/{rhel_latest}}', 'tasks/dashboard}', 'tasks/failover}', 'tasks/workunits}', 'thrashers/careful', 'thrashers/default', 'thrashers/many', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'workloads/admin_socket_objecter_requests}', 'workloads/cache-agent-big}', 'workloads/cache-agent-small}', 'workloads/cache-pool-snaps-readproxy}', 'workloads/cache-pool-snaps}', 'workloads/cache-snaps}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}', 'workloads/erasure-code}', 'workloads/pool-snaps-few-objects}', 'workloads/rados_api_tests}', 'workloads/rados_mon_osdmap_prune}', 'workloads/radosbench-high-concurrency}', 'workloads/radosbench}', 'workloads/redirect_promote_tests}', 'workloads/redirect_set_object}', 'workloads/redirect}', 'workloads/set-chunks-read}', 'workloads/small-objects}', 'workloads/write_fadvise_dontneed}'] 2020-09-01T23:07:48.915 INFO:scrape: 2020-09-01T23:07:48.915 INFO:scrape:Failure: Command failed on smithi140 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic' 2020-09-01T23:07:48.916 INFO:scrape:3 jobs: ['5389766', '5390062', '5390063'] 2020-09-01T23:07:48.916 INFO:scrape:suites intersection: [] 2020-09-01T23:07:48.917 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/singleton-bluestore/{all/cephtool', 'rados/standalone/{supported-random-distro$/{rhel_latest}', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{rhel_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/radosbench-high-concurrency}', 'workloads/scrub}'] 2020-09-01T23:07:48.918 INFO:scrape: 2020-09-01T23:07:48.918 INFO:scrape:Failure: Test failure: test_pool_create (tasks.mgr.dashboard.test_pool.PoolTest) 2020-09-01T23:07:48.919 INFO:scrape:3 jobs: ['5389907', '5389778', '5390072'] 2020-09-01T23:07:48.919 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{clusters/{2-node-mgr}', 'tasks/dashboard}'] 2020-09-01T23:07:48.920 INFO:scrape:suites union: ['debug/mgr', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/filestore-xfs', 'rados/dashboard/{clusters/{2-node-mgr}', 'supported-random-distro$/{centos_latest}', 'supported-random-distro$/{rhel_latest}', 'tasks/dashboard}'] 2020-09-01T23:07:48.921 INFO:scrape: 2020-09-01T23:07:48.921 INFO:scrape:Failure: SSH connection to smithi016 was lost: 'uname -r' 2020-09-01T23:07:48.922 INFO:scrape:1 jobs: ['5390045'] 2020-09-01T23:07:48.922 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/off', 'msgr-failures/osd-delay', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/none', 'thrashosds-health', 'workloads/snaps-few-objects}'] 2020-09-01T23:07:48.923 INFO:scrape: 2020-09-01T23:07:48.923 INFO:scrape:Failure: failed to install new kernel version within timeout 2020-09-01T23:07:48.923 INFO:scrape:2 jobs: ['5390027', '5389272'] 2020-09-01T23:07:48.924 INFO:scrape:suites intersection: ['thrashosds-health}'] 2020-09-01T23:07:48.924 INFO:scrape:suites union: ['1-install/mimic', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-nautilus', '8-workload/{rbd-python', 'msgr-failures/many', 'msgr/random', 'objectstore/bluestore-stupid', 'rados', 'rados/singleton/{all/thrash-rados/{thrash-rados', 'rados/upgrade/mimic-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'rgw-swift', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-random-distro$/{centos_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'thrashosds-health}'] 2020-09-01T23:07:48.925 INFO:scrape: 2020-09-01T23:07:48.925 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --set_chunk --low_tier_pool low_tier --max-ops 4000 --objects 300 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 10 --op write_excl 50 --pool unique_pool_0' 2020-09-01T23:07:48.926 INFO:scrape:1 jobs: ['5389979'] 2020-09-01T23:07:48.927 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/upmap', 'msgr-failures/few', 'msgr/random', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/set-chunks-read}'] 2020-09-01T23:07:48.928 INFO:scrape: 2020-09-01T23:07:48.929 INFO:scrape:Failure: 'ssh_keyscan smithi016.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds 2020-09-01T23:07:48.929 INFO:scrape:1 jobs: ['5390054'] 2020-09-01T23:07:48.930 INFO:scrape: 2020-09-01T23:07:48.931 INFO:scrape:Timeout 6h running clone.client.0/qa/workunits/rados/test.sh 2020-09-01T23:07:48.931 INFO:scrape:1 jobs: ['5389344'] 2020-09-01T23:07:48.932 INFO:scrape:suites: ['clusters/{fixed-2', 'd-thrash/default/{default', 'msgr-failures/few', 'msgr/async', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/verify/{ceph', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}'] 2020-09-01T23:07:48.932 INFO:scrape: 2020-09-01T23:07:48.966 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/ failed: 10 dead: 46 running: 0 waiting: 0 queued: 0 passed: 458 Fail ================================================================= [5389272] rados/upgrade/mimic-x-singleton/{0-cluster/{openstack start} 1-install/mimic 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-nautilus 8-workload/{rbd-python rgw-swift snaps-many-objects} supported-random-distro$/{centos_latest} thrashosds-health} ----------------------------------------------------------------- time: 03:16:52 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389272/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389272/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=ecb4ea19bf2e4d60888b39e32d0e2651 failed to recover before timeout expired [5389344] rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 06:34:43 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389344/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389344/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=0a9f082b08b0422ea4ba4b6357115c4f Command failed (workunit test rados/test.sh) on smithi106 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=af0268dc910f84b47655e83a83ca54b6fb92dbaf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5389766] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389766/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389766/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=53ac0ea94c0545898b288077110fe12b Command failed on smithi140 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic' [5389778] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:38:14 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389778/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389778/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=4272f409371e4117b3f2a656d6a49559 Test failure: test_pool_create (tasks.mgr.dashboard.test_pool.PoolTest) [5389907] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:43:23 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389907/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389907/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=b7ab45d03f384c2ab6c7a4aaffab37b7 Test failure: test_pool_create (tasks.mgr.dashboard.test_pool.PoolTest) [5389979] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} ----------------------------------------------------------------- time: 00:08:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389979/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389979/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --set_chunk --low_tier_pool low_tier --max-ops 4000 --objects 300 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max- seconds 0 --op read 100 --op write 50 --op delete 10 --op write_excl 50 --pool unique_pool_0' [5390027] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/many msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390027/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390027/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=54c4ef1ac05a45beb74f13817374ebcd failed to install new kernel version within timeout [5390062] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} ----------------------------------------------------------------- time: 00:05:27 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390062/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390062/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=fd68cec1dd4d4a668843ad10fd62d50b Command failed on smithi124 with status 1: 'sudo yum -y install ceph- radosgw' [5390063] rados/standalone/{supported-random-distro$/{rhel_latest} workloads/scrub} ----------------------------------------------------------------- time: 00:05:10 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390063/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390063/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=3d02e13c1a974e8891235d75d5bc5504 Command failed on smithi133 with status 1: 'sudo yum -y install ceph- radosgw' [5390072] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:42:52 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390072/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390072/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=d9c3c40246c34d3c860c2384349cac67 Test failure: test_pool_create (tasks.mgr.dashboard.test_pool.PoolTest) Dead ================================================================= [5389242] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} ----------------------------------------------------------------- time: 00:02:10 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389242/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389242/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=65ad6d5f2f0f47b288580d2c606c09f9 {'Failure object was': {'smithi183.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389246] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest}} ----------------------------------------------------------------- time: 00:02:02 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389246/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389246/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=24ac3069b8934224b4a108f1cbe1d906 {'Failure object was': {'smithi049.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389250] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_latest} tasks/workunits} ----------------------------------------------------------------- time: 00:02:02 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389250/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389250/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=874371d18f64429191e54a731be5e0fc {'Failure object was': {'smithi050.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389260] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:02:13 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389260/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389260/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=8c426b45f87d48e09aa560cff5b5e67f {'Failure object was': {'smithi132.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389268] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{rhel_latest}} ----------------------------------------------------------------- time: 00:02:02 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389268/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389268/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=6d5d5f1eaf6447edb418e6b4a82f60f1 {'Failure object was': {'smithi017.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389276] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/set-chunks-read} ----------------------------------------------------------------- time: 00:02:03 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389276/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389276/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=5e70e3adc1dc459e9c5e47aa9026da5f {'Failure object was': {'smithi037.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389284] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} ----------------------------------------------------------------- time: 00:02:00 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389284/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389284/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=8889dd9bf4cf41778e754ca0ae866c74 {'Failure object was': {'smithi197.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389300] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:02:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389300/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389300/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=993f98be79f44ccea5b0af0e2a7c0ce6 {'Failure object was': {'smithi037.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389310] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:02:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389310/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389310/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=8e55e0db808a47e58671ea9021160811 {'Failure object was': {'smithi143.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389320] rados/singleton/{all/ec-lost-unfound msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest}} ----------------------------------------------------------------- time: 00:01:59 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389320/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389320/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=12594ebf44cc41c7af2846a573c0b531 {'Failure object was': {'smithi186.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389322] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} ----------------------------------------------------------------- time: 00:02:05 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389322/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389322/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=02ed9bfbf3fb48ab9b62fb30ca04d1e4 {'Failure object was': {'smithi033.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389328] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{rhel_latest}} ----------------------------------------------------------------- time: 00:01:59 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389328/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389328/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=41f32dae958d42a7ad6dd3bf76307f4e {'Failure object was': {'smithi143.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389346] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} ----------------------------------------------------------------- time: 00:02:00 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389346/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389346/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=52c81b3166124802be9b0ff04b527f84 {'Failure object was': {'smithi171.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389354] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps} ----------------------------------------------------------------- time: 00:02:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389354/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389354/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=eeb1bb338a68482b894fbead44a200d6 {'Failure object was': {'smithi093.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389374] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/redirect} ----------------------------------------------------------------- time: 00:02:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389374/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389374/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=5b0dc1118bb44bcca82f363ffabcc241 {'Failure object was': {'smithi160.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389384] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/set-chunks-read} ----------------------------------------------------------------- time: 00:02:12 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389384/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389384/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=f2b1ba31b4704fa8bfa0dd9e364b1b28 {'Failure object was': {'smithi044.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389393] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} ----------------------------------------------------------------- time: 00:02:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389393/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389393/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=dba7587a40b14e90b718e77e81df15d9 {'Failure object was': {'smithi039.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389397] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{rhel_latest}} ----------------------------------------------------------------- time: 00:01:57 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389397/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389397/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=dfca3b5a2d1645938664deb9dbe61938 {'Failure object was': {'smithi137.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389411] rados/standalone/{supported-random-distro$/{rhel_latest} workloads/erasure-code} ----------------------------------------------------------------- time: 00:01:57 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389411/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389411/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=c5ade900886c4d649c0d4d12c4015ef5 {'Failure object was': {'smithi137.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389425] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/simple objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} ----------------------------------------------------------------- time: 00:02:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389425/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389425/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=85c1397b29564706b37b99ef021f81bc {'Failure object was': {'smithi205.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389431] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:02:07 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389431/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389431/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=0c389cce42774a4d91233c66e2539db5 {'Failure object was': {'smithi038.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389433] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} ----------------------------------------------------------------- time: 00:02:02 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389433/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389433/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=9664285e000c4567a2fd581a8dbcc2e6 {'Failure object was': {'smithi201.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389443] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} ----------------------------------------------------------------- time: 00:02:03 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389443/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389443/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=2440747570c046c2a6915f965ba38a0e {'Failure object was': {'smithi081.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389445] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/set-chunks-read} ----------------------------------------------------------------- time: 00:02:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389445/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389445/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=883e418c5e20438a86632a8fb3910c19 {'Failure object was': {'smithi165.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389447] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_latest} thrashers/many workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:02:05 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389447/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389447/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=8c26fe553cc64976a6a8cf6fb63b0aaf {'Failure object was': {'smithi017.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389457] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_latest} tasks/failover} ----------------------------------------------------------------- time: 00:01:57 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389457/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389457/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=2e526c36ae394a6c89e6e8d11c405d38 {'Failure object was': {'smithi121.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389473] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} ----------------------------------------------------------------- time: 00:02:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389473/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389473/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=76e2a12c753a406c9b3c32f43f92bd48 {'Failure object was': {'smithi123.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389475] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{rhel_latest}} ----------------------------------------------------------------- time: 00:01:56 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389475/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389475/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=7d4ee17f0b03451198a420b82407ff25 {'Failure object was': {'smithi169.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389499] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/redirect} ----------------------------------------------------------------- time: 00:02:03 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389499/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389499/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=8b8e043f77ae48d1a6bb3e97d8144774 {'Failure object was': {'smithi039.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389503] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} ----------------------------------------------------------------- time: 00:01:57 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389503/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389503/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=a7d5c25535f74bfead584b25815f7bef {'Failure object was': {'smithi137.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389506] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/small-objects} ----------------------------------------------------------------- time: 00:02:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389506/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389506/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=4be0faf632eb47b888ad2676810c662e {'Failure object was': {'smithi201.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389510] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} ----------------------------------------------------------------- time: 00:02:02 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389510/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389510/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=ea3627e136e44d5b98d45e7370804dce {'Failure object was': {'smithi093.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389518] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:02:03 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389518/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389518/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=379fad7610fc49f8bbc577878d8fcde0 {'Failure object was': {'smithi135.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389526] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/cache-agent-small} ----------------------------------------------------------------- time: 00:02:04 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389526/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389526/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=20a3ad441421459c89e77562ff955d30 {'Failure object was': {'smithi032.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389532] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:01:59 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389532/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389532/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=3ceb84dc33b9432fbeb3ce08bedbc906 {'Failure object was': {'smithi138.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389548] rados/singleton/{all/mon-config-key-caps msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest}} ----------------------------------------------------------------- time: 00:01:58 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389548/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389548/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=679192c57c85442eae898ff990cbabfe {'Failure object was': {'smithi119.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389560] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} ----------------------------------------------------------------- time: 00:02:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389560/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389560/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=c0d9d7abf09b4ef793b9bb3ce7a671ec {'Failure object was': {'smithi049.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389612] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:02:02 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389612/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389612/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=9ab7d3915dcc4ddca89e0244a56e3e81 {'Failure object was': {'smithi142.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389614] rados/singleton/{all/mon-config msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest}} ----------------------------------------------------------------- time: 00:02:04 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389614/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389614/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=2f461eacb0c04561b6f87a0d766beee1 {'Failure object was': {'smithi066.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389635] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:02:07 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389635/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389635/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=b16e3d7672834290a19ca4a2efbf342c {'Failure object was': {'smithi116.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389664] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:02:09 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389664/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389664/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=c253d74302db4d78823a0fa370616ac8 {'Failure object was': {'smithi055.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389668] rados/singleton/{all/osd-recovery-incomplete msgr-failures/many msgr/simple objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest}} ----------------------------------------------------------------- time: 00:02:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389668/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389668/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=0582429e465f4db1bfec5d6b87979e56 {'Failure object was': {'smithi038.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389672] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/redirect} ----------------------------------------------------------------- time: 00:02:08 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389672/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389672/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=004119f17a9d4250adac195470ee722c {'Failure object was': {'smithi055.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5389676] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{rhel_latest}} ----------------------------------------------------------------- time: 00:02:02 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389676/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389676/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=b190efa2680a4736a8fa5f8e56eac669 {'Failure object was': {'smithi132.front.sepia.ceph.com': {'changed': False, 'results': [], 'rc': 1, 'invocation': {'module_args': {'lock_timeout': 30, 'update_cache': False, 'disable_excludes': 'None', 'exclude': [], 'allow_downgrade': False, 'disable_gpg_check': False, 'conf_file': 'None', 'use_backend': 'auto', 'state': 'latest', 'disablerepo': [], 'releasever': 'None', 'skip_broken': False, 'autoremove': False, 'download_dir': 'None', 'enable_plugin': [], 'installroot': '/', 'install_weak_deps': True, 'name': ['nagios-common', 'nrpe', 'nagios-plugins', 'nagios-plugins-load'], 'download_only': False, 'bugfix': False, 'list': 'None', 'install_repoquery': True, 'update_only': False, 'disable_plugin': [], 'enablerepo': ['epel'], 'security': False, 'validate_certs': True}}, 'msg': 'Error: requested datatype primary not available\\n', '_ansible_no_log': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teut hology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'epel')"} [5390045] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390045/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390045/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=d621a6c902fc46febc6af5db6104be85 SSH connection to smithi016 was lost: 'uname -r' [5390054] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390054/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390054/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=aed7b0d7c2b44657b198f78574eb7bd5 'ssh_keyscan smithi016.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds Pass ================================================================= [5389232] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:19:38 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389232/ [5389234] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/cache} time: 00:10:04 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389234/ [5389236] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:24:55 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389236/ [5389238] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:21:15 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389238/ [5389240] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:22:09 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389240/ [5389244] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 01:09:11 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389244/ [5389248] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:27 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389248/ [5389252] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect} time: 00:14:22 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389252/ [5389254] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:09:40 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389254/ [5389256] rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04}} time: 00:08:21 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389256/ [5389258] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389258/ [5389262] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_16.04}} time: 00:06:21 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389262/ [5389264] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_16.04}} time: 00:07:37 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389264/ [5389266] rados/singleton-flat/valgrind-leaks time: 00:15:16 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389266/ [5389270] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:07:26 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389270/ [5389274] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389274/ [5389278] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:20:36 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389278/ [5389280] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:25:45 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389280/ [5389282] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:12:13 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389282/ [5389286] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:20:22 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389286/ [5389288] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389288/ [5389290] rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-comp-lz4 openstack settings/optimized workloads/cosbench_64K_read_write} time: 00:15:53 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389290/ [5389292] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:22:48 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389292/ [5389294] rados/singleton/{all/dump-stuck msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04}} time: 00:07:19 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389294/ [5389296] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:20:44 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389296/ [5389298] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:20 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389298/ [5389302] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:26:21 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389302/ [5389304] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:13:11 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389304/ [5389306] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389306/ [5389308] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:24:31 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389308/ [5389312] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:30:10 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389312/ [5389314] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 01:09:11 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389314/ [5389316] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/redirect} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389316/ [5389318] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:17:16 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389318/ [5389324] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:11:16 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389324/ [5389326] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:23:00 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389326/ [5389330] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:22:10 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389330/ [5389332] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/random objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:11:40 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389332/ [5389334] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04} tasks/rados_striper} time: 00:07:07 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389334/ [5389336] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04} thrashers/force-sync-many workloads/rados_api_tests} time: 00:20:28 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389336/ [5389338] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389338/ [5389340] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:43 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389340/ [5389342] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/hammer backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} msgr-failures/osd-delay msgr/async rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:15:56 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389342/ [5389348] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:13:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389348/ [5389350] rados/singleton/{all/erasure-code-nonregression msgr-failures/few msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04}} time: 00:05:33 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389350/ [5389352] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:26:42 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389352/ [5389356] rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-comp-snappy openstack settings/optimized workloads/cosbench_64K_write} time: 00:15:21 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389356/ [5389358] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:06:31 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389358/ [5389360] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:23:35 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389360/ [5389362] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:20:15 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389362/ [5389364] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:14:44 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389364/ [5389366] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:24:15 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389366/ [5389368] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:21:15 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389368/ [5389370] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:26:14 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389370/ [5389372] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 01:11:24 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389372/ [5389376] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_latest}} time: 00:18:45 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389376/ [5389378] rados/singleton/{all/lost-unfound-delete msgr-failures/many msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_16.04}} time: 00:24:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389378/ [5389380] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389380/ [5389382] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:13:03 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389382/ [5389387] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:17:32 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389387/ [5389389] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_16.04} tasks/dashboard} time: 00:45:12 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389389/ [5389391] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:28:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389391/ [5389395] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:19:14 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389395/ [5389399] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:24:10 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389399/ [5389401] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:09:19 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389401/ [5389403] rados/singleton/{all/lost-unfound msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:23:16 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389403/ [5389405] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:31 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389405/ [5389407] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:12 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389407/ [5389409] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:26:59 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389409/ [5389413] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:20:05 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389413/ [5389415] rados/multimon/{clusters/6 msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:04:25 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389415/ [5389417] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:19:29 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389417/ [5389419] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04} tasks/rados_workunit_loadgen_big} time: 00:28:52 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389419/ [5389421] rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-comp-zlib openstack settings/optimized workloads/fio_4K_rand_read} time: 00:12:05 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389421/ [5389423] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:08:36 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389423/ [5389427] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:26:33 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389427/ [5389429] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389429/ [5389435] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 01:09:15 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389435/ [5389437] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/redirect} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389437/ [5389439] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:08:52 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389439/ [5389441] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:11:13 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389441/ [5389449] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:35 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389449/ [5389451] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:18:16 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389451/ [5389453] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:24:32 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389453/ [5389455] rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/random objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/lockdep} time: 00:08:50 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389455/ [5389459] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389459/ [5389461] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:21:17 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389461/ [5389463] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/jewel backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_16.04} msgr-failures/fastclose msgr/random rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:22:46 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389463/ [5389465] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:27:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389465/ [5389467] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389467/ [5389469] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:08:31 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389469/ [5389471] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:25:11 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389471/ [5389477] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:16:32 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389477/ [5389479] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:18:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389479/ [5389481] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389481/ [5389483] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:36:17 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389483/ [5389485] rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-comp-zstd openstack settings/optimized workloads/fio_4K_rand_rw} time: 00:13:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389485/ [5389487] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:21:18 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389487/ [5389489] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:27:50 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389489/ [5389491] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 01:16:10 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389491/ [5389493] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:04:28 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389493/ [5389495] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:17:57 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389495/ [5389497] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/many msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:14:49 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389497/ [5389500] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:14:50 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389500/ [5389504] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389504/ [5389508] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:24:28 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389508/ [5389512] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:12:29 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389512/ [5389514] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_16.04} tasks/dashboard} time: 00:45:14 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389514/ [5389516] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:15:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389516/ [5389520] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:08 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389520/ [5389522] rados/singleton/{all/mon-auth-caps msgr-failures/few msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:11:32 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389522/ [5389524] rados/multimon/{clusters/9 msgr-failures/many msgr/random no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} tasks/mon_clock_with_skews} time: 00:05:57 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389524/ [5389528] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:24:52 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389528/ [5389530] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:18:45 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389530/ [5389534] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{ubuntu_latest}} time: 00:04:08 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389534/ [5389536] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389536/ [5389538] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:26:47 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389538/ [5389540] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:18:09 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389540/ [5389542] rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-hybrid openstack settings/optimized workloads/fio_4M_rand_read} time: 00:07:34 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389542/ [5389544] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:43:20 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389544/ [5389546] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/random objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 01:06:58 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389546/ [5389550] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/one workloads/rados_mon_workunits} time: 00:30:23 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389550/ [5389552] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:53 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389552/ [5389554] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:08:07 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389554/ [5389556] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/simple objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/redirect} time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389556/ [5389558] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:08:25 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389558/ [5389562] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:15:55 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389562/ [5389564] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:15:51 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389564/ [5389566] rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/simple objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/valgrind} time: 00:25:33 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389566/ [5389568] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:19:40 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389568/ [5389570] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:27:24 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389570/ [5389572] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/simple objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:26:38 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389572/ [5389574] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:21:42 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389574/ [5389576] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:17:38 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389576/ [5389578] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:18:52 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389578/ [5389580] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_16.04} msgr-failures/few msgr/simple rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:00:11 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389580/ [5389582] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:29:32 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389582/ [5389584] rados/singleton/{all/mon-config-keys msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04}} time: 00:11:43 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389584/ [5389586] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:10:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389586/ [5389588] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:18:56 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389588/ [5389590] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:29:28 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389590/ [5389592] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:18:38 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389592/ [5389594] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:26:52 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389594/ [5389596] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:25:55 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389596/ [5389598] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache} time: 00:07:56 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389598/ [5389600] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/random objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:23:26 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389600/ [5389602] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/simple objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:19:10 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389602/ [5389604] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:26:32 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389604/ [5389606] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{ubuntu_16.04}} time: 00:05:37 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389606/ [5389608] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:35:04 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389608/ [5389610] rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-stupid openstack settings/optimized workloads/fio_4M_rand_rw} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389610/ [5389616] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:16:20 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389616/ [5389619] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389619/ [5389621] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/simple objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:08:52 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389621/ [5389623] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:17:45 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389623/ [5389625] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} thrashers/none thrashosds-health workloads/small-objects} time: 00:17:05 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389625/ [5389627] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:24:57 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389627/ [5389629] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:17:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389629/ [5389631] rados/multimon/{clusters/21 msgr-failures/few msgr/simple no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:20:16 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389631/ [5389633] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:22:40 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389633/ [5389637] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:20:27 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389637/ [5389639] rados/singleton/{all/osd-backfill msgr-failures/few msgr/random objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04}} time: 00:11:25 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389639/ [5389641] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:27:05 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389641/ [5389643] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:15:56 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389643/ [5389644] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} tasks/readwrite} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389644/ [5389646] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:17:19 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389646/ [5389648] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_16.04} tasks/dashboard} time: 00:45:16 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389648/ [5389650] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:31:00 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389650/ [5389652] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:21:09 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389652/ [5389654] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_16.04} tasks/module_selftest} time: 00:23:50 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389654/ [5389656] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache} time: 00:08:29 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389656/ [5389658] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:24:37 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389658/ [5389660] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} time: 00:23:58 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389660/ [5389662] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:28 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389662/ [5389666] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:24:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389666/ [5389670] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:09:54 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389670/ [5389674] rados/perf/{ceph distros/ubuntu_latest objectstore/filestore-xfs openstack settings/optimized workloads/fio_4M_rand_write} time: 00:10:24 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389674/ [5389678] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:19:34 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389678/ [5389680] rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/lockdep} time: 00:16:45 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389680/ [5389682] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:11:27 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389682/ [5389684] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:26:48 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389684/ [5389686] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:18:34 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389686/ [5389688] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/small-objects} time: 00:21:30 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389688/ [5389690] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:28:55 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389690/ [5389692] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389692/ [5389694] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:22:34 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389694/ [5389696] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/hammer backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{centos_latest} msgr-failures/osd-delay msgr/async-v1only rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:15:31 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389696/ [5389698] rados/singleton/{all/osd-recovery msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:08:59 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389698/ [5389700] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:18:19 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389700/ [5389702] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:10:50 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389702/ [5389704] rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc} time: 00:28:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389704/ [5389705] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:16:33 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389705/ [5389707] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:22:29 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389707/ [5389710] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:21:15 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389710/ [5389712] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389712/ [5389714] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:27:59 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389714/ [5389716] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_latest}} time: 02:41:28 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389716/ [5389717] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/repair_test} time: 00:19:46 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389717/ [5389720] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:23:45 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389720/ [5389722] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:46:27 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389722/ [5389724] rados/singleton/{all/peer msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest}} time: 00:10:13 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389724/ [5389726] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:00:12 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389726/ [5389728] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/random objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:15:09 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389728/ [5389730] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:11:38 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389730/ [5389732] rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-bitmap openstack settings/optimized workloads/radosbench_4K_rand_read} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389732/ [5389734] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:10:42 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389734/ [5389736] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:13:02 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389736/ [5389738] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{ubuntu_latest}} time: 00:06:44 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389738/ [5389740] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v1only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} tasks/mon_clock_no_skews} time: 00:05:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389740/ [5389742] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/small-objects} time: 00:22:05 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389742/ [5389744] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/random objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:25:24 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389744/ [5389746] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:26 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389746/ [5389748] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:18 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389748/ [5389750] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/simple objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389750/ [5389752] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{centos_latest} tasks/orchestrator_cli} time: 00:13:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389752/ [5389754] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:21:29 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389754/ [5389756] rados/singleton/{all/pg-autoscaler msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:12:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389756/ [5389758] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:15:04 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389758/ [5389760] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389760/ [5389762] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:18:55 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389762/ [5389764] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} thrashers/sync workloads/snaps-few-objects} time: 00:28:34 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389764/ [5389768] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:42 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389768/ [5389770] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:50 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389770/ [5389772] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:27:22 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389772/ [5389774] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:24:27 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389774/ [5389776] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/cache} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389776/ [5389780] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:21:55 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389780/ [5389782] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:18:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389782/ [5389784] rados/singleton/{all/pg-removal-interruption msgr-failures/many msgr/random objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest}} time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389784/ [5389786] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:25:48 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389786/ [5389788] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:10:44 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389788/ [5389790] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 01:21:09 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389790/ [5389792] rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/valgrind} time: 00:35:44 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389792/ [5389794] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389794/ [5389796] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:10:36 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389796/ [5389798] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rgw_snaps} time: 00:15:21 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389798/ [5389800] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389800/ [5389802] rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-comp-lz4 openstack settings/optimized workloads/radosbench_4K_seq_read} time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389802/ [5389804] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:18:26 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389804/ [5389806] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/small-objects} time: 00:21:05 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389806/ [5389808] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:30:36 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389808/ [5389810] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{ubuntu_latest}} time: 00:05:29 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389810/ [5389812] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:11:58 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389812/ [5389814] rados/singleton/{all/radostool msgr-failures/few msgr/simple objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04}} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389814/ [5389816] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:18:31 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389816/ [5389818] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/jewel backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} msgr-failures/fastclose msgr/async rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:29:46 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389818/ [5389820] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/simple objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:22:10 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389820/ [5389822] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:16:27 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389822/ [5389824] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:23:55 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389824/ [5389826] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:23:08 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389826/ [5389828] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:26:30 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389828/ [5389830] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_16.04}} time: 00:05:16 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389830/ [5389832] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/cache} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389832/ [5389834] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:26:22 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389834/ [5389836] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:25:24 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389836/ [5389838] rados/singleton/{all/random-eio msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:23:08 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389838/ [5389840] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:36:54 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389840/ [5389842] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:17:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389842/ [5389844] rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon} time: 00:55:43 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389844/ [5389846] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/redirect} time: 00:11:43 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389846/ [5389848] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_latest} tasks/progress} time: 00:17:22 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389848/ [5389850] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:17:20 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389850/ [5389852] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} tasks/mon_clock_with_skews} time: 00:09:18 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389852/ [5389854] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:15:55 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389854/ [5389856] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:17:31 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389856/ [5389858] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:18 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389858/ [5389860] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:30 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389860/ [5389862] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/small-objects} time: 00:21:31 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389862/ [5389864] rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-comp-snappy openstack settings/optimized workloads/radosbench_4M_rand_read} time: 00:10:19 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389864/ [5389866] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:24:15 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389866/ [5389868] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:57 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389868/ [5389870] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_latest}} time: 00:14:33 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389870/ [5389872] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:08:26 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389872/ [5389874] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/pool-create-delete} time: 00:17:11 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389874/ [5389876] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:23:48 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389876/ [5389878] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:47 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389878/ [5389880] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:23:16 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389880/ [5389882] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{ubuntu_16.04}} time: 00:07:25 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389882/ [5389884] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:12:14 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389884/ [5389886] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:22:50 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389886/ [5389888] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:23:46 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389888/ [5389890] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:21:58 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389890/ [5389892] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/cache} time: 00:09:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389892/ [5389894] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:19:05 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389894/ [5389896] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:27:37 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389896/ [5389898] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:21:58 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389898/ [5389901] rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04}} time: 00:13:20 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389901/ [5389902] rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/lockdep} time: 00:08:35 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389902/ [5389905] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:35:35 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389905/ [5389909] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:19:38 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389909/ [5389911] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:15:03 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389911/ [5389913] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389913/ [5389915] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:14:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389915/ [5389917] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:16:42 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389917/ [5389919] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/small-objects} time: 00:21:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389919/ [5389921] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:27:13 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389921/ [5389923] rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-comp-zlib openstack settings/optimized workloads/radosbench_4M_seq_read} time: 00:07:43 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389923/ [5389925] rados/singleton/{all/resolve_stuck_peering msgr-failures/few msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_latest}} time: 00:11:12 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389925/ [5389927] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:56 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389927/ [5389929] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:19:24 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389929/ [5389931] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{centos_latest} msgr-failures/few msgr/random rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:15:07 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389931/ [5389933] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:31:00 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389933/ [5389935] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} time: 00:37:39 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389935/ [5389937] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} time: 00:18:18 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389937/ [5389939] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:15:43 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389939/ [5389941] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:16:25 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389941/ [5389943] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/random objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:21:11 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389943/ [5389945] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_latest}} time: 00:09:03 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389945/ [5389947] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{rhel_latest}} time: 00:11:54 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389947/ [5389949] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/simple objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:20:56 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389949/ [5389951] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_latest} tasks/rados_api_tests} time: 00:25:20 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389951/ [5389953] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} tasks/prometheus} time: 00:12:57 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389953/ [5389955] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389955/ [5389957] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:23:15 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389957/ [5389959] rados/singleton/{all/test-crash msgr-failures/many msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest}} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389959/ [5389961] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:33:15 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389961/ [5389963] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:22:43 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389963/ [5389965] rados/multimon/{clusters/9 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_latest} tasks/mon_recovery} time: 00:17:09 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389965/ [5389967] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/simple objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:03:17 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389967/ [5389969] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:14:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389969/ [5389971] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389971/ [5389973] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:09:53 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389973/ [5389975] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:22 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389975/ [5389977] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:17 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389977/ [5389981] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/many workloads/rados_5925} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389981/ [5389983] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:14 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389983/ [5389985] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/small-objects} time: 00:22:12 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389985/ [5389986] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:25:31 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389986/ [5389987] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389987/ [5389988] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:37 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389988/ [5389989] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:19:58 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389989/ [5389990] rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-comp-zstd openstack settings/optimized workloads/radosbench_4M_write} time: 00:08:03 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389990/ [5389991] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:17:16 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389991/ [5389992] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 02:50:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389992/ [5389993] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:14:56 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389993/ [5389994] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:15:53 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389994/ [5389995] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:22:12 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389995/ [5389996] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:28:43 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389996/ [5389997] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:23:44 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389997/ [5389998] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/cache} time: 00:15:34 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389998/ [5389999] rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/random objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} time: 01:00:48 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5389999/ [5390000] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:24:51 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390000/ [5390001] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{ubuntu_16.04}} time: 00:21:50 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390001/ [5390002] rados/singleton/{all/thrash-backfill-full msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 01:03:05 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390002/ [5390003] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:25:02 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390003/ [5390004] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:42:36 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390004/ [5390005] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/radosbench} time: 00:56:43 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390005/ [5390006] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} tasks/rados_cls_all} time: 00:14:07 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390006/ [5390007] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:09:15 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390007/ [5390008] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:17:40 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390008/ [5390009] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_latest} tasks/dashboard} time: 00:49:36 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390009/ [5390010] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390010/ [5390011] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:18:38 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390011/ [5390012] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/small-objects} time: 00:22:15 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390012/ [5390013] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/fastclose msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:26:24 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390013/ [5390014] rados/singleton/{all/thrash-eio msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:27:12 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390014/ [5390015] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/few msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390015/ [5390016] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/ssh_orchestrator} time: 00:05:37 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390016/ [5390017] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:20:52 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390017/ [5390018] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/hammer backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_16.04} msgr-failures/few msgr/async-v1only rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:31:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390018/ [5390019] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:20:22 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390019/ [5390020] rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-hybrid openstack settings/optimized workloads/sample_fio} time: 00:09:18 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390020/ [5390021] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:14:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390021/ [5390022] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_16.04}} time: 00:28:50 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390022/ [5390023] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:35:54 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390023/ [5390024] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:17:10 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390024/ [5390025] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:23:50 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390025/ [5390026] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache} time: 00:13:22 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390026/ [5390028] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:28:16 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390028/ [5390029] rados/multimon/{clusters/21 msgr-failures/few msgr/random no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:15 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390029/ [5390030] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:18:24 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390030/ [5390031] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:46:36 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390031/ [5390032] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{ubuntu_16.04}} time: 00:20:18 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390032/ [5390033] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/radosbench} time: 01:04:36 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390033/ [5390034] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_api_tests} time: 00:26:51 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390034/ [5390035] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390035/ [5390036] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:16:22 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390036/ [5390037] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:47 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390037/ [5390038] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:58 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390038/ [5390039] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390039/ [5390040] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390040/ [5390041] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390041/ [5390042] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:22:55 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390042/ [5390043] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390043/ [5390044] rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/few msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest}} time: 00:21:31 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390044/ [5390046] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:15 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390046/ [5390047] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:27:32 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390047/ [5390048] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:23:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390048/ [5390049] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:18:04 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390049/ [5390050] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:23:15 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390050/ [5390051] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:26:39 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390051/ [5390052] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390052/ [5390053] rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-stupid openstack settings/optimized workloads/sample_radosbench} time: 00:08:37 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390053/ [5390055] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:20:19 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390055/ [5390056] rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/simple objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:09:04 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390056/ [5390057] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/random objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:19:20 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390057/ [5390058] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/simple objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/cache} time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390058/ [5390059] rados/singleton/{all/watch-notify-same-primary msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest}} time: 00:10:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390059/ [5390060] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:28:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390060/ [5390061] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:20:52 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390061/ [5390064] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/random objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench} time: 00:38:55 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390064/ [5390065] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/simple objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390065/ [5390066] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:10:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390066/ [5390067] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_latest} tasks/workunits} time: 00:10:08 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390067/ [5390068] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{centos_latest}} time: 00:09:44 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390068/ [5390069] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:11:22 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390069/ [5390070] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:16:20 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390070/ [5390071] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:18:58 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390071/ [5390073] rados/singleton/{all/admin-socket msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:04:34 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390073/ [5390074] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:26:06 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390074/ [5390075] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:17:13 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390075/ [5390076] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:19:32 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390076/ [5390077] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/jewel backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_16.04} msgr-failures/osd-delay msgr/async rados thrashers/default thrashosds-health workloads/radosbench} time: 00:44:17 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390077/ [5390078] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:19:41 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390078/ [5390079] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_latest}} time: 04:59:20 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390079/ [5390080] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:10:11 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390080/ [5390081] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:13:58 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390081/ [5390082] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:19:11 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390082/ [5390083] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:17:08 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390083/ [5390084] rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-bitmap openstack settings/optimized workloads/cosbench_64K_read_write} time: 00:13:40 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390084/ [5390085] rados/multimon/{clusters/3 msgr-failures/many msgr/simple no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:04:26 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390085/ [5390086] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:22:22 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390086/ [5390087] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/cache} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390087/ [5390088] rados/singleton/{all/deduptool msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:05:22 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390088/ [5390089] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:31:27 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390089/ [5390090] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:37:02 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390090/ [5390091] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:37 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390091/ [5390092] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:23:52 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390092/ [5390093] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:45:54 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390093/ [5390094] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:07:52 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390094/ [5390095] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:00 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390095/ [5390096] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench} time: 00:57:50 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390096/ [5390097] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:14:46 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390097/ [5390098] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:15:30 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390098/ [5390099] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:11:38 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390099/ [5390100] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:13:18 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390100/ [5390101] rados/singleton/{all/divergent_priors msgr-failures/few msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest}} time: 00:11:27 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390101/ [5390102] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:23:16 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390102/ [5390103] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:19:04 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390103/ [5390104] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{ubuntu_16.04}} time: 00:25:55 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390104/ [5390105] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:25:29 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390105/ [5390106] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:32 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390106/ [5390107] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:22:37 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390107/ [5390108] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:21:42 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390108/ [5390109] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390109/ [5390110] rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} time: 00:25:13 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390110/ [5390111] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:24:00 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390111/ [5390112] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:23:27 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390112/ [5390113] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:24:29 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390113/ [5390114] rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-comp-lz4 openstack settings/optimized workloads/cosbench_64K_write} time: 00:15:55 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390114/ [5390115] rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04}} time: 00:08:07 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390115/ [5390116] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache} time: 00:15:36 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390116/ [5390117] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:07:01 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390117/ [5390118] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:31:21 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390118/ [5390119] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:05:51 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390119/ [5390120] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:21:34 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390120/ [5390121] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/random objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:42:40 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390121/ [5390122] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/simple objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/radosbench} time: 00:38:31 info: http://pulpito.ceph.com/teuthology-2020-08-30_02:30:02-rados-nautilus-distro-basic-smithi/5390122/