2021-04-17T06:08:18.204 INFO:root:teuthology version: 1.1.0-2713a3cd 2021-04-17T06:08:18.207 INFO:teuthology.results:subset: '6982/99999' 2021-04-17T06:08:18.207 INFO:teuthology.results:seed: '5567' 2021-04-17T09:15:36.642 INFO:root:teuthology version: 1.1.0-2713a3cd 2021-04-17T09:15:36.699 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-04-17T17:00:46.109 INFO:teuthology.results:Tests finished! gathering results... 2021-04-17T17:01:05.411 INFO:scrape:Found 176 jobs 2021-04-17T17:01:06.085 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.0-22-gef44fe1c (ef44fe1c828ef54c784bf132acaac3a2e6b8c272) pacific (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14e) [0x7f67ea9b3d8f] , 2: /usr/lib/ceph/libceph-common.so.2(+0x2dff79) [0x7f67ea9b3f79] 2021-04-17T17:01:06.086 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.848 INFO:teuthology.orchestra.run.smithi109.stdout: "events": [ , 2021-04-17T06:31:53.848 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.849 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "initiated", 2021-04-17T17:01:06.087 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.882 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:53.882 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.882 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "header_read", 2021-04-17T17:01:06.087 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.915 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:53.915 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.916 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "dispatched", 2021-04-17T17:01:06.089 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.949 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:53.949 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.950 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "reached_pg", 2021-04-17T17:01:06.090 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.984 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:53.984 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.984 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "started", 2021-04-17T17:01:06.090 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.018 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.018 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:54.018 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "sub_op_commit_rec", 2021-04-17T17:01:06.091 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.052 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.052 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:54.053 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "commit_sent", 2021-04-17T17:01:06.091 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.089 INFO:teuthology.orchestra.run.smithi109.stdout: } , 2021-04-17T06:31:54.090 INFO:teuthology.orchestra.run.smithi109.stdout: ] , 2021-04-17T06:31:54.090 INFO:teuthology.orchestra.run.smithi109.stdout: } 2021-04-17T17:01:06.092 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.123 INFO:teuthology.orchestra.run.smithi109.stdout: "flag_point": "commit sent; apply or cleanup", , 2021-04-17T06:31:54.123 INFO:teuthology.orchestra.run.smithi109.stdout: "client_info": { , 2021-04-17T06:31:54.123 INFO:teuthology.orchestra.run.smithi109.stdout: "client": "client.4776", 2021-04-17T17:01:06.093 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.156 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0 , 2021-04-17T06:31:54.156 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.157 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:06.093 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.189 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 1.0246e-05 , 2021-04-17T06:31:54.190 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.190 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:06.094 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.222 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 1.1851999999999999e-05 , 2021-04-17T06:31:54.222 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.223 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:06.095 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.255 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 3.8111000000000002e-05 , 2021-04-17T06:31:54.255 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.256 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:06.095 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.290 INFO:teuthology.orchestra.run.smithi109.stdout: "type_data": { , 2021-04-17T06:31:54.290 INFO:teuthology.orchestra.run.smithi109.stdout: "flag_point": "commit sent; apply or cleanup", , 2021-04-17T06:31:54.291 INFO:teuthology.orchestra.run.smithi109.stdout: "client_info": { 2021-04-17T17:01:06.096 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.328 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:45.718656+0000", , 2021-04-17T06:31:54.328 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 6.3400000000000003e-06 , 2021-04-17T06:31:54.329 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.096 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.361 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:12.002652+0000", , 2021-04-17T06:31:54.361 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.00043246199999999999 , 2021-04-17T06:31:54.361 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.097 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.394 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:17.057080+0000", , 2021-04-17T06:31:54.394 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.00077451899999999999 , 2021-04-17T06:31:54.394 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.098 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.426 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:31.851523+0000", , 2021-04-17T06:31:54.426 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 3.3130000000000003e-05 , 2021-04-17T06:31:54.427 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.098 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.845 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.00039110700000000002 , 2021-04-17T06:31:54.846 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.846 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:06.099 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.885 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 3.5151999999999998e-05 , 2021-04-17T06:31:54.885 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.886 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:06.100 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.921 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:54.922 INFO:teuthology.orchestra.run.smithi109.stdout: "description": "osd_op(client.4776.0:19865 4.1e 4:7fa955a7:::rbd_header.12a8bfce7101:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e166)", , 2021-04-17T06:31:54.922 INFO:teuthology.orchestra.run.smithi109.stdout: "initiated_at": "2021-04-17T06:28:38.765063+0000", 2021-04-17T17:01:06.100 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.955 INFO:teuthology.orchestra.run.smithi109.stdout: "tid": 20898 , 2021-04-17T06:31:54.956 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.956 INFO:teuthology.orchestra.run.smithi109.stdout: "events": [ 2021-04-17T17:01:06.101 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.988 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:28:59.824608+0000", , 2021-04-17T06:31:54.989 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 1.0406e-05 , 2021-04-17T06:31:54.989 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.101 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.020 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:09.933663+0000", , 2021-04-17T06:31:55.021 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 1.6858999999999999e-05 , 2021-04-17T06:31:55.021 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.102 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.052 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:10.933518+0000", , 2021-04-17T06:31:55.052 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 5.8764999999999997e-05 , 2021-04-17T06:31:55.053 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.103 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.084 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:24.107514+0000", , 2021-04-17T06:31:55.084 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.011463449000000001 , 2021-04-17T06:31:55.084 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.103 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.115 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "throttled", , 2021-04-17T06:31:55.116 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:34.389436+0000", , 2021-04-17T06:31:55.116 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 6.5250000000000002e-06 2021-04-17T17:01:06.104 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.147 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "op must wait for map", , 2021-04-17T06:31:55.147 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:35.410587+0000", , 2021-04-17T06:31:55.147 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.0037283020000000002 2021-04-17T17:01:06.105 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.178 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "started", , 2021-04-17T06:31:55.179 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:44.664231+0000", , 2021-04-17T06:31:55.179 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.006311489 2021-04-17T17:01:06.105 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.210 INFO:teuthology.orchestra.run.smithi109.stdout: "client": "client.4607", , 2021-04-17T06:31:55.210 INFO:teuthology.orchestra.run.smithi109.stdout: "client_addr": "172.21.15.104:0/672963026", , 2021-04-17T06:31:55.210 INFO:teuthology.orchestra.run.smithi109.stdout: "tid": 63160 2021-04-17T17:01:06.106 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.241 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.242 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "throttled", , 2021-04-17T06:31:55.242 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:05.935836+0000", 2021-04-17T17:01:06.107 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.273 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.273 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "all_read", , 2021-04-17T06:31:55.273 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:06.961140+0000", 2021-04-17T17:01:06.107 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.304 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.305 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "queued_for_pg", , 2021-04-17T06:31:55.305 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:07.972039+0000", 2021-04-17T17:01:06.108 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.336 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.336 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "op must wait for map", , 2021-04-17T06:31:55.336 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:10.833952+0000", 2021-04-17T17:01:06.108 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.367 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.367 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "started", , 2021-04-17T06:31:55.368 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:22.115085+0000", 2021-04-17T17:01:06.122 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:29:48.763787+0000", , 2021-04-17T06:31:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019747636999999998 , 2021-04-17T06:31:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: } 2021-04-17T17:01:06.123 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", , 2021-04-17T06:31:55.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:29:48.964358+0000", , 2021-04-17T06:31:55.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2252000000000001e-05 2021-04-17T17:01:06.124 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.864 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:55.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", , 2021-04-17T06:31:55.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:30:06.973206+0000", 2021-04-17T17:01:06.125 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.902 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:55.902 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", , 2021-04-17T06:31:55.903 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:30:10.848197+0000", 2021-04-17T17:01:06.125 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.941 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2021-04-17T06:30:10.873976+0000", , 2021-04-17T06:31:55.942 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 104.89220493800001, , 2021-04-17T06:31:55.942 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016288229999999999, 2021-04-17T17:01:06.126 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:55.980 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:55.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2021-04-17T17:01:06.126 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:56.019 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:56.020 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2021-04-17T17:01:06.127 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.058 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:56.059 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:56.059 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2021-04-17T17:01:06.128 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.100 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4607.0:63425 20.6 20:63ef7e0b:::rbd_object_map.11ff9528d5a3:head [delete] snapc 0=[] ondisk+write+known_if_redirected e257)", , 2021-04-17T06:31:56.101 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2021-04-17T06:30:10.932555+0000", , 2021-04-17T06:31:56.101 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 104.833626302, 2021-04-17T17:01:06.128 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.142 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3739999999999997e-06 , 2021-04-17T06:31:56.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:56.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2021-04-17T17:01:06.129 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00031178100000000002 , 2021-04-17T06:31:56.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:56.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2021-04-17T17:01:06.130 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.229 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:56.229 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4776.0:27001 20.4 20:27ca6743:::rbd_id.image167:head [delete] snapc 0=[] ondisk+write+known_if_redirected e263)", , 2021-04-17T06:31:56.229 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2021-04-17T06:30:17.117900+0000", 2021-04-17T17:01:06.130 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:30:17.145840+0000", , 2021-04-17T06:31:56.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2880000000000003e-06 , 2021-04-17T06:31:56.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2021-04-17T17:01:06.131 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:30:17.155184+0000", , 2021-04-17T06:31:56.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000114579 , 2021-04-17T06:31:56.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2021-04-17T17:01:06.132 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:58.113 INFO:tasks.ceph.osd.0:Started , 2021-04-17T06:31:58.113 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight , nodeep-scrub is unset 2021-04-17T17:01:06.142 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:25.836 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":330,"fsid":"8a3376dc-fed9-4752-8f22-e17f3c108376","created":"2021-04-17T06:25:08.928630+0000","modified":"2021-04-17T06:32:25.180703+0000","last_up_change":"2021-04-17T06:32:08.956870+0000","last_in_change":"2021-04-17T06:31:39.909648+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-04-17T06:25:18.055633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-04-17T06:25:19.887069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"21","last_force_op_resend_prenautilus":"21","last_force_op_resend_preluminous":"21","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2021-04-17T06:25:29.581351+0000","flags":9,"flags_names":"hashpspool,incomplete_clones","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"21","last_force_op_resend_prenautilus":"21","last_force_op_resend_preluminous":"21","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"test-librbd-smithi104-24519-2","create_time":"2021-04-17T06:26:21.397665+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":51,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":6,"pool_name":"test-librbd-smithi104-24519-3","create_time":"2021-04-17T06:26:24.988207+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":55,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":7,"pool_name":"test-librbd-smithi104-24519-4","create_time":"2021-04-17T06:26:28.888126+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":59,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":8,"pool_name":"test-librbd-smithi104-24519-5","create_time":"2021-04-17T06:26:33.346843+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":63,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":9,"pool_name":"test-librbd-smithi104-24519-6","create_time":"2021-04-17T06:26:37.297373+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":7,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":10,"pool_name":"test-librbd-smithi104-24519-7","create_time":"2021-04-17T06:26:44.947343+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":11,"pool_name":"test-librbd-smithi104-24519-8","create_time":"2021-04-17T06:27:44.594299+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":12,"pool_name":"test-librbd-smithi104-24519-9","create_time":"2021-04-17T06:28:06.471554+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":144,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":13,"pool_name":"test-librbd-smithi104-24519-10","create_time":"2021-04-17T06:28:08.359230+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":142,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":14,"pool_name":"test-librbd-smithi104-24519-11","create_time":"2021-04-17T06:28:16.954901+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"162","last_force_op_resend_prenautilus":"162","last_force_op_resend_preluminous":"162","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":161,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":15,"pool_name":"test-librbd-smithi104-24519-12","create_time":"2021-04-17T06:28:18.840077+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":159,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":16,"pool_name":"test-librbd-smithi104-24519-13","create_time":"2021-04-17T06:28:20.844060+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"162","last_force_op_resend_prenautilus":"162","last_force_op_resend_preluminous":"162","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":161,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":0,"cache_target_dirty_high_ratio_micro":0,"cache_target_full_ratio_micro":0,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":17,"pool_name":"test-librbd-smithi104-24519-14","create_time":"2021-04-17T06:29:35.785481+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"226","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":226,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":18,"pool_name":"test-librbd-smithi104-24519-15","create_time":"2021-04-17T06:29:40.769632+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"232","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":232,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":19,"pool_name":"test-librbd-smithi104-24519-16","create_time":"2021-04-17T06:29:46.938404+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"247","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":7,"snap_epoch":247,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":20,"pool_name":"test-librbd-smithi104-24519-17","create_time":"2021-04-17T06:30:00.984819+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"273","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":22,"snap_epoch":273,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"ab470f8c-d507-440a-a38e-e0def732094a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":279,"up_from":310,"up_thru":328,"down_at":280,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":72438},{"type":"v1","addr":"172.21.15.104:6809","nonce":72438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":72438},{"type":"v1","addr":"172.21.15.104:6811","nonce":72438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":72438},{"type":"v1","addr":"172.21.15.104:6815","nonce":72438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":72438},{"type":"v1","addr":"172.21.15.104:6813","nonce":72438}]},"public_addr":"172.21.15.104:6809/72438","cluster_addr":"172.21.15.104:6811/72438","heartbeat_back_addr":"172.21.15.104:6815/72438","heartbeat_front_addr":"172.21.15.104:6813/72438","state":["exists","up"]},{"osd":1,"uuid":"513fb047-78d2-4beb-84b4-12fccdfd4ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":187,"up_from":233,"up_thru":314,"down_at":188,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":50331},{"type":"v1","addr":"172.21.15.104:6801","nonce":50331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":50331},{"type":"v1","addr":"172.21.15.104:6803","nonce":50331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":50331},{"type":"v1","addr":"172.21.15.104:6807","nonce":50331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":50331},{"type":"v1","addr":"172.21.15.104:6805","nonce":50331}]},"public_addr":"172.21.15.104:6801/50331","cluster_addr":"172.21.15.104:6803/50331","heartbeat_back_addr":"172.21.15.104:6807/50331","heartbeat_front_addr":"172.21.15.104:6805/50331","state":["exists","up"]},{"osd":2,"uuid":"1549b7bd-b713-4af0-a445-122c9e74869a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":314,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":17970},{"type":"v1","addr":"172.21.15.104:6818","nonce":17970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":17970},{"type":"v1","addr":"172.21.15.104:6822","nonce":17970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6829","nonce":17970},{"type":"v1","addr":"172.21.15.104:6831","nonce":17970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":17970},{"type":"v1","addr":"172.21.15.104:6826","nonce":17970}]},"public_addr":"172.21.15.104:6818/17970","cluster_addr":"172.21.15.104:6822/17970","heartbeat_back_addr":"172.21.15.104:6831/17970","heartbeat_front_addr":"172.21.15.104:6826/17970","state":["exists","up"]},{"osd":3,"uuid":"1791ecee-8af7-49f5-b163-40b87b8e493b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":315,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":17967},{"type":"v1","addr":"172.21.15.104:6819","nonce":17967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":17967},{"type":"v1","addr":"172.21.15.104:6823","nonce":17967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":17967},{"type":"v1","addr":"172.21.15.104:6830","nonce":17967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":17967},{"type":"v1","addr":"172.21.15.104:6827","nonce":17967}]},"public_addr":"172.21.15.104:6819/17967","cluster_addr":"172.21.15.104:6823/17967","heartbeat_back_addr":"172.21.15.104:6830/17967","heartbeat_front_addr":"172.21.15.104:6827/17967","state":["exists","up"]},{"osd":4,"uuid":"a2c83886-f0fe-46f1-8d23-5d0cc0789f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":247,"up_from":314,"up_thru":315,"down_at":248,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":45629},{"type":"v1","addr":"172.21.15.109:6817","nonce":45629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":45629},{"type":"v1","addr":"172.21.15.109:6819","nonce":45629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":45629},{"type":"v1","addr":"172.21.15.109:6824","nonce":45629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":45629},{"type":"v1","addr":"172.21.15.109:6821","nonce":45629}]},"public_addr":"172.21.15.109:6817/45629","cluster_addr":"172.21.15.109:6819/45629","heartbeat_back_addr":"172.21.15.109:6824/45629","heartbeat_front_addr":"172.21.15.109:6821/45629","state":["exists","up"]},{"osd":5,"uuid":"4ae773d6-8875-40fa-8456-8d9055a2efd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":320,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6823","nonce":18092},{"type":"v1","addr":"172.21.15.109:6825","nonce":18092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":18092},{"type":"v1","addr":"172.21.15.109:6827","nonce":18092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":18092},{"type":"v1","addr":"172.21.15.109:6831","nonce":18092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":18092},{"type":"v1","addr":"172.21.15.109:6829","nonce":18092}]},"public_addr":"172.21.15.109:6825/18092","cluster_addr":"172.21.15.109:6827/18092","heartbeat_back_addr":"172.21.15.109:6831/18092","heartbeat_front_addr":"172.21.15.109:6829/18092","state":["exists","up"]},{"osd":6,"uuid":"ae2256a2-f5e1-4c42-bb8b-b0d167af36fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6800","nonce":18081},{"type":"v1","addr":"172.21.15.109:6801","nonce":18081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":18081},{"type":"v1","addr":"172.21.15.109:6803","nonce":18081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":18081},{"type":"v1","addr":"172.21.15.109:6807","nonce":18081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":18081},{"type":"v1","addr":"172.21.15.109:6805","nonce":18081}]},"public_addr":"172.21.15.109:6801/18081","cluster_addr":"172.21.15.109:6803/18081","heartbeat_back_addr":"172.21.15.109:6807/18081","heartbeat_front_addr":"172.21.15.109:6805/18081","state":["exists","up"]},{"osd":7,"uuid":"461d25cc-8851-443e-98d6-f07775462174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":314,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":18082},{"type":"v1","addr":"172.21.15.109:6809","nonce":18082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":18082},{"type":"v1","addr":"172.21.15.109:6811","nonce":18082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":18082},{"type":"v1","addr":"172.21.15.109:6815","nonce":18082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":18082},{"type":"v1","addr":"172.21.15.109:6813","nonce":18082}]},"public_addr":"172.21.15.109:6809/18082","cluster_addr":"172.21.15.109:6811/18082","heartbeat_back_addr":"172.21.15.109:6815/18082","heartbeat_front_addr":"172.21.15.109:6813/18082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.625755+0000","dead_epoch":280},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.573959+0000","dead_epoch":188},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.822291+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.880854+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.753434+0000","dead_epoch":248},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.725997+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.617296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.826670+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.1","osds":[6,0]},{"pgid":"7.f","osds":[2,5]},{"pgid":"9.1d","osds":[5,7]}],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:0/785442747":"2021-04-17T07:29:31.883250+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} , 2021-04-17T06:32:25.851 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats , 2021-04-17T06:32:26.027 INFO:teuthology.orchestra.run.smithi104.stdout:1331439861766 2021-04-17T17:01:06.147 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 4 to deep-scrub , 2021-04-17T06:32:36.837 INFO:tasks.ceph:Scrubbing osd.5 , 2021-04-17T06:32:36.837 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-04-17T17:01:06.147 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:38.941 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:38.942 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:38.943 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2021-04-17T06:28:08.735315+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=8, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.148 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:38.999 INFO:tasks.ceph:pgid 20.4 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:38.999 INFO:tasks.ceph:pgid 19.3 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.000 INFO:tasks.ceph:pgid 18.2 last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.149 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:39.047 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2021-04-17T06:26:37.717741+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.047 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2021-04-17T06:26:33.694914+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.048 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.150 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:39.091 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2021-04-17T06:26:25.816361+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.092 INFO:tasks.ceph:pgid 10.e last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.092 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.153 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:39.141 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2021-04-17T06:26:33.694914+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.141 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.141 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-04-17T06:25:20.019177+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=25, tm_sec=20, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.154 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.603 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.603 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2021-04-17T06:26:25.816361+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.604 INFO:tasks.ceph:pgid 10.12 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.154 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.652 INFO:tasks.ceph:pgid 16.2 last_scrub_stamp 2021-04-17T06:28:21.767917+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=21, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.652 INFO:tasks.ceph:pgid 20.5 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.653 INFO:tasks.ceph:pgid 19.2 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.155 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.700 INFO:tasks.ceph:pgid 10.1 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.701 INFO:tasks.ceph:pgid 11.0 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.701 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.156 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.749 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.750 INFO:tasks.ceph:pgid 10.e last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.750 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.160 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.802 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.803 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2021-04-17T06:26:25.816361+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.803 INFO:tasks.ceph:pgid 10.6 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.161 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:20.280 INFO:tasks.ceph:pgid 10.14 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.280 INFO:tasks.ceph:pgid 11.15 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.281 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.169 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:20.324 INFO:tasks.ceph:pgid 20.2 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.324 INFO:tasks.ceph:pgid 19.5 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.325 INFO:tasks.ceph:pgid 18.4 last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.170 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:20.374 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.375 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.375 INFO:tasks.ceph:pgid 20.1a last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.174 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:20.419 INFO:tasks.ceph:pgid 10.9 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.420 INFO:tasks.ceph:pgid 11.8 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.420 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.175 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:40.889 INFO:tasks.ceph:pgid 10.15 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.889 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.890 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.176 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:40.932 INFO:tasks.ceph:pgid 16.7 last_scrub_stamp 2021-04-17T06:28:21.767917+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=21, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.932 INFO:tasks.ceph:pgid 20.2 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.933 INFO:tasks.ceph:pgid 19.5 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.177 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:40.975 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.976 INFO:tasks.ceph:pgid 20.11 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.976 INFO:tasks.ceph:pgid 19.16 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.181 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:41.019 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:41.019 INFO:tasks.ceph:pgid 20.19 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:41.020 INFO:tasks.ceph:pgid 19.1e last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.181 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:01.479 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.479 INFO:tasks.ceph:pgid 13.1e last_scrub_stamp 2021-04-17T06:28:08.735315+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=8, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.480 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.182 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:01.524 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2021-04-17T06:28:08.735315+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=8, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.525 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.525 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.185 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:01.574 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.575 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.575 INFO:tasks.ceph:pgid 20.18 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.186 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:22.038 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:22.038 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:22.039 INFO:tasks.ceph:pgid 16.2 last_scrub_stamp 2021-04-17T06:28:21.767917+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=21, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.190 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:22.087 INFO:tasks.ceph:pgid 20.11 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:22.087 INFO:tasks.ceph:pgid 19.16 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:22.088 INFO:tasks.ceph:pgid 18.17 last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.190 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:42.544 INFO:tasks.ceph:pgid 19.b last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:42.544 INFO:tasks.ceph:pgid 18.a last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:42.545 INFO:tasks.ceph:pgid 17.9 last_scrub_stamp 2021-04-17T06:29:36.548387+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=36, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.194 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:42.590 INFO:tasks.ceph:pgid 17.1e last_scrub_stamp 2021-04-17T06:29:36.548387+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=36, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:42.590 INFO:tasks.ceph:pgid 16.1f last_scrub_stamp 2021-04-17T06:28:21.767917+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=21, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:42.591 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.197 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:35:03.056 INFO:tasks.ceph:pgid 18.1 last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:35:03.057 INFO:tasks.ceph:pgid 17.2 last_scrub_stamp 2021-04-17T06:29:36.548387+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=36, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:35:03.057 INFO:tasks.ceph:pgid 20.6 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.244 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:35:23.535 INFO:tasks.ceph:pgid 20.a last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:35:23.535 INFO:tasks.ceph:pgid 19.d last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:35:23.536 INFO:tasks.ceph:pgid 20.9 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.245 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:36:25.198 INFO:teuthology.orchestra.run:waiting for 300 , 2021-04-17T06:36:25.266 INFO:tasks.ceph.osd.0:Stopped , 2021-04-17T06:36:25.267 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-04-17T17:01:06.246 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:36:46.564 DEBUG:teuthology.run_tasks:Unwinding manager install , 2021-04-17T06:36:46.575 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... , 2021-04-17T06:36:46.576 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-04-17T17:01:06.585 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.0-22-gef44fe1c (ef44fe1c828ef54c784bf132acaac3a2e6b8c272) pacific (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14e) [0x7f67ea9b3d8f] , 2: /usr/lib/ceph/libceph-common.so.2(+0x2dff79) [0x7f67ea9b3f79] 2021-04-17T17:01:06.586 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.848 INFO:teuthology.orchestra.run.smithi109.stdout: "events": [ , 2021-04-17T06:31:53.848 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.849 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "initiated", 2021-04-17T17:01:06.586 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.882 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:53.882 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.882 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "header_read", 2021-04-17T17:01:06.587 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.915 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:53.915 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.916 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "dispatched", 2021-04-17T17:01:06.588 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.949 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:53.949 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.950 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "reached_pg", 2021-04-17T17:01:06.588 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.984 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:53.984 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.984 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "started", 2021-04-17T17:01:06.589 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.018 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.018 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:54.018 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "sub_op_commit_rec", 2021-04-17T17:01:06.590 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.052 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.052 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:54.053 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "commit_sent", 2021-04-17T17:01:06.590 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.089 INFO:teuthology.orchestra.run.smithi109.stdout: } , 2021-04-17T06:31:54.090 INFO:teuthology.orchestra.run.smithi109.stdout: ] , 2021-04-17T06:31:54.090 INFO:teuthology.orchestra.run.smithi109.stdout: } 2021-04-17T17:01:06.591 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.123 INFO:teuthology.orchestra.run.smithi109.stdout: "flag_point": "commit sent; apply or cleanup", , 2021-04-17T06:31:54.123 INFO:teuthology.orchestra.run.smithi109.stdout: "client_info": { , 2021-04-17T06:31:54.123 INFO:teuthology.orchestra.run.smithi109.stdout: "client": "client.4776", 2021-04-17T17:01:06.592 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.156 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0 , 2021-04-17T06:31:54.156 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.157 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:06.592 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.189 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 1.0246e-05 , 2021-04-17T06:31:54.190 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.190 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:06.593 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.222 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 1.1851999999999999e-05 , 2021-04-17T06:31:54.222 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.223 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:06.594 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.255 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 3.8111000000000002e-05 , 2021-04-17T06:31:54.255 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.256 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:06.594 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.290 INFO:teuthology.orchestra.run.smithi109.stdout: "type_data": { , 2021-04-17T06:31:54.290 INFO:teuthology.orchestra.run.smithi109.stdout: "flag_point": "commit sent; apply or cleanup", , 2021-04-17T06:31:54.291 INFO:teuthology.orchestra.run.smithi109.stdout: "client_info": { 2021-04-17T17:01:06.595 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.328 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:45.718656+0000", , 2021-04-17T06:31:54.328 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 6.3400000000000003e-06 , 2021-04-17T06:31:54.329 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.596 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.361 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:12.002652+0000", , 2021-04-17T06:31:54.361 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.00043246199999999999 , 2021-04-17T06:31:54.361 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.596 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.394 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:17.057080+0000", , 2021-04-17T06:31:54.394 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.00077451899999999999 , 2021-04-17T06:31:54.394 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.597 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.426 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:31.851523+0000", , 2021-04-17T06:31:54.426 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 3.3130000000000003e-05 , 2021-04-17T06:31:54.427 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.598 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.845 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.00039110700000000002 , 2021-04-17T06:31:54.846 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.846 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:06.598 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.885 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 3.5151999999999998e-05 , 2021-04-17T06:31:54.885 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.886 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:06.599 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.921 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:54.922 INFO:teuthology.orchestra.run.smithi109.stdout: "description": "osd_op(client.4776.0:19865 4.1e 4:7fa955a7:::rbd_header.12a8bfce7101:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e166)", , 2021-04-17T06:31:54.922 INFO:teuthology.orchestra.run.smithi109.stdout: "initiated_at": "2021-04-17T06:28:38.765063+0000", 2021-04-17T17:01:06.600 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.955 INFO:teuthology.orchestra.run.smithi109.stdout: "tid": 20898 , 2021-04-17T06:31:54.956 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.956 INFO:teuthology.orchestra.run.smithi109.stdout: "events": [ 2021-04-17T17:01:06.600 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.988 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:28:59.824608+0000", , 2021-04-17T06:31:54.989 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 1.0406e-05 , 2021-04-17T06:31:54.989 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.601 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.020 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:09.933663+0000", , 2021-04-17T06:31:55.021 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 1.6858999999999999e-05 , 2021-04-17T06:31:55.021 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.602 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.052 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:10.933518+0000", , 2021-04-17T06:31:55.052 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 5.8764999999999997e-05 , 2021-04-17T06:31:55.053 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.602 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.084 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:24.107514+0000", , 2021-04-17T06:31:55.084 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.011463449000000001 , 2021-04-17T06:31:55.084 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:06.603 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.115 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "throttled", , 2021-04-17T06:31:55.116 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:34.389436+0000", , 2021-04-17T06:31:55.116 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 6.5250000000000002e-06 2021-04-17T17:01:06.604 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.147 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "op must wait for map", , 2021-04-17T06:31:55.147 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:35.410587+0000", , 2021-04-17T06:31:55.147 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.0037283020000000002 2021-04-17T17:01:06.604 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.178 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "started", , 2021-04-17T06:31:55.179 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:44.664231+0000", , 2021-04-17T06:31:55.179 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.006311489 2021-04-17T17:01:06.605 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.210 INFO:teuthology.orchestra.run.smithi109.stdout: "client": "client.4607", , 2021-04-17T06:31:55.210 INFO:teuthology.orchestra.run.smithi109.stdout: "client_addr": "172.21.15.104:0/672963026", , 2021-04-17T06:31:55.210 INFO:teuthology.orchestra.run.smithi109.stdout: "tid": 63160 2021-04-17T17:01:06.606 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.241 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.242 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "throttled", , 2021-04-17T06:31:55.242 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:05.935836+0000", 2021-04-17T17:01:06.606 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.273 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.273 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "all_read", , 2021-04-17T06:31:55.273 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:06.961140+0000", 2021-04-17T17:01:06.607 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.304 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.305 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "queued_for_pg", , 2021-04-17T06:31:55.305 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:07.972039+0000", 2021-04-17T17:01:06.608 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.336 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.336 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "op must wait for map", , 2021-04-17T06:31:55.336 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:10.833952+0000", 2021-04-17T17:01:06.608 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.367 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.367 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "started", , 2021-04-17T06:31:55.368 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:22.115085+0000", 2021-04-17T17:01:06.609 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:29:48.763787+0000", , 2021-04-17T06:31:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019747636999999998 , 2021-04-17T06:31:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: } 2021-04-17T17:01:06.610 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", , 2021-04-17T06:31:55.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:29:48.964358+0000", , 2021-04-17T06:31:55.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2252000000000001e-05 2021-04-17T17:01:06.610 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.864 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:55.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", , 2021-04-17T06:31:55.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:30:06.973206+0000", 2021-04-17T17:01:06.611 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.902 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:55.902 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", , 2021-04-17T06:31:55.903 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:30:10.848197+0000", 2021-04-17T17:01:06.611 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.941 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2021-04-17T06:30:10.873976+0000", , 2021-04-17T06:31:55.942 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 104.89220493800001, , 2021-04-17T06:31:55.942 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016288229999999999, 2021-04-17T17:01:06.612 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:55.980 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:55.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2021-04-17T17:01:06.613 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:56.019 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:56.020 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2021-04-17T17:01:06.613 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.058 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:56.059 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:56.059 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2021-04-17T17:01:06.614 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.100 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4607.0:63425 20.6 20:63ef7e0b:::rbd_object_map.11ff9528d5a3:head [delete] snapc 0=[] ondisk+write+known_if_redirected e257)", , 2021-04-17T06:31:56.101 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2021-04-17T06:30:10.932555+0000", , 2021-04-17T06:31:56.101 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 104.833626302, 2021-04-17T17:01:06.615 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.142 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3739999999999997e-06 , 2021-04-17T06:31:56.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:56.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2021-04-17T17:01:06.615 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00031178100000000002 , 2021-04-17T06:31:56.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:56.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2021-04-17T17:01:06.616 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.229 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:56.229 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4776.0:27001 20.4 20:27ca6743:::rbd_id.image167:head [delete] snapc 0=[] ondisk+write+known_if_redirected e263)", , 2021-04-17T06:31:56.229 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2021-04-17T06:30:17.117900+0000", 2021-04-17T17:01:06.617 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:30:17.145840+0000", , 2021-04-17T06:31:56.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2880000000000003e-06 , 2021-04-17T06:31:56.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2021-04-17T17:01:06.617 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:30:17.155184+0000", , 2021-04-17T06:31:56.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000114579 , 2021-04-17T06:31:56.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2021-04-17T17:01:06.618 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:58.113 INFO:tasks.ceph.osd.0:Started , 2021-04-17T06:31:58.113 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight , nodeep-scrub is unset 2021-04-17T17:01:06.629 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:25.836 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":330,"fsid":"8a3376dc-fed9-4752-8f22-e17f3c108376","created":"2021-04-17T06:25:08.928630+0000","modified":"2021-04-17T06:32:25.180703+0000","last_up_change":"2021-04-17T06:32:08.956870+0000","last_in_change":"2021-04-17T06:31:39.909648+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-04-17T06:25:18.055633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-04-17T06:25:19.887069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"21","last_force_op_resend_prenautilus":"21","last_force_op_resend_preluminous":"21","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2021-04-17T06:25:29.581351+0000","flags":9,"flags_names":"hashpspool,incomplete_clones","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"21","last_force_op_resend_prenautilus":"21","last_force_op_resend_preluminous":"21","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"test-librbd-smithi104-24519-2","create_time":"2021-04-17T06:26:21.397665+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":51,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":6,"pool_name":"test-librbd-smithi104-24519-3","create_time":"2021-04-17T06:26:24.988207+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":55,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":7,"pool_name":"test-librbd-smithi104-24519-4","create_time":"2021-04-17T06:26:28.888126+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":59,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":8,"pool_name":"test-librbd-smithi104-24519-5","create_time":"2021-04-17T06:26:33.346843+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":63,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":9,"pool_name":"test-librbd-smithi104-24519-6","create_time":"2021-04-17T06:26:37.297373+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":7,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":10,"pool_name":"test-librbd-smithi104-24519-7","create_time":"2021-04-17T06:26:44.947343+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":11,"pool_name":"test-librbd-smithi104-24519-8","create_time":"2021-04-17T06:27:44.594299+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":12,"pool_name":"test-librbd-smithi104-24519-9","create_time":"2021-04-17T06:28:06.471554+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":144,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":13,"pool_name":"test-librbd-smithi104-24519-10","create_time":"2021-04-17T06:28:08.359230+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":142,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":14,"pool_name":"test-librbd-smithi104-24519-11","create_time":"2021-04-17T06:28:16.954901+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"162","last_force_op_resend_prenautilus":"162","last_force_op_resend_preluminous":"162","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":161,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":15,"pool_name":"test-librbd-smithi104-24519-12","create_time":"2021-04-17T06:28:18.840077+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":159,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":16,"pool_name":"test-librbd-smithi104-24519-13","create_time":"2021-04-17T06:28:20.844060+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"162","last_force_op_resend_prenautilus":"162","last_force_op_resend_preluminous":"162","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":161,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":0,"cache_target_dirty_high_ratio_micro":0,"cache_target_full_ratio_micro":0,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":17,"pool_name":"test-librbd-smithi104-24519-14","create_time":"2021-04-17T06:29:35.785481+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"226","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":226,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":18,"pool_name":"test-librbd-smithi104-24519-15","create_time":"2021-04-17T06:29:40.769632+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"232","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":232,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":19,"pool_name":"test-librbd-smithi104-24519-16","create_time":"2021-04-17T06:29:46.938404+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"247","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":7,"snap_epoch":247,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":20,"pool_name":"test-librbd-smithi104-24519-17","create_time":"2021-04-17T06:30:00.984819+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"273","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":22,"snap_epoch":273,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"ab470f8c-d507-440a-a38e-e0def732094a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":279,"up_from":310,"up_thru":328,"down_at":280,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":72438},{"type":"v1","addr":"172.21.15.104:6809","nonce":72438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":72438},{"type":"v1","addr":"172.21.15.104:6811","nonce":72438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":72438},{"type":"v1","addr":"172.21.15.104:6815","nonce":72438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":72438},{"type":"v1","addr":"172.21.15.104:6813","nonce":72438}]},"public_addr":"172.21.15.104:6809/72438","cluster_addr":"172.21.15.104:6811/72438","heartbeat_back_addr":"172.21.15.104:6815/72438","heartbeat_front_addr":"172.21.15.104:6813/72438","state":["exists","up"]},{"osd":1,"uuid":"513fb047-78d2-4beb-84b4-12fccdfd4ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":187,"up_from":233,"up_thru":314,"down_at":188,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":50331},{"type":"v1","addr":"172.21.15.104:6801","nonce":50331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":50331},{"type":"v1","addr":"172.21.15.104:6803","nonce":50331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":50331},{"type":"v1","addr":"172.21.15.104:6807","nonce":50331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":50331},{"type":"v1","addr":"172.21.15.104:6805","nonce":50331}]},"public_addr":"172.21.15.104:6801/50331","cluster_addr":"172.21.15.104:6803/50331","heartbeat_back_addr":"172.21.15.104:6807/50331","heartbeat_front_addr":"172.21.15.104:6805/50331","state":["exists","up"]},{"osd":2,"uuid":"1549b7bd-b713-4af0-a445-122c9e74869a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":314,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":17970},{"type":"v1","addr":"172.21.15.104:6818","nonce":17970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":17970},{"type":"v1","addr":"172.21.15.104:6822","nonce":17970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6829","nonce":17970},{"type":"v1","addr":"172.21.15.104:6831","nonce":17970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":17970},{"type":"v1","addr":"172.21.15.104:6826","nonce":17970}]},"public_addr":"172.21.15.104:6818/17970","cluster_addr":"172.21.15.104:6822/17970","heartbeat_back_addr":"172.21.15.104:6831/17970","heartbeat_front_addr":"172.21.15.104:6826/17970","state":["exists","up"]},{"osd":3,"uuid":"1791ecee-8af7-49f5-b163-40b87b8e493b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":315,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":17967},{"type":"v1","addr":"172.21.15.104:6819","nonce":17967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":17967},{"type":"v1","addr":"172.21.15.104:6823","nonce":17967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":17967},{"type":"v1","addr":"172.21.15.104:6830","nonce":17967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":17967},{"type":"v1","addr":"172.21.15.104:6827","nonce":17967}]},"public_addr":"172.21.15.104:6819/17967","cluster_addr":"172.21.15.104:6823/17967","heartbeat_back_addr":"172.21.15.104:6830/17967","heartbeat_front_addr":"172.21.15.104:6827/17967","state":["exists","up"]},{"osd":4,"uuid":"a2c83886-f0fe-46f1-8d23-5d0cc0789f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":247,"up_from":314,"up_thru":315,"down_at":248,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":45629},{"type":"v1","addr":"172.21.15.109:6817","nonce":45629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":45629},{"type":"v1","addr":"172.21.15.109:6819","nonce":45629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":45629},{"type":"v1","addr":"172.21.15.109:6824","nonce":45629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":45629},{"type":"v1","addr":"172.21.15.109:6821","nonce":45629}]},"public_addr":"172.21.15.109:6817/45629","cluster_addr":"172.21.15.109:6819/45629","heartbeat_back_addr":"172.21.15.109:6824/45629","heartbeat_front_addr":"172.21.15.109:6821/45629","state":["exists","up"]},{"osd":5,"uuid":"4ae773d6-8875-40fa-8456-8d9055a2efd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":320,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6823","nonce":18092},{"type":"v1","addr":"172.21.15.109:6825","nonce":18092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":18092},{"type":"v1","addr":"172.21.15.109:6827","nonce":18092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":18092},{"type":"v1","addr":"172.21.15.109:6831","nonce":18092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":18092},{"type":"v1","addr":"172.21.15.109:6829","nonce":18092}]},"public_addr":"172.21.15.109:6825/18092","cluster_addr":"172.21.15.109:6827/18092","heartbeat_back_addr":"172.21.15.109:6831/18092","heartbeat_front_addr":"172.21.15.109:6829/18092","state":["exists","up"]},{"osd":6,"uuid":"ae2256a2-f5e1-4c42-bb8b-b0d167af36fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6800","nonce":18081},{"type":"v1","addr":"172.21.15.109:6801","nonce":18081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":18081},{"type":"v1","addr":"172.21.15.109:6803","nonce":18081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":18081},{"type":"v1","addr":"172.21.15.109:6807","nonce":18081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":18081},{"type":"v1","addr":"172.21.15.109:6805","nonce":18081}]},"public_addr":"172.21.15.109:6801/18081","cluster_addr":"172.21.15.109:6803/18081","heartbeat_back_addr":"172.21.15.109:6807/18081","heartbeat_front_addr":"172.21.15.109:6805/18081","state":["exists","up"]},{"osd":7,"uuid":"461d25cc-8851-443e-98d6-f07775462174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":314,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":18082},{"type":"v1","addr":"172.21.15.109:6809","nonce":18082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":18082},{"type":"v1","addr":"172.21.15.109:6811","nonce":18082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":18082},{"type":"v1","addr":"172.21.15.109:6815","nonce":18082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":18082},{"type":"v1","addr":"172.21.15.109:6813","nonce":18082}]},"public_addr":"172.21.15.109:6809/18082","cluster_addr":"172.21.15.109:6811/18082","heartbeat_back_addr":"172.21.15.109:6815/18082","heartbeat_front_addr":"172.21.15.109:6813/18082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.625755+0000","dead_epoch":280},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.573959+0000","dead_epoch":188},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.822291+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.880854+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.753434+0000","dead_epoch":248},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.725997+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.617296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.826670+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.1","osds":[6,0]},{"pgid":"7.f","osds":[2,5]},{"pgid":"9.1d","osds":[5,7]}],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:0/785442747":"2021-04-17T07:29:31.883250+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} , 2021-04-17T06:32:25.851 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats , 2021-04-17T06:32:26.027 INFO:teuthology.orchestra.run.smithi104.stdout:1331439861766 2021-04-17T17:01:06.634 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 4 to deep-scrub , 2021-04-17T06:32:36.837 INFO:tasks.ceph:Scrubbing osd.5 , 2021-04-17T06:32:36.837 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-04-17T17:01:06.634 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:38.941 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:38.942 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:38.943 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2021-04-17T06:28:08.735315+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=8, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.635 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:38.999 INFO:tasks.ceph:pgid 20.4 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:38.999 INFO:tasks.ceph:pgid 19.3 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.000 INFO:tasks.ceph:pgid 18.2 last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.636 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:39.047 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2021-04-17T06:26:37.717741+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.047 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2021-04-17T06:26:33.694914+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.048 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.637 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:39.091 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2021-04-17T06:26:25.816361+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.092 INFO:tasks.ceph:pgid 10.e last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.092 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.640 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:39.141 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2021-04-17T06:26:33.694914+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.141 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.141 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-04-17T06:25:20.019177+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=25, tm_sec=20, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.641 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.603 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.603 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2021-04-17T06:26:25.816361+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.604 INFO:tasks.ceph:pgid 10.12 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.642 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.652 INFO:tasks.ceph:pgid 16.2 last_scrub_stamp 2021-04-17T06:28:21.767917+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=21, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.652 INFO:tasks.ceph:pgid 20.5 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.653 INFO:tasks.ceph:pgid 19.2 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.643 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.700 INFO:tasks.ceph:pgid 10.1 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.701 INFO:tasks.ceph:pgid 11.0 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.701 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.643 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.749 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.750 INFO:tasks.ceph:pgid 10.e last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.750 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.647 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.802 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.803 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2021-04-17T06:26:25.816361+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.803 INFO:tasks.ceph:pgid 10.6 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.648 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:20.280 INFO:tasks.ceph:pgid 10.14 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.280 INFO:tasks.ceph:pgid 11.15 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.281 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.648 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:20.324 INFO:tasks.ceph:pgid 20.2 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.324 INFO:tasks.ceph:pgid 19.5 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.325 INFO:tasks.ceph:pgid 18.4 last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.649 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:20.374 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.375 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.375 INFO:tasks.ceph:pgid 20.1a last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.653 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:20.419 INFO:tasks.ceph:pgid 10.9 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.420 INFO:tasks.ceph:pgid 11.8 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.420 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.653 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:40.889 INFO:tasks.ceph:pgid 10.15 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.889 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.890 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.654 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:40.932 INFO:tasks.ceph:pgid 16.7 last_scrub_stamp 2021-04-17T06:28:21.767917+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=21, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.932 INFO:tasks.ceph:pgid 20.2 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.933 INFO:tasks.ceph:pgid 19.5 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.655 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:40.975 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.976 INFO:tasks.ceph:pgid 20.11 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.976 INFO:tasks.ceph:pgid 19.16 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.659 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:41.019 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:41.019 INFO:tasks.ceph:pgid 20.19 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:41.020 INFO:tasks.ceph:pgid 19.1e last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.659 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:01.479 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.479 INFO:tasks.ceph:pgid 13.1e last_scrub_stamp 2021-04-17T06:28:08.735315+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=8, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.480 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.660 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:01.524 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2021-04-17T06:28:08.735315+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=8, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.525 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.525 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.664 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:01.574 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.575 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.575 INFO:tasks.ceph:pgid 20.18 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.664 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:22.038 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:22.038 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:22.039 INFO:tasks.ceph:pgid 16.2 last_scrub_stamp 2021-04-17T06:28:21.767917+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=21, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.668 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:22.087 INFO:tasks.ceph:pgid 20.11 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:22.087 INFO:tasks.ceph:pgid 19.16 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:22.088 INFO:tasks.ceph:pgid 18.17 last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.669 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:42.544 INFO:tasks.ceph:pgid 19.b last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:42.544 INFO:tasks.ceph:pgid 18.a last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:42.545 INFO:tasks.ceph:pgid 17.9 last_scrub_stamp 2021-04-17T06:29:36.548387+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=36, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.673 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:42.590 INFO:tasks.ceph:pgid 17.1e last_scrub_stamp 2021-04-17T06:29:36.548387+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=36, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:42.590 INFO:tasks.ceph:pgid 16.1f last_scrub_stamp 2021-04-17T06:28:21.767917+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=21, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:42.591 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.676 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:35:03.056 INFO:tasks.ceph:pgid 18.1 last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:35:03.057 INFO:tasks.ceph:pgid 17.2 last_scrub_stamp 2021-04-17T06:29:36.548387+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=36, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:35:03.057 INFO:tasks.ceph:pgid 20.6 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.686 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:35:23.535 INFO:tasks.ceph:pgid 20.a last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:35:23.535 INFO:tasks.ceph:pgid 19.d last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:35:23.536 INFO:tasks.ceph:pgid 20.9 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:06.687 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:36:25.198 INFO:teuthology.orchestra.run:waiting for 300 , 2021-04-17T06:36:25.266 INFO:tasks.ceph.osd.0:Stopped , 2021-04-17T06:36:25.267 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-04-17T17:01:06.687 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:36:46.564 DEBUG:teuthology.run_tasks:Unwinding manager install , 2021-04-17T06:36:46.575 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... , 2021-04-17T06:36:46.576 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-04-17T17:01:07.032 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.0-22-gef44fe1c (ef44fe1c828ef54c784bf132acaac3a2e6b8c272) pacific (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14e) [0x7f67ea9b3d8f] , 2: /usr/lib/ceph/libceph-common.so.2(+0x2dff79) [0x7f67ea9b3f79] 2021-04-17T17:01:07.034 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.848 INFO:teuthology.orchestra.run.smithi109.stdout: "events": [ , 2021-04-17T06:31:53.848 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.849 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "initiated", 2021-04-17T17:01:07.034 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.882 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:53.882 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.882 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "header_read", 2021-04-17T17:01:07.035 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.915 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:53.915 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.916 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "dispatched", 2021-04-17T17:01:07.036 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.949 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:53.949 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.950 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "reached_pg", 2021-04-17T17:01:07.036 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:53.984 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:53.984 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:53.984 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "started", 2021-04-17T17:01:07.037 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.018 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.018 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:54.018 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "sub_op_commit_rec", 2021-04-17T17:01:07.038 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.052 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.052 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:54.053 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "commit_sent", 2021-04-17T17:01:07.038 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.089 INFO:teuthology.orchestra.run.smithi109.stdout: } , 2021-04-17T06:31:54.090 INFO:teuthology.orchestra.run.smithi109.stdout: ] , 2021-04-17T06:31:54.090 INFO:teuthology.orchestra.run.smithi109.stdout: } 2021-04-17T17:01:07.039 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.123 INFO:teuthology.orchestra.run.smithi109.stdout: "flag_point": "commit sent; apply or cleanup", , 2021-04-17T06:31:54.123 INFO:teuthology.orchestra.run.smithi109.stdout: "client_info": { , 2021-04-17T06:31:54.123 INFO:teuthology.orchestra.run.smithi109.stdout: "client": "client.4776", 2021-04-17T17:01:07.040 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.156 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0 , 2021-04-17T06:31:54.156 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.157 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:07.040 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.189 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 1.0246e-05 , 2021-04-17T06:31:54.190 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.190 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:07.041 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.222 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 1.1851999999999999e-05 , 2021-04-17T06:31:54.222 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.223 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:07.041 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.255 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 3.8111000000000002e-05 , 2021-04-17T06:31:54.255 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.256 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:07.042 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.290 INFO:teuthology.orchestra.run.smithi109.stdout: "type_data": { , 2021-04-17T06:31:54.290 INFO:teuthology.orchestra.run.smithi109.stdout: "flag_point": "commit sent; apply or cleanup", , 2021-04-17T06:31:54.291 INFO:teuthology.orchestra.run.smithi109.stdout: "client_info": { 2021-04-17T17:01:07.043 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.328 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:45.718656+0000", , 2021-04-17T06:31:54.328 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 6.3400000000000003e-06 , 2021-04-17T06:31:54.329 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:07.043 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.361 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:12.002652+0000", , 2021-04-17T06:31:54.361 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.00043246199999999999 , 2021-04-17T06:31:54.361 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:07.044 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.394 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:17.057080+0000", , 2021-04-17T06:31:54.394 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.00077451899999999999 , 2021-04-17T06:31:54.394 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:07.045 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.426 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:31.851523+0000", , 2021-04-17T06:31:54.426 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 3.3130000000000003e-05 , 2021-04-17T06:31:54.427 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:07.045 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.845 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.00039110700000000002 , 2021-04-17T06:31:54.846 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.846 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:07.046 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.885 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 3.5151999999999998e-05 , 2021-04-17T06:31:54.885 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.886 INFO:teuthology.orchestra.run.smithi109.stdout: { 2021-04-17T17:01:07.047 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.921 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:54.922 INFO:teuthology.orchestra.run.smithi109.stdout: "description": "osd_op(client.4776.0:19865 4.1e 4:7fa955a7:::rbd_header.12a8bfce7101:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e166)", , 2021-04-17T06:31:54.922 INFO:teuthology.orchestra.run.smithi109.stdout: "initiated_at": "2021-04-17T06:28:38.765063+0000", 2021-04-17T17:01:07.047 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.955 INFO:teuthology.orchestra.run.smithi109.stdout: "tid": 20898 , 2021-04-17T06:31:54.956 INFO:teuthology.orchestra.run.smithi109.stdout: }, , 2021-04-17T06:31:54.956 INFO:teuthology.orchestra.run.smithi109.stdout: "events": [ 2021-04-17T17:01:07.048 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:54.988 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:28:59.824608+0000", , 2021-04-17T06:31:54.989 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 1.0406e-05 , 2021-04-17T06:31:54.989 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:07.049 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.020 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:09.933663+0000", , 2021-04-17T06:31:55.021 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 1.6858999999999999e-05 , 2021-04-17T06:31:55.021 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:07.049 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.052 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:10.933518+0000", , 2021-04-17T06:31:55.052 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 5.8764999999999997e-05 , 2021-04-17T06:31:55.053 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:07.050 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.084 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:24.107514+0000", , 2021-04-17T06:31:55.084 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.011463449000000001 , 2021-04-17T06:31:55.084 INFO:teuthology.orchestra.run.smithi109.stdout: }, 2021-04-17T17:01:07.050 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.115 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "throttled", , 2021-04-17T06:31:55.116 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:34.389436+0000", , 2021-04-17T06:31:55.116 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 6.5250000000000002e-06 2021-04-17T17:01:07.051 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.147 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "op must wait for map", , 2021-04-17T06:31:55.147 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:35.410587+0000", , 2021-04-17T06:31:55.147 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.0037283020000000002 2021-04-17T17:01:07.052 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.178 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "started", , 2021-04-17T06:31:55.179 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:29:44.664231+0000", , 2021-04-17T06:31:55.179 INFO:teuthology.orchestra.run.smithi109.stdout: "duration": 0.006311489 2021-04-17T17:01:07.052 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.210 INFO:teuthology.orchestra.run.smithi109.stdout: "client": "client.4607", , 2021-04-17T06:31:55.210 INFO:teuthology.orchestra.run.smithi109.stdout: "client_addr": "172.21.15.104:0/672963026", , 2021-04-17T06:31:55.210 INFO:teuthology.orchestra.run.smithi109.stdout: "tid": 63160 2021-04-17T17:01:07.053 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.241 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.242 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "throttled", , 2021-04-17T06:31:55.242 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:05.935836+0000", 2021-04-17T17:01:07.054 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.273 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.273 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "all_read", , 2021-04-17T06:31:55.273 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:06.961140+0000", 2021-04-17T17:01:07.054 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.304 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.305 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "queued_for_pg", , 2021-04-17T06:31:55.305 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:07.972039+0000", 2021-04-17T17:01:07.055 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.336 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.336 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "op must wait for map", , 2021-04-17T06:31:55.336 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:10.833952+0000", 2021-04-17T17:01:07.056 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.367 INFO:teuthology.orchestra.run.smithi109.stdout: { , 2021-04-17T06:31:55.367 INFO:teuthology.orchestra.run.smithi109.stdout: "event": "started", , 2021-04-17T06:31:55.368 INFO:teuthology.orchestra.run.smithi109.stdout: "time": "2021-04-17T06:30:22.115085+0000", 2021-04-17T17:01:07.056 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:29:48.763787+0000", , 2021-04-17T06:31:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.019747636999999998 , 2021-04-17T06:31:55.791 INFO:teuthology.orchestra.run.smithi104.stdout: } 2021-04-17T17:01:07.057 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.828 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", , 2021-04-17T06:31:55.828 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:29:48.964358+0000", , 2021-04-17T06:31:55.829 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 1.2252000000000001e-05 2021-04-17T17:01:07.058 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.864 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:55.865 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", , 2021-04-17T06:31:55.865 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:30:06.973206+0000", 2021-04-17T17:01:07.058 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.902 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:55.902 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", , 2021-04-17T06:31:55.903 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:30:10.848197+0000", 2021-04-17T17:01:07.059 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.941 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2021-04-17T06:30:10.873976+0000", , 2021-04-17T06:31:55.942 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 104.89220493800001, , 2021-04-17T06:31:55.942 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.0016288229999999999, 2021-04-17T17:01:07.060 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:55.980 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:55.980 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:55.981 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "header_read", 2021-04-17T17:01:07.060 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:56.019 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:56.020 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "reached_pg", 2021-04-17T17:01:07.061 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.058 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:56.059 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:56.059 INFO:teuthology.orchestra.run.smithi104.stdout: "event": "sub_op_commit_rec", 2021-04-17T17:01:07.061 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.100 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4607.0:63425 20.6 20:63ef7e0b:::rbd_object_map.11ff9528d5a3:head [delete] snapc 0=[] ondisk+write+known_if_redirected e257)", , 2021-04-17T06:31:56.101 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2021-04-17T06:30:10.932555+0000", , 2021-04-17T06:31:56.101 INFO:teuthology.orchestra.run.smithi104.stdout: "age": 104.833626302, 2021-04-17T17:01:07.062 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.142 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 5.3739999999999997e-06 , 2021-04-17T06:31:56.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:56.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2021-04-17T17:01:07.063 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.183 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.00031178100000000002 , 2021-04-17T06:31:56.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, , 2021-04-17T06:31:56.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2021-04-17T17:01:07.063 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.229 INFO:teuthology.orchestra.run.smithi104.stdout: { , 2021-04-17T06:31:56.229 INFO:teuthology.orchestra.run.smithi104.stdout: "description": "osd_op(client.4776.0:27001 20.4 20:27ca6743:::rbd_id.image167:head [delete] snapc 0=[] ondisk+write+known_if_redirected e263)", , 2021-04-17T06:31:56.229 INFO:teuthology.orchestra.run.smithi104.stdout: "initiated_at": "2021-04-17T06:30:17.117900+0000", 2021-04-17T17:01:07.064 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.260 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:30:17.145840+0000", , 2021-04-17T06:31:56.261 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 4.2880000000000003e-06 , 2021-04-17T06:31:56.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2021-04-17T17:01:07.065 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:56.292 INFO:teuthology.orchestra.run.smithi104.stdout: "time": "2021-04-17T06:30:17.155184+0000", , 2021-04-17T06:31:56.292 INFO:teuthology.orchestra.run.smithi104.stdout: "duration": 0.000114579 , 2021-04-17T06:31:56.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2021-04-17T17:01:07.066 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:31:58.113 INFO:tasks.ceph.osd.0:Started , 2021-04-17T06:31:58.113 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight , nodeep-scrub is unset 2021-04-17T17:01:07.076 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:25.836 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":330,"fsid":"8a3376dc-fed9-4752-8f22-e17f3c108376","created":"2021-04-17T06:25:08.928630+0000","modified":"2021-04-17T06:32:25.180703+0000","last_up_change":"2021-04-17T06:32:08.956870+0000","last_in_change":"2021-04-17T06:31:39.909648+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-04-17T06:25:18.055633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-04-17T06:25:19.887069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"21","last_force_op_resend_prenautilus":"21","last_force_op_resend_preluminous":"21","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2021-04-17T06:25:29.581351+0000","flags":9,"flags_names":"hashpspool,incomplete_clones","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"21","last_force_op_resend_prenautilus":"21","last_force_op_resend_preluminous":"21","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"test-librbd-smithi104-24519-2","create_time":"2021-04-17T06:26:21.397665+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":51,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":6,"pool_name":"test-librbd-smithi104-24519-3","create_time":"2021-04-17T06:26:24.988207+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":55,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":7,"pool_name":"test-librbd-smithi104-24519-4","create_time":"2021-04-17T06:26:28.888126+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":59,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":8,"pool_name":"test-librbd-smithi104-24519-5","create_time":"2021-04-17T06:26:33.346843+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":63,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":9,"pool_name":"test-librbd-smithi104-24519-6","create_time":"2021-04-17T06:26:37.297373+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":7,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":10,"pool_name":"test-librbd-smithi104-24519-7","create_time":"2021-04-17T06:26:44.947343+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":11,"pool_name":"test-librbd-smithi104-24519-8","create_time":"2021-04-17T06:27:44.594299+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":12,"pool_name":"test-librbd-smithi104-24519-9","create_time":"2021-04-17T06:28:06.471554+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":144,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":13,"pool_name":"test-librbd-smithi104-24519-10","create_time":"2021-04-17T06:28:08.359230+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":142,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":14,"pool_name":"test-librbd-smithi104-24519-11","create_time":"2021-04-17T06:28:16.954901+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"162","last_force_op_resend_prenautilus":"162","last_force_op_resend_preluminous":"162","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":161,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":15,"pool_name":"test-librbd-smithi104-24519-12","create_time":"2021-04-17T06:28:18.840077+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":159,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":16,"pool_name":"test-librbd-smithi104-24519-13","create_time":"2021-04-17T06:28:20.844060+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"162","last_force_op_resend_prenautilus":"162","last_force_op_resend_preluminous":"162","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":161,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":0,"cache_target_dirty_high_ratio_micro":0,"cache_target_full_ratio_micro":0,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":17,"pool_name":"test-librbd-smithi104-24519-14","create_time":"2021-04-17T06:29:35.785481+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"226","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":226,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":18,"pool_name":"test-librbd-smithi104-24519-15","create_time":"2021-04-17T06:29:40.769632+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"232","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":232,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":19,"pool_name":"test-librbd-smithi104-24519-16","create_time":"2021-04-17T06:29:46.938404+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"247","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":7,"snap_epoch":247,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}},{"pool":20,"pool_name":"test-librbd-smithi104-24519-17","create_time":"2021-04-17T06:30:00.984819+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"273","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":22,"snap_epoch":273,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"ab470f8c-d507-440a-a38e-e0def732094a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":279,"up_from":310,"up_thru":328,"down_at":280,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":72438},{"type":"v1","addr":"172.21.15.104:6809","nonce":72438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":72438},{"type":"v1","addr":"172.21.15.104:6811","nonce":72438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":72438},{"type":"v1","addr":"172.21.15.104:6815","nonce":72438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":72438},{"type":"v1","addr":"172.21.15.104:6813","nonce":72438}]},"public_addr":"172.21.15.104:6809/72438","cluster_addr":"172.21.15.104:6811/72438","heartbeat_back_addr":"172.21.15.104:6815/72438","heartbeat_front_addr":"172.21.15.104:6813/72438","state":["exists","up"]},{"osd":1,"uuid":"513fb047-78d2-4beb-84b4-12fccdfd4ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":187,"up_from":233,"up_thru":314,"down_at":188,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":50331},{"type":"v1","addr":"172.21.15.104:6801","nonce":50331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":50331},{"type":"v1","addr":"172.21.15.104:6803","nonce":50331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":50331},{"type":"v1","addr":"172.21.15.104:6807","nonce":50331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":50331},{"type":"v1","addr":"172.21.15.104:6805","nonce":50331}]},"public_addr":"172.21.15.104:6801/50331","cluster_addr":"172.21.15.104:6803/50331","heartbeat_back_addr":"172.21.15.104:6807/50331","heartbeat_front_addr":"172.21.15.104:6805/50331","state":["exists","up"]},{"osd":2,"uuid":"1549b7bd-b713-4af0-a445-122c9e74869a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":314,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":17970},{"type":"v1","addr":"172.21.15.104:6818","nonce":17970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":17970},{"type":"v1","addr":"172.21.15.104:6822","nonce":17970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6829","nonce":17970},{"type":"v1","addr":"172.21.15.104:6831","nonce":17970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":17970},{"type":"v1","addr":"172.21.15.104:6826","nonce":17970}]},"public_addr":"172.21.15.104:6818/17970","cluster_addr":"172.21.15.104:6822/17970","heartbeat_back_addr":"172.21.15.104:6831/17970","heartbeat_front_addr":"172.21.15.104:6826/17970","state":["exists","up"]},{"osd":3,"uuid":"1791ecee-8af7-49f5-b163-40b87b8e493b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":315,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6817","nonce":17967},{"type":"v1","addr":"172.21.15.104:6819","nonce":17967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6821","nonce":17967},{"type":"v1","addr":"172.21.15.104:6823","nonce":17967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":17967},{"type":"v1","addr":"172.21.15.104:6830","nonce":17967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6825","nonce":17967},{"type":"v1","addr":"172.21.15.104:6827","nonce":17967}]},"public_addr":"172.21.15.104:6819/17967","cluster_addr":"172.21.15.104:6823/17967","heartbeat_back_addr":"172.21.15.104:6830/17967","heartbeat_front_addr":"172.21.15.104:6827/17967","state":["exists","up"]},{"osd":4,"uuid":"a2c83886-f0fe-46f1-8d23-5d0cc0789f7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":247,"up_from":314,"up_thru":315,"down_at":248,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6816","nonce":45629},{"type":"v1","addr":"172.21.15.109:6817","nonce":45629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6818","nonce":45629},{"type":"v1","addr":"172.21.15.109:6819","nonce":45629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6822","nonce":45629},{"type":"v1","addr":"172.21.15.109:6824","nonce":45629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6820","nonce":45629},{"type":"v1","addr":"172.21.15.109:6821","nonce":45629}]},"public_addr":"172.21.15.109:6817/45629","cluster_addr":"172.21.15.109:6819/45629","heartbeat_back_addr":"172.21.15.109:6824/45629","heartbeat_front_addr":"172.21.15.109:6821/45629","state":["exists","up"]},{"osd":5,"uuid":"4ae773d6-8875-40fa-8456-8d9055a2efd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":320,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6823","nonce":18092},{"type":"v1","addr":"172.21.15.109:6825","nonce":18092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6826","nonce":18092},{"type":"v1","addr":"172.21.15.109:6827","nonce":18092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6830","nonce":18092},{"type":"v1","addr":"172.21.15.109:6831","nonce":18092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6828","nonce":18092},{"type":"v1","addr":"172.21.15.109:6829","nonce":18092}]},"public_addr":"172.21.15.109:6825/18092","cluster_addr":"172.21.15.109:6827/18092","heartbeat_back_addr":"172.21.15.109:6831/18092","heartbeat_front_addr":"172.21.15.109:6829/18092","state":["exists","up"]},{"osd":6,"uuid":"ae2256a2-f5e1-4c42-bb8b-b0d167af36fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6800","nonce":18081},{"type":"v1","addr":"172.21.15.109:6801","nonce":18081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6802","nonce":18081},{"type":"v1","addr":"172.21.15.109:6803","nonce":18081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6806","nonce":18081},{"type":"v1","addr":"172.21.15.109:6807","nonce":18081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6804","nonce":18081},{"type":"v1","addr":"172.21.15.109:6805","nonce":18081}]},"public_addr":"172.21.15.109:6801/18081","cluster_addr":"172.21.15.109:6803/18081","heartbeat_back_addr":"172.21.15.109:6807/18081","heartbeat_front_addr":"172.21.15.109:6805/18081","state":["exists","up"]},{"osd":7,"uuid":"461d25cc-8851-443e-98d6-f07775462174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":314,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6808","nonce":18082},{"type":"v1","addr":"172.21.15.109:6809","nonce":18082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6810","nonce":18082},{"type":"v1","addr":"172.21.15.109:6811","nonce":18082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6814","nonce":18082},{"type":"v1","addr":"172.21.15.109:6815","nonce":18082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.109:6812","nonce":18082},{"type":"v1","addr":"172.21.15.109:6813","nonce":18082}]},"public_addr":"172.21.15.109:6809/18082","cluster_addr":"172.21.15.109:6811/18082","heartbeat_back_addr":"172.21.15.109:6815/18082","heartbeat_front_addr":"172.21.15.109:6813/18082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.625755+0000","dead_epoch":280},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.573959+0000","dead_epoch":188},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.822291+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.880854+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.753434+0000","dead_epoch":248},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.725997+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.617296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-04-17T06:25:16.826670+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.1","osds":[6,0]},{"pgid":"7.f","osds":[2,5]},{"pgid":"9.1d","osds":[5,7]}],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:0/785442747":"2021-04-17T07:29:31.883250+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} , 2021-04-17T06:32:25.851 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats , 2021-04-17T06:32:26.027 INFO:teuthology.orchestra.run.smithi104.stdout:1331439861766 2021-04-17T17:01:07.081 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 4 to deep-scrub , 2021-04-17T06:32:36.837 INFO:tasks.ceph:Scrubbing osd.5 , 2021-04-17T06:32:36.837 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-04-17T17:01:07.082 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:38.941 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:38.942 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:38.943 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2021-04-17T06:28:08.735315+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=8, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.082 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:38.999 INFO:tasks.ceph:pgid 20.4 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:38.999 INFO:tasks.ceph:pgid 19.3 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.000 INFO:tasks.ceph:pgid 18.2 last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.083 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:39.047 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2021-04-17T06:26:37.717741+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.047 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2021-04-17T06:26:33.694914+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.048 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.084 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:39.091 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2021-04-17T06:26:25.816361+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.092 INFO:tasks.ceph:pgid 10.e last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.092 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.087 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:39.141 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2021-04-17T06:26:33.694914+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.141 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:39.141 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-04-17T06:25:20.019177+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=25, tm_sec=20, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.088 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.603 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.603 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2021-04-17T06:26:25.816361+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.604 INFO:tasks.ceph:pgid 10.12 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.089 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.652 INFO:tasks.ceph:pgid 16.2 last_scrub_stamp 2021-04-17T06:28:21.767917+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=21, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.652 INFO:tasks.ceph:pgid 20.5 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.653 INFO:tasks.ceph:pgid 19.2 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.090 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.700 INFO:tasks.ceph:pgid 10.1 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.701 INFO:tasks.ceph:pgid 11.0 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.701 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.090 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.749 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.750 INFO:tasks.ceph:pgid 10.e last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.750 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.094 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:32:59.802 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2021-04-17T06:26:29.707650+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.803 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2021-04-17T06:26:25.816361+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=25, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:32:59.803 INFO:tasks.ceph:pgid 10.6 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.095 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:20.280 INFO:tasks.ceph:pgid 10.14 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.280 INFO:tasks.ceph:pgid 11.15 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.281 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.096 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:20.324 INFO:tasks.ceph:pgid 20.2 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.324 INFO:tasks.ceph:pgid 19.5 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.325 INFO:tasks.ceph:pgid 18.4 last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.096 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:20.374 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.375 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.375 INFO:tasks.ceph:pgid 20.1a last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.100 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:20.419 INFO:tasks.ceph:pgid 10.9 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.420 INFO:tasks.ceph:pgid 11.8 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:20.420 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.101 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:40.889 INFO:tasks.ceph:pgid 10.15 last_scrub_stamp 2021-04-17T06:26:45.786195+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=26, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.889 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2021-04-17T06:27:45.074220+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.890 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.101 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:40.932 INFO:tasks.ceph:pgid 16.7 last_scrub_stamp 2021-04-17T06:28:21.767917+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=21, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.932 INFO:tasks.ceph:pgid 20.2 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.933 INFO:tasks.ceph:pgid 19.5 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.102 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:40.975 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.976 INFO:tasks.ceph:pgid 20.11 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:40.976 INFO:tasks.ceph:pgid 19.16 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.106 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:33:41.019 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:41.019 INFO:tasks.ceph:pgid 20.19 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:33:41.020 INFO:tasks.ceph:pgid 19.1e last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.106 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:01.479 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2021-04-17T06:28:07.242110+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=7, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.479 INFO:tasks.ceph:pgid 13.1e last_scrub_stamp 2021-04-17T06:28:08.735315+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=8, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.480 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.107 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:01.524 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2021-04-17T06:28:08.735315+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=8, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.525 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.525 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.111 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:01.574 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.575 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:01.575 INFO:tasks.ceph:pgid 20.18 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.112 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:22.038 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:22.038 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2021-04-17T06:28:19.761152+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=19, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:22.039 INFO:tasks.ceph:pgid 16.2 last_scrub_stamp 2021-04-17T06:28:21.767917+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=21, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.115 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:22.087 INFO:tasks.ceph:pgid 20.11 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:22.087 INFO:tasks.ceph:pgid 19.16 last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:22.088 INFO:tasks.ceph:pgid 18.17 last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.116 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:42.544 INFO:tasks.ceph:pgid 19.b last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:42.544 INFO:tasks.ceph:pgid 18.a last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:42.545 INFO:tasks.ceph:pgid 17.9 last_scrub_stamp 2021-04-17T06:29:36.548387+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=36, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.120 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:34:42.590 INFO:tasks.ceph:pgid 17.1e last_scrub_stamp 2021-04-17T06:29:36.548387+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=36, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:42.590 INFO:tasks.ceph:pgid 16.1f last_scrub_stamp 2021-04-17T06:28:21.767917+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=21, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:34:42.591 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2021-04-17T06:28:17.773392+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=28, tm_sec=17, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.123 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:35:03.056 INFO:tasks.ceph:pgid 18.1 last_scrub_stamp 2021-04-17T06:29:41.597620+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=41, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:35:03.057 INFO:tasks.ceph:pgid 17.2 last_scrub_stamp 2021-04-17T06:29:36.548387+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=36, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:35:03.057 INFO:tasks.ceph:pgid 20.6 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.133 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:35:23.535 INFO:tasks.ceph:pgid 20.a last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:35:23.535 INFO:tasks.ceph:pgid 19.d last_scrub_stamp 2021-04-17T06:29:47.671179+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) , 2021-04-17T06:35:23.536 INFO:tasks.ceph:pgid 20.9 last_scrub_stamp 2021-04-17T06:30:01.874832+0000 time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=30, tm_sec=1, tm_wday=5, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=4, tm_mday=17, tm_hour=6, tm_min=32, tm_sec=33, tm_wday=5, tm_yday=107, tm_isdst=0) 2021-04-17T17:01:07.134 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:36:25.198 INFO:teuthology.orchestra.run:waiting for 300 , 2021-04-17T06:36:25.266 INFO:tasks.ceph.osd.0:Stopped , 2021-04-17T06:36:25.267 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-04-17T17:01:07.135 WARNING:scrape:Ignoring malparsed backtrace: 2021-04-17T06:36:46.564 DEBUG:teuthology.run_tasks:Unwinding manager install , 2021-04-17T06:36:46.575 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... , 2021-04-17T06:36:46.576 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-04-17T17:01:07.634 INFO:scrape:Found 2 distinct failure reasons 2021-04-17T17:01:07.635 INFO:scrape:Failure: Command failed (workunit test rbd/test_librbd.sh) on smithi104 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ef44fe1c828ef54c784bf132acaac3a2e6b8c272 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 RBD_FEATURES=61 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' 2021-04-17T17:01:07.636 INFO:scrape:1 jobs: ['6053026'] 2021-04-17T17:01:07.636 INFO:scrape:suites: ['clusters/{fixed-2', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'openstack}', 'rbd/thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/cache', 'thrashosds-health', 'workloads/rbd_api_tests_copy_on_read}'] 2021-04-17T17:01:07.637 INFO:scrape: 2021-04-17T17:01:07.637 INFO:scrape:Failure: "2021-04-17T07:24:24.549420+0000 osd.7 (osd.7) 3 : cluster [WRN] slow request osd_op(client.4521.0:31537 2.5 2:b474cc52:::rbd_data.1127339d54b5.0000000000000324:head [stat out=16b,write 176128~4018176 in=4018176b] snapc 0=[] ondisk+write+known_if_redirected e22) initiated 2021-04-17T07:23:54.530596+0000 currently waiting for sub ops" in cluster log 2021-04-17T17:01:07.638 INFO:scrape:2 jobs: ['6053085', '6053066'] 2021-04-17T17:01:07.638 INFO:scrape:suites intersection: ['clusters/{fixed-3', 'openstack}'] 2021-04-17T17:01:07.639 INFO:scrape:suites union: ['clusters/{fixed-3', 'features/defaults', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'pool/none', 'qemu/xfstests', 'rbd/maintenance/{base/install', 'rbd/qemu/{cache/none', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'workloads/dynamic_features_no_cache}', 'workloads/qemu_bonnie}'] 2021-04-17T17:01:07.640 INFO:scrape: 2021-04-17T17:01:07.646 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/ failed: 3 dead: 0 running: 0 waiting: 0 queued: 0 passed: 173 Fail ================================================================= [6053026] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests_copy_on_read} ----------------------------------------------------------------- time: 00:17:35 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053026/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053026/ sentry: https://sentry.ceph.com/organizations/ceph/?query=16b69b49815b41608b66c3c4d9838c94 Command failed (workunit test rbd/test_librbd.sh) on smithi104 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ef44fe1c828ef54c784bf132acaac3a2e6b8c272 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 RBD_FEATURES=61 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' [6053066] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 02:30:56 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053066/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053066/ "2021-04-17T07:15:18.666500+0000 osd.7 (osd.7) 3 : cluster [WRN] slow request osd_op(client.4468.0:53104 2.0 2:0c7dcb60:::rbd_data.11ac7695c588.000000000000080f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected e23) initiated 2021-04-17T07:14:48.485649+0000 currently delayed" in cluster log [6053085] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{centos_8} workloads/qemu_bonnie} ----------------------------------------------------------------- time: 00:16:28 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053085/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053085/ "2021-04-17T07:24:24.549420+0000 osd.7 (osd.7) 3 : cluster [WRN] slow request osd_op(client.4521.0:31537 2.5 2:b474cc52:::rbd_data.1127339d54b5.0000000000000324:head [stat out=16b,write 176128~4018176 in=4018176b] snapc 0=[] ondisk+write+known_if_redirected e22) initiated 2021-04-17T07:23:54.530596+0000 currently waiting for sub ops" in cluster log Pass ================================================================= [6053023] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} time: 00:21:48 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053023/ [6053024] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/rbd_cls_tests} time: 00:17:52 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053024/ [6053025] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/python_api_tests_with_defaults} time: 00:32:41 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053025/ [6053027] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} time: 00:27:52 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053027/ [6053028] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} time: 02:19:36 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053028/ [6053029] rbd/singleton/{all/permissions objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} time: 00:18:46 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053029/ [6053030] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} time: 00:09:05 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053030/ [6053031] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:19:26 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053031/ [6053032] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-pool/cache 5-cache-mode/rwl 6-workloads/recovery} time: 00:19:38 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053032/ [6053033] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:25:54 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053033/ [6053034] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:48:38 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053034/ [6053035] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_migration} time: 00:32:12 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053035/ [6053036] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks2} time: 01:18:58 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053036/ [6053037] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-snappy 4-supported-random-distro$/{rhel_8} 5-pool/none 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:31:48 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053037/ [6053038] rbd/singleton/{all/qemu-iotests-no-cache objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}} time: 00:10:42 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053038/ [6053039] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_api_tests_journaling} time: 00:36:43 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053039/ [6053040] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_defaults} time: 00:25:14 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053040/ [6053041] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/rbd_lock_and_fence} time: 00:18:35 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053041/ [6053042] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/python_api_tests_with_journaling} time: 00:33:29 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053042/ [6053043] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} time: 01:41:43 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053043/ [6053044] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} time: 00:18:55 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053044/ [6053045] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:16:14 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053045/ [6053046] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} time: 00:15:38 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053046/ [6053047] rbd/singleton/{all/qemu-iotests-writearound objectstore/bluestore-comp-snappy openstack supported-random-distro$/{centos_8}} time: 00:10:14 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053047/ [6053048] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} time: 00:16:53 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053048/ [6053049] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:50:49 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053049/ [6053050] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_api_tests_no_locking} time: 00:26:18 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053050/ [6053051] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-lz4 pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} time: 00:29:25 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053051/ [6053052] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} time: 02:31:28 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053052/ [6053053] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features} time: 01:39:46 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053053/ [6053054] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zlib 4-supported-random-distro$/{ubuntu_latest} 5-pool/replicated-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:56:50 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053054/ [6053055] rbd/singleton/{all/qemu-iotests-writeback objectstore/bluestore-comp-zlib openstack supported-random-distro$/{centos_8}} time: 00:09:42 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053055/ [6053056] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/c_api_tests_with_journaling} time: 00:37:54 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053056/ [6053057] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/rbd_python_api_tests_old_format} time: 00:27:17 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053057/ [6053058] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/rbd_mirror} time: 00:55:44 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053058/ [6053059] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} time: 00:17:13 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053059/ [6053060] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:19:23 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053060/ [6053061] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-journaling} time: 00:25:30 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053061/ [6053062] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound} time: 00:13:54 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053062/ [6053063] rbd/singleton/{all/qemu-iotests-writethrough objectstore/bluestore-comp-zstd openstack supported-random-distro$/{centos_8}} time: 00:09:31 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053063/ [6053064] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests} time: 02:23:01 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053064/ [6053065] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:48:45 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053065/ [6053067] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-snappy pool/ec-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_groups} time: 00:09:12 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053067/ [6053068] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-snappy pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} time: 03:19:53 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053068/ [6053069] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zstd 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 02:03:29 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053069/ [6053070] rbd/singleton/{all/qos objectstore/bluestore-hybrid openstack supported-random-distro$/{centos_8}} time: 00:24:08 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053070/ [6053071] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} time: 00:19:38 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053071/ [6053072] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults} time: 00:24:32 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053072/ [6053073] rbd/iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053073/ [6053074] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:13:58 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053074/ [6053075] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-pool/cache 5-cache-mode/rwl 6-workloads/c_api_tests_with_defaults} time: 00:40:22 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053075/ [6053076] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} time: 00:14:02 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053076/ [6053077] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} time: 00:15:29 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053077/ [6053078] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writeback} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053078/ [6053079] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/rbd_api_tests_old_format} time: 00:27:33 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053079/ [6053080] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/c_api_tests} time: 00:45:07 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053080/ [6053081] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{ubuntu_latest} workloads/fsx} time: 00:16:32 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053081/ [6053082] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} time: 01:30:20 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053082/ [6053083] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} time: 00:38:03 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053083/ [6053084] rbd/singleton/{all/rbd-vs-unmanaged-snaps objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{rhel_8}} time: 00:17:18 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053084/ [6053086] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:07:09 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053086/ [6053087] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks1} time: 01:25:19 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053087/ [6053088] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough} time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053088/ [6053089] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} time: 00:54:44 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053089/ [6053090] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:07:31 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053090/ [6053091] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:09:03 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053091/ [6053092] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-hybrid 4-supported-random-distro$/{rhel_8} 5-pool/none 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:30:08 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053092/ [6053093] rbd/singleton/{all/rbd_mirror objectstore/bluestore-stupid openstack supported-random-distro$/{centos_8}} time: 00:42:44 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053093/ [6053094] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/rbd_cls_tests} time: 00:18:45 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053094/ [6053095] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/c_api_tests_with_defaults} time: 00:44:39 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053095/ [6053096] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests} time: 00:18:33 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053096/ [6053097] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} time: 02:26:26 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053097/ [6053098] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} time: 00:58:05 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053098/ [6053099] rbd/singleton/{all/rbd_tasks objectstore/filestore-xfs openstack supported-random-distro$/{rhel_8}} time: 00:19:06 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053099/ [6053100] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} time: 00:14:13 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053100/ [6053101] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_copy_on_read} time: 00:13:32 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053101/ [6053102] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-config-key} time: 00:31:40 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053102/ [6053103] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:20:24 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053103/ [6053104] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:15:18 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053104/ [6053105] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zstd pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_luks_encryption} time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053105/ [6053106] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-zstd pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} time: 01:05:31 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053106/ [6053107] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} time: 01:26:52 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053107/ [6053108] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-low-osd-mem-target 4-supported-random-distro$/{ubuntu_latest} 5-pool/replicated-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:39:37 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053108/ [6053109] rbd/singleton/{all/rbdmap_RBDMAPFILE objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} time: 00:07:30 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053109/ [6053110] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/rbd_lock_and_fence} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053110/ [6053111] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/c_api_tests_with_journaling} time: 00:57:14 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053111/ [6053112] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} time: 00:24:06 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053112/ [6053113] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{centos_8} workloads/python_api_tests_with_defaults} time: 00:20:29 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053113/ [6053114] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} time: 00:31:53 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053114/ [6053115] rbd/singleton/{all/read-flags-no-cache objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}} time: 00:06:53 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053115/ [6053116] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} time: 00:20:29 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053116/ [6053117] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests} time: 00:59:51 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053117/ [6053118] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} time: 00:08:45 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053118/ [6053119] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:10:45 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053119/ [6053120] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-pool/cache 5-cache-mode/rwl 6-workloads/fio} time: 00:28:17 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053120/ [6053121] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} time: 02:27:23 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053121/ [6053122] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_migration} time: 00:40:32 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053122/ [6053123] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} time: 02:08:16 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053123/ [6053124] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_journal} time: 00:19:19 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053124/ [6053125] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-stupid 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 02:21:52 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053125/ [6053126] rbd/singleton/{all/read-flags-writeback objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}} time: 00:06:47 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053126/ [6053127] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/rbd_python_api_tests_old_format} time: 00:19:25 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053127/ [6053128] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/fsx} time: 00:19:06 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053128/ [6053129] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} time: 00:18:52 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053129/ [6053130] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} time: 00:57:10 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053130/ [6053131] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} time: 00:20:34 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053131/ [6053132] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-lz4 pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:18:47 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053132/ [6053133] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{ubuntu_latest} workloads/fio_on_immutable_object_cache} time: 00:20:15 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053133/ [6053134] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:23:45 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053134/ [6053135] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} time: 01:41:23 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053135/ [6053136] rbd/singleton/{all/read-flags-writethrough objectstore/bluestore-comp-zlib openstack supported-random-distro$/{centos_8}} time: 00:08:45 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053136/ [6053137] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_bonnie} time: 00:22:16 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053137/ [6053138] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nocache} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053138/ [6053139] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} time: 00:18:49 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053139/ [6053140] rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} time: 02:18:53 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053140/ [6053141] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/filestore-xfs 4-supported-random-distro$/{ubuntu_latest} 5-pool/none 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:13:24 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053141/ [6053142] rbd/singleton/{all/snap-diff objectstore/bluestore-comp-zstd openstack supported-random-distro$/{rhel_8}} time: 00:17:42 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053142/ [6053143] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/rbd_api_tests_old_format} time: 00:17:44 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053143/ [6053144] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/python_api_tests} time: 00:31:20 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053144/ [6053145] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} time: 00:20:35 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053145/ [6053146] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} time: 01:55:57 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053146/ [6053147] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} time: 00:57:56 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053147/ [6053148] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{centos_8} workloads/rbd_fio} time: 00:27:11 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053148/ [6053149] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} time: 00:07:00 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053149/ [6053150] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:08:48 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053150/ [6053151] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_rate_limit} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053151/ [6053152] rbd/singleton/{all/verify_pool objectstore/bluestore-hybrid openstack supported-random-distro$/{centos_8}} time: 00:08:46 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053152/ [6053153] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_fsstress} time: 00:25:05 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053153/ [6053154] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_groups} time: 00:08:21 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053154/ [6053155] rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/ec-data-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} time: 01:45:02 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053155/ [6053156] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} time: 02:26:30 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053156/ [6053157] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-bitmap 4-supported-random-distro$/{ubuntu_latest} 5-pool/replicated-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:34:19 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053157/ [6053158] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-bootstrap-workunit} time: 00:09:51 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053158/ [6053159] rbd/singleton/{all/admin_socket objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} time: 00:07:00 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053159/ [6053160] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/journal} time: 00:08:03 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053160/ [6053161] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/rbd_cls_tests} time: 00:08:10 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053161/ [6053162] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/python_api_tests_with_defaults} time: 00:32:54 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053162/ [6053163] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} time: 00:29:10 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053163/ [6053164] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053164/ [6053165] rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-pool/cache 5-cache-mode/rwl 6-workloads/qemu_xfstests} time: 08:11:55 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053165/ [6053166] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-comp-snappy openstack supported-random-distro$/{centos_8}} time: 00:15:39 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053166/ [6053167] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:49:04 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053167/ [6053168] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} time: 00:21:43 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053168/ [6053169] rbd/singleton/{all/formatted-output objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{centos_8}} time: 00:09:02 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053169/ [6053170] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} time: 01:45:35 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053170/ [6053171] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_api_tests} time: 00:30:58 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053171/ [6053172] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} time: 01:37:28 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053172/ [6053173] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} time: 00:14:01 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053173/ [6053174] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} time: 00:09:16 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053174/ [6053175] rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} time: 00:58:32 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053175/ [6053176] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} time: 00:18:15 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053176/ [6053177] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_nbd} time: 00:10:38 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053177/ [6053178] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-lz4 4-supported-random-distro$/{ubuntu_latest} 5-pool/ec-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 02:01:55 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053178/ [6053179] rbd/singleton/{all/merge_diff objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053179/ [6053180] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/rbd_lock_and_fence} time: 00:07:57 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053180/ [6053181] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/python_api_tests_with_journaling} time: 00:32:22 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053181/ [6053182] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} time: 00:45:51 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053182/ [6053183] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/c_api_tests_with_defaults} time: 00:34:11 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053183/ [6053184] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_api_tests_copy_on_read} time: 00:40:29 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053184/ [6053185] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} time: 01:44:47 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053185/ [6053186] rbd/singleton/{all/permissions objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053186/ [6053187] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_bonnie} time: 00:19:36 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053187/ [6053188] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} time: 00:15:47 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053188/ [6053189] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} time: 00:21:32 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053189/ [6053190] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{rhel_8} workloads/qemu_on_immutable_object_cache_and_thrash} time: 01:08:58 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053190/ [6053191] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} time: 00:24:51 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053191/ [6053192] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_luks_encryption} time: 00:18:31 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053192/ [6053193] rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} time: 02:23:18 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053193/ [6053194] rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-snappy 4-supported-random-distro$/{ubuntu_latest} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} time: 01:54:10 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053194/ [6053195] rbd/singleton/{all/qemu-iotests-no-cache objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} time: 00:17:21 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053195/ [6053196] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} time: 00:36:44 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053196/ [6053197] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests_journaling} time: 00:34:01 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053197/ [6053198] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/rbd_python_api_tests_old_format} time: 00:17:14 info: http://pulpito.ceph.com/teuthology-2021-04-17_06:07:03-rbd-pacific-distro-basic-smithi/6053198/